-- Logs begin at Wed 2021-12-15 02:18:02 UTC, end at Wed 2021-12-15 03:48:56 UTC. -- Dec 15 02:50:06.425019 dv-cinder-818037-9-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Dec 15 02:50:06.434215 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 02:50:06 2021] *** Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: nodename: dv-cinder-818037-9-iscsi Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: machine: x86_64 Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: clock source: unix Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: pcre jit disabled Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: detected number of CPU cores: 4 Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: current working directory: / Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: detected binary path: /usr/bin/uwsgi-core Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: your processes number limit is 47680 Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: your memory page size is 4096 bytes Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: detected max file descriptor number: 2048 Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: lock engine: pthread robust mutexes Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: thunder lock: enabled Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Dec 15 02:50:06.435720 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 02:50:06.481726 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: Python main interpreter initialized at 0x5632715ea9c0 Dec 15 02:50:06.481726 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: python threads support enabled Dec 15 02:50:06.481726 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: your server socket listen backlog is limited to 100 connections Dec 15 02:50:06.481726 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: your mercy for graceful operations on workers is 90 seconds Dec 15 02:50:06.482072 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 02:50:06.482072 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: *** Operational MODE: preforking *** Dec 15 02:50:06.482370 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: *** uWSGI is running in multiple interpreter mode *** Dec 15 02:50:06.482370 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: spawned uWSGI master process (pid: 79154) Dec 15 02:50:06.482572 dv-cinder-818037-9-iscsi systemd[1]: Started Devstack devstack@keystone.service. Dec 15 02:50:06.486686 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: spawned uWSGI worker 1 (pid: 79172, cores: 1) Dec 15 02:50:06.486686 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: spawned uWSGI worker 2 (pid: 79173, cores: 1) Dec 15 02:50:06.486686 dv-cinder-818037-9-iscsi devstack@keystone.service[79154]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 02:50:11.773568 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 02:50:11.773568 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: from cryptography.utils import int_from_bytes Dec 15 02:50:11.774374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 02:50:11.774374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: from cryptography.utils import int_from_bytes Dec 15 02:50:11.774778 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 02:50:11.774778 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: from cryptography.utils import int_from_bytes Dec 15 02:50:11.774893 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 02:50:11.774893 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: from cryptography.utils import int_from_bytes Dec 15 02:50:11.822482 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 02:50:11.822668 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 02:50:11.822838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 02:50:11.822931 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] command line args: [] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 02:50:11.823034 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 02:50:11.823118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 02:50:11.823228 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] command line args: [] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 02:50:11.823305 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ================================================================================ {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 02:50:11.823497 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 02:50:11.823585 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] admin_token = **** {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.823661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ================================================================================ {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 02:50:11.823736 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] config_dir = [] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.823911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.823994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] admin_token = **** {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.824090 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] config_source = [] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.824174 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] config_dir = [] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.824269 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] debug = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.824351 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.824464 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.824719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] config_source = [] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.824719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] debug = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.824844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.824908 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.824994 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.825058 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.825228 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.825335 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.825476 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.825590 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.825691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] list_limit = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.825784 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.825886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] log_config_append = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.826019 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] list_limit = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.826126 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.826230 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] log_config_append = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.826330 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] log_dir = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.826430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.826536 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] log_file = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.826636 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] log_dir = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.826736 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.826857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] log_file = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.826937 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.827057 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.827139 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.827210 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.827287 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.827365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.827462 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.827546 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.827627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.827757 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.827867 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.827943 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.828110 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.828233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.828340 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.828422 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.828570 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.828652 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.828798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.828917 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.829579 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.829669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.829815 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.829925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.830084 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.830173 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.830333 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.830454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.830706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.830942 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.831124 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] publish_errors = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.831239 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.831358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.831445 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] publish_errors = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.831590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.831668 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.831768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.831844 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.832001 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.832132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.832278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.832355 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.832460 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] standard_threads = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.832596 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.832699 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.832804 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] standard_threads = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.832926 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.833011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.833104 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.833193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.833272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] use_journal = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.833344 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.833422 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] use_json = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.833495 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] use_journal = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.833595 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] use_stderr = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.833681 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] use_json = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.833759 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] use_syslog = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.833830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] use_stderr = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.834002 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] use_syslog = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.834083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.834245 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:50:11.834336 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.834491 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.834574 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.834735 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.834819 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.834979 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.835064 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.835230 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.835314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.835468 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.835547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.835711 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.835869 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.835951 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.836026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.836182 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.836267 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.836429 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.836518 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.836677 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.836761 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.836910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.836989 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.837150 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.837237 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.837383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.837459 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.837627 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.837704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.837874 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.837960 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.838142 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.838240 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.838380 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.838459 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.838639 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.838728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.838888 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.838967 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.839123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.839207 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.839362 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.839439 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.839622 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.839709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.839876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.839959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.840125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.840204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.840356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.840434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.840587 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.840664 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.840819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.840907 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.841051 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.841134 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.841286 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.841362 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.841531 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.841611 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.841760 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.841838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.842025 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.842108 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.842243 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.842321 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.842489 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.842565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.842722 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.842800 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.842966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.843048 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.843193 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.843275 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.843427 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.843510 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.843660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.843738 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.843888 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.843965 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.844116 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.844193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.844343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.844421 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.844598 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.844679 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.844830 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.844906 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.845066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.845144 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.845291 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.845374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.845523 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.845600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.845749 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.845839 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.845996 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.846102 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.846233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.846344 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.846478 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.846583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.846688 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.846784 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.846919 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.847024 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.847152 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.847237 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.847382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.847462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.847617 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.847701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.847845 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.847922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.848072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.848154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.848303 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.848392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.848536 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.848629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.848768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.848854 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.848997 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.849084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.849228 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.849315 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.849471 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.849556 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.849698 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.849772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.849929 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.850042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.850193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.850272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.850434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.850514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.850673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.850767 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.850922 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.851022 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.851139 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.851221 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.851382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.851477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.851615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.851700 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.851847 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.851927 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.852078 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.852165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.852311 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.852543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.852621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.852773 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.852860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.853030 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.853112 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.853265 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.853345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.853502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.853581 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.853730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.853811 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.853958 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.854109 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.854204 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.854279 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.854429 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.854510 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.854656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.854736 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.854894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.854973 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.855125 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.855204 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.855371 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.855459 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.855603 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.855680 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.855852 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.855941 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.856094 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.856174 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.856334 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.856413 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.856563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] auth.external = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.856649 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.856790 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.856877 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.857057 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] auth.external = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.857138 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.857291 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.857381 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.857524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] auth.password = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.857603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.857753 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] auth.token = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.857839 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.858003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.858097 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] auth.password = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.858245 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.858331 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] auth.token = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.858492 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.858571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.858720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.858806 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.858967 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.859047 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.859198 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.859282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.859427 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.859513 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.859661 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] credential.caching = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.859769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.859907 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.859995 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.860167 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] credential.caching = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.860246 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.860413 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.860503 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.860648 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.860734 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.860888 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.860968 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.861120 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.861208 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.861364 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.861442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.861601 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.861681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.861835 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.861923 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.862119 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.862201 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.862360 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.862440 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.862615 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.862704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.862873 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.862951 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.863111 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.863192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.863364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.863452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.863597 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] federation.caching = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.863677 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.863848 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.863928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.864084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] federation.caching = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.864171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.864327 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.864406 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.864555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.864643 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.864799 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.864888 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.865031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.865120 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.865279 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.865358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.865508 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.865587 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.865758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.865837 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.866029 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.866113 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.866257 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.866338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.866490 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity.caching = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.866578 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.866736 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.866815 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.866961 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity.caching = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.867037 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.867199 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.867278 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.867436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.867515 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.867674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.867754 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.867902 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.867988 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.868136 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.868216 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.868368 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.868448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.868607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.868686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.868838 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.868915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.869067 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.869148 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.869295 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.869375 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.869536 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.869616 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.869767 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.869846 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.870029 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.870126 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.870284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.870369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.870529 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.870610 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.870786 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.870865 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.871020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.871098 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.871253 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.871333 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.871483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.871563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.871718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.871798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.871947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.872028 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.872181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.872260 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.872411 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.872496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.872645 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.872724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.872884 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.872962 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.873110 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.873188 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.873356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.873436 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.873586 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.873665 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.873824 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.873902 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.874096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.874176 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.874336 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.874415 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.874561 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.874641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.874784 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.874866 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.875011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.875090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.875244 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.875332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.875476 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.875556 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.876230 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.876315 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.876469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.876557 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.876703 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.876782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.876939 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.877018 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.877175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.877263 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.877404 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.877482 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.877632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.877712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.877881 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.877968 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.878125 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.878200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.878373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.878453 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.878603 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.878690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.878835 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.878915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.879061 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.879144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.879294 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.879381 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.879526 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.879605 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.879764 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.879843 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.880009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.880100 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.880249 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.880328 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.880491 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.880570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.880722 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.880810 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.880951 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.881032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.881181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.881260 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.881411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.881499 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.881642 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.881728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.881872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.881952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.882130 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.882222 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.882368 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.882454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.882611 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.882690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.882856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.882948 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.883100 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.883180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.883330 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.883409 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.883572 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.883663 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.883804 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.883884 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.884036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.884116 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.884270 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.884359 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.884501 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.884582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.884737 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.884815 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.884974 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.885061 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.885207 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.885285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.885725 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.885811 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.885958 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.886100 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.886222 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.886303 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.886454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.886534 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.886687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.886776 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.886920 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.887000 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.887156 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.887235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.887390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.887477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.887620 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.887699 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.887855 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.887935 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.888091 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.888177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] resource.caching = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.888330 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.888410 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.888571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] resource.caching = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.888657 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.888800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.888889 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.889047 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.889127 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.889284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.889364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.889514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.889600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.889758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.889838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.890007 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.890089 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.890250 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.890411 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.890488 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] role.caching = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.890560 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.890711 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] role.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.890791 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.890937 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.891026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] role.caching = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.891181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.891262 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] role.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.891969 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.892060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.892227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.892309 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.892482 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.892563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.892734 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.892814 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.892985 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.893070 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.893235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.893313 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.893485 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.893565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.893714 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.893796 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.893960 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.894108 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.894214 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.894293 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.894465 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.894547 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.894708 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.894787 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.894958 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.895096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.895210 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.895328 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.895578 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.895663 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.895826 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.895904 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.896072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.896152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.896317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.896397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.896548 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.896629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.896796 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.896877 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.897029 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.897108 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.897264 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.897350 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.897492 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.897572 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.897720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.897804 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.897954 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.898114 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.898192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.898264 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.898429 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.898509 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.898680 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.898768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.898917 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.898995 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.899156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.899235 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.899375 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.899462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.899606 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] token.caching = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.899695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.899839 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.899918 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.900080 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] token.caching = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.900166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.900312 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.900391 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.900560 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.900638 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.900798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.900885 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.901027 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.901105 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.901267 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.901347 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.901506 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.901593 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.901747 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.901825 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.901995 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.902076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.902237 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.902328 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.902469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.902548 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.902706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.902784 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.902943 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.903031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.903166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.903246 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.903404 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.903483 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.903643 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.903730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.903886 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.903966 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.connection = **** {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.904135 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.904214 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.904380 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.904467 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.connection = **** {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.904612 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.904692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.904849 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.904929 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.905102 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.905237 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.905316 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.905388 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.905534 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.905614 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.905766 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.905854 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.906026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.906110 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.906269 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.906349 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.906508 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.906597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.906742 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.906826 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.907026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.907118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.907265 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.907350 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.907508 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.907589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.907737 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.907819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.907980 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.908059 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.908209 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.908288 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.908370 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 02:50:11.908444 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.908673 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:50:11.908843 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 02:50:11.937067 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:11.937296 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:11.937381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:11.937520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:11.937607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:11.937823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:11.946683 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:11.947021 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:11.976799 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:11.977025 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:11.977253 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:11.977486 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.030222 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.030344 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.081385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.081611 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.083362 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.083599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.148764 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.148986 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.149203 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.149373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.149480 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.149606 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.149691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.149813 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.149896 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.150063 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.150284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.150501 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.173192 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.173300 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.173418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.173521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.173644 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.173738 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.173866 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.173950 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.174107 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.174194 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.174319 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.174402 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.174528 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.174620 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.185693 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.185792 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.198338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.198496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.198586 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.198724 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.198809 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.198944 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.199075 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.199180 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.199311 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.199804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.199913 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.200014 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.200113 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.200223 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 02:50:12.217205 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.217411 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 02:50:12.217532 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.217741 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 02:50:12.217845 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.217926 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 02:50:12.218094 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.218218 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.218302 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 02:50:12.218479 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.218566 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.218734 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.218816 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.218986 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.219067 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.219254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.230295 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.230474 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.230559 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.230748 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.230845 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.231017 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.231100 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.231294 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.239149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.239445 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.242348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.242621 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.242705 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.242896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.242979 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.243175 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.243259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.243451 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.243535 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.243706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.243798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.243968 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.244052 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.244228 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.244308 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.244490 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.244579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.244758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.244839 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.245019 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.245100 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.245281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.271603 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.272511 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.273166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.273439 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.274132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.274412 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.278562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.279642 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.279920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.280552 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.280794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.281915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.288441 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.288716 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.289629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.289909 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.293053 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.293332 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.293611 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.293887 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.294182 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.294299 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.294452 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.294582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.294716 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.294863 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.294979 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.295143 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.295410 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.295678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.295948 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.296214 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.313210 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.313487 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.314523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.314798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.317921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.319261 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.321507 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.321895 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.322807 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.323097 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.326824 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.328085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.330919 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.332166 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.334625 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.334917 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.335194 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.335468 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.335747 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.335841 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.336029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.336113 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.336405 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.336685 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.336970 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.337258 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.355291 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.355565 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.355823 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.356079 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.356510 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.356788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.357051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.357568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.363755 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.365345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.365423 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.365679 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.367078 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.367352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.368836 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.369110 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.369384 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.369673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.369954 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.370500 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.370776 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.371052 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.371326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.371607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.382905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.383176 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.383446 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.383714 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.384087 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.384361 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.384631 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.384723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.384930 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.385208 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.385739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.386037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.386414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.386703 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.402898 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.404814 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.406066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.408582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.409911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.411636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.411836 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.413222 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.413493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.413577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.413767 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.415184 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.415461 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.415739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.420900 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.422473 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.422921 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.424493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.425623 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.425916 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.426341 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.426622 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.427674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.427970 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.428365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.428650 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.435537 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.435826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.436102 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.437667 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.438017 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.438867 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.444244 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.444515 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.444784 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.445056 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.445322 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.445702 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.446008 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.446284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.446549 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.446632 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 02:50:12.446813 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.446896 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.447077 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.447168 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.447331 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.447414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.447603 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.447686 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.447868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.448020 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.448305 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.448581 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.448849 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.449116 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.449384 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.449652 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.449927 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.450220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 02:50:12.485257 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632715ea9c0 pid: 79172 (default app) Dec 15 02:50:12.487923 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632715ea9c0 pid: 79173 (default app) Dec 15 02:50:12.488637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbf4f0-9a93-41b7-8407-11c571c351e9 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:12.488923 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbf4f0-9a93-41b7-8407-11c571c351e9 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:12.489198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbf4f0-9a93-41b7-8407-11c571c351e9 None None] PATH_INFO: `/v3` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:12.493349 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Wed Dec 15 02:50:12 2021] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:20.280553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b39a-b7e8-4266-aa0c-013355e23cfb None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:20.281012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b39a-b7e8-4266-aa0c-013355e23cfb None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:20.281114 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b39a-b7e8-4266-aa0c-013355e23cfb None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:20.286175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:20 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:20.291793 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4861-0544-4bdb-9060-137eeb5fec2c None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:20.292145 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4861-0544-4bdb-9060-137eeb5fec2c None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:20.292351 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4861-0544-4bdb-9060-137eeb5fec2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:20.324988 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG oslo_db.sqlalchemy.engines [None req-17df4861-0544-4bdb-9060-137eeb5fec2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 02:50:20.519698 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG passlib.handlers.bcrypt [None req-17df4861-0544-4bdb-9060-137eeb5fec2c None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79172) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 15 02:50:20.520027 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG passlib.handlers.bcrypt [None req-17df4861-0544-4bdb-9060-137eeb5fec2c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79172) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 15 02:50:20.574741 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-17df4861-0544-4bdb-9060-137eeb5fec2c None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:20.576331 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-17df4861-0544-4bdb-9060-137eeb5fec2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:20.700285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:20.846490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0b39a-b7e8-4266-aa0c-013355e23cfb None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:20.879983 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG oslo_db.sqlalchemy.engines [None req-48a0b39a-b7e8-4266-aa0c-013355e23cfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 02:50:21.005257 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0b39a-b7e8-4266-aa0c-013355e23cfb None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:21.009390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dee26-7c56-448a-95e5-ff82bd1d5911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:21.010055 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dee26-7c56-448a-95e5-ff82bd1d5911 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:21.010591 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dee26-7c56-448a-95e5-ff82bd1d5911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:21.010876 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dee26-7c56-448a-95e5-ff82bd1d5911 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:21.018686 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dee26-7c56-448a-95e5-ff82bd1d5911 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:21.070333 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0c9dee26-7c56-448a-95e5-ff82bd1d5911 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 15 02:50:21.070682 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dee26-7c56-448a-95e5-ff82bd1d5911 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:21.080387 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 02:50:21.086970 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df4861-0544-4bdb-9060-137eeb5fec2c None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:21.101464 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df4861-0544-4bdb-9060-137eeb5fec2c None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:21.105756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c285acd-5a2c-4cc8-9ba1-b2820a5630c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:21.106877 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c285acd-5a2c-4cc8-9ba1-b2820a5630c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:21.107164 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c285acd-5a2c-4cc8-9ba1-b2820a5630c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:21.107438 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c285acd-5a2c-4cc8-9ba1-b2820a5630c1 admin admin] PATH_INFO: `/v3/projects/f289697819814b2daa5373dc010a1dbf` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:21.108922 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c285acd-5a2c-4cc8-9ba1-b2820a5630c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=f289697819814b2daa5373dc010a1dbf)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:21.161797 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8c285acd-5a2c-4cc8-9ba1-b2820a5630c1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 15 02:50:21.162148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c285acd-5a2c-4cc8-9ba1-b2820a5630c1 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:21.166733 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:21 2021] GET /identity/v3/projects/f289697819814b2daa5373dc010a1dbf => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:23.450458 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8f2d6-aa57-41b4-92ad-d0b88d6d0111 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:23.450974 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8f2d6-aa57-41b4-92ad-d0b88d6d0111 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:23.451082 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8f2d6-aa57-41b4-92ad-d0b88d6d0111 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:23.456083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:23 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:23.462193 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380ad5a-0cc6-45dd-9218-cdf2a7592232 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:23.462599 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380ad5a-0cc6-45dd-9218-cdf2a7592232 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:23.462705 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380ad5a-0cc6-45dd-9218-cdf2a7592232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:23.481425 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-9380ad5a-0cc6-45dd-9218-cdf2a7592232 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:23.482968 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9380ad5a-0cc6-45dd-9218-cdf2a7592232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:23.490704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:23.513282 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8f2d6-aa57-41b4-92ad-d0b88d6d0111 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:23.525626 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8f2d6-aa57-41b4-92ad-d0b88d6d0111 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:23.529783 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ed75e-b7bb-4842-9cff-2a18be6ab8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:23.530438 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ed75e-b7bb-4842-9cff-2a18be6ab8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:23.530720 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ed75e-b7bb-4842-9cff-2a18be6ab8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:23.530994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ed75e-b7bb-4842-9cff-2a18be6ab8a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:23.539067 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ed75e-b7bb-4842-9cff-2a18be6ab8a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:23.540819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ed75e-b7bb-4842-9cff-2a18be6ab8a3 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:23.549305 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:50:23.554800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380ad5a-0cc6-45dd-9218-cdf2a7592232 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:23.563464 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380ad5a-0cc6-45dd-9218-cdf2a7592232 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:23.567764 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6975ad-abf8-47b3-9807-03dce0ccedfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:23.568590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6975ad-abf8-47b3-9807-03dce0ccedfd admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:23.568873 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6975ad-abf8-47b3-9807-03dce0ccedfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:23.569149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6975ad-abf8-47b3-9807-03dce0ccedfd admin admin] PATH_INFO: `/v3/users/3bbde01a62314e839f70db08ddf77996` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:23.570560 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6975ad-abf8-47b3-9807-03dce0ccedfd admin admin] RBAC: Authorizing `identity:get_user(user_id=3bbde01a62314e839f70db08ddf77996)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:23.572404 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6975ad-abf8-47b3-9807-03dce0ccedfd admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:23.573930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:23 2021] GET /identity/v3/users/3bbde01a62314e839f70db08ddf77996 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:25.956694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a822774-10a8-43e2-af71-b97cbd998fa4 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:25.957221 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a822774-10a8-43e2-af71-b97cbd998fa4 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:25.957329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a822774-10a8-43e2-af71-b97cbd998fa4 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:25.959094 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:25.964780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a7d5f-01cb-4d2f-b88d-9ef04fbbc887 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:25.965179 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a7d5f-01cb-4d2f-b88d-9ef04fbbc887 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:25.965453 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a7d5f-01cb-4d2f-b88d-9ef04fbbc887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:25.967416 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52ce52-fe80-4159-bf7c-8365281c920e None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:25.967704 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52ce52-fe80-4159-bf7c-8365281c920e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:25.967983 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52ce52-fe80-4159-bf7c-8365281c920e None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:25.970079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:50:25.976038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935970a-2af9-463e-98c9-dc87a679530a None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:25.976328 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935970a-2af9-463e-98c9-dc87a679530a None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:25.976609 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935970a-2af9-463e-98c9-dc87a679530a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:25.983860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-9c5a7d5f-01cb-4d2f-b88d-9ef04fbbc887 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:25.985593 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9c5a7d5f-01cb-4d2f-b88d-9ef04fbbc887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:25.992904 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:26.016449 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a7d5f-01cb-4d2f-b88d-9ef04fbbc887 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:26.019174 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG passlib.handlers.bcrypt [None req-a935970a-2af9-463e-98c9-dc87a679530a None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79173) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 15 02:50:26.019603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG passlib.handlers.bcrypt [None req-a935970a-2af9-463e-98c9-dc87a679530a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79173) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 15 02:50:26.024911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a7d5f-01cb-4d2f-b88d-9ef04fbbc887 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:26.029147 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7465c-9624-4a37-b5a4-dcfc5cdc314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:26.029903 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7465c-9624-4a37-b5a4-dcfc5cdc314b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:26.030211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7465c-9624-4a37-b5a4-dcfc5cdc314b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:26.030484 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7465c-9624-4a37-b5a4-dcfc5cdc314b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:26.043347 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7465c-9624-4a37-b5a4-dcfc5cdc314b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:26.050817 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-23b7465c-9624-4a37-b5a4-dcfc5cdc314b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:50:26.051949 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 7/13] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:50:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:50:26.057578 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7465c-9624-4a37-b5a4-dcfc5cdc314b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:26.066354 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7465c-9624-4a37-b5a4-dcfc5cdc314b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:26.066459 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a935970a-2af9-463e-98c9-dc87a679530a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:26.068010 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a935970a-2af9-463e-98c9-dc87a679530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:26.070538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44272457-9b8d-4789-9a8f-8f48b9018867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:26.071119 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44272457-9b8d-4789-9a8f-8f48b9018867 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:26.071397 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44272457-9b8d-4789-9a8f-8f48b9018867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:26.071669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44272457-9b8d-4789-9a8f-8f48b9018867 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:26.072403 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44272457-9b8d-4789-9a8f-8f48b9018867 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:26.072701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44272457-9b8d-4789-9a8f-8f48b9018867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:26.074448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-44272457-9b8d-4789-9a8f-8f48b9018867 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:50:26.074448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:50:26.074448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:50:26.075333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44272457-9b8d-4789-9a8f-8f48b9018867 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:26.088714 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 8/14] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:26.089611 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 7/15] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:26.094670 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44272457-9b8d-4789-9a8f-8f48b9018867 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:26.103643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44272457-9b8d-4789-9a8f-8f48b9018867 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:26.107918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b42a2f-1aaa-4ad4-9d2d-f948233b5912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:26.108720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b42a2f-1aaa-4ad4-9d2d-f948233b5912 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:26.108998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b42a2f-1aaa-4ad4-9d2d-f948233b5912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:26.109269 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b42a2f-1aaa-4ad4-9d2d-f948233b5912 admin admin] PATH_INFO: `/v3/users/3bbde01a62314e839f70db08ddf77996` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:26.111038 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b42a2f-1aaa-4ad4-9d2d-f948233b5912 admin admin] RBAC: Authorizing `identity:get_user(user_id=3bbde01a62314e839f70db08ddf77996)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:26.112822 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b42a2f-1aaa-4ad4-9d2d-f948233b5912 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:26.113535 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935970a-2af9-463e-98c9-dc87a679530a None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:26.114352 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 9/16] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:26 2021] GET /identity/v3/users/3bbde01a62314e839f70db08ddf77996 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:26.119683 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b42a2f-1aaa-4ad4-9d2d-f948233b5912 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:26.122871 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935970a-2af9-463e-98c9-dc87a679530a None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:26.127273 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4980da2-8fc9-4724-af66-242c68bc39fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:26.128224 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4980da2-8fc9-4724-af66-242c68bc39fe admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:26.128513 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4980da2-8fc9-4724-af66-242c68bc39fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:26.128599 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b42a2f-1aaa-4ad4-9d2d-f948233b5912 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:26.128792 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4980da2-8fc9-4724-af66-242c68bc39fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:26.132776 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701848c-577a-41b4-bb31-f8c32db7f0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:26.133474 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701848c-577a-41b4-bb31-f8c32db7f0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:26.133748 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701848c-577a-41b4-bb31-f8c32db7f0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:26.134036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701848c-577a-41b4-bb31-f8c32db7f0f4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:26.135182 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701848c-577a-41b4-bb31-f8c32db7f0f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:26.136953 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4980da2-8fc9-4724-af66-242c68bc39fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:26.137054 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701848c-577a-41b4-bb31-f8c32db7f0f4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:26.138544 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 10/17] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:50:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:26.138808 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4980da2-8fc9-4724-af66-242c68bc39fe admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:26.144175 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701848c-577a-41b4-bb31-f8c32db7f0f4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:26.147921 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 8/18] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 02:50:26.152940 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701848c-577a-41b4-bb31-f8c32db7f0f4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:26.153383 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4980da2-8fc9-4724-af66-242c68bc39fe admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:26.157783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203f010-7dbe-4891-8fbd-8c79a2fa5350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:26.158396 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203f010-7dbe-4891-8fbd-8c79a2fa5350 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:26.158677 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203f010-7dbe-4891-8fbd-8c79a2fa5350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:26.158951 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203f010-7dbe-4891-8fbd-8c79a2fa5350 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:26.159758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203f010-7dbe-4891-8fbd-8c79a2fa5350 admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.domain.id=default, user.id=3bbde01a62314e839f70db08ddf77996) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:26.160058 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203f010-7dbe-4891-8fbd-8c79a2fa5350 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:26.161010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-0203f010-7dbe-4891-8fbd-8c79a2fa5350 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:50:26.161010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:50:26.161010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:50:26.162089 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4980da2-8fc9-4724-af66-242c68bc39fe admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:26.162176 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203f010-7dbe-4891-8fbd-8c79a2fa5350 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:26.166423 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bdcae-17a7-4edf-b07e-e5c26107ec7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:26.167153 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bdcae-17a7-4edf-b07e-e5c26107ec7a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:26.167433 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bdcae-17a7-4edf-b07e-e5c26107ec7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:26.167707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bdcae-17a7-4edf-b07e-e5c26107ec7a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:26.168730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 11/19] 10.222.0.18 () {56 vars in 1343 bytes} [Wed Dec 15 02:50:26 2021] GET /identity/v3/role_assignments?user.id=3bbde01a62314e839f70db08ddf77996&scope.domain.id=default&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 233 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:26.169121 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bdcae-17a7-4edf-b07e-e5c26107ec7a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:26.170923 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bdcae-17a7-4edf-b07e-e5c26107ec7a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:26.173080 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 9/20] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:50:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:29.083582 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe11e0-9e35-45fa-842b-96794f4eda11 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.084126 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe11e0-9e35-45fa-842b-96794f4eda11 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.084126 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe11e0-9e35-45fa-842b-96794f4eda11 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.086364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 12/21] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:29.103978 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f808312-ed5f-4129-8949-fdbad958e3b3 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.104439 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f808312-ed5f-4129-8949-fdbad958e3b3 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.104511 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f808312-ed5f-4129-8949-fdbad958e3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.135180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-9f808312-ed5f-4129-8949-fdbad958e3b3 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:29.136612 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-9f808312-ed5f-4129-8949-fdbad958e3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:29.149305 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 10/22] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:29.182339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe11e0-9e35-45fa-842b-96794f4eda11 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:29.217268 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe11e0-9e35-45fa-842b-96794f4eda11 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:29.222147 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9116059-2931-4332-bd07-f8f69a033074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:29.223183 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9116059-2931-4332-bd07-f8f69a033074 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.223671 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9116059-2931-4332-bd07-f8f69a033074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.224166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9116059-2931-4332-bd07-f8f69a033074 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.270922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676098c-cbf8-4417-8f75-60bb35b86995 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.275888 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676098c-cbf8-4417-8f75-60bb35b86995 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.276512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676098c-cbf8-4417-8f75-60bb35b86995 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.278723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 11/23] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:29 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:50:29.285564 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a8c11-dc39-4ff0-8b58-91827e70a9d5 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.286096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a8c11-dc39-4ff0-8b58-91827e70a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.286537 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a8c11-dc39-4ff0-8b58-91827e70a9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.330215 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-f98a8c11-dc39-4ff0-8b58-91827e70a9d5 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:29.331687 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f98a8c11-dc39-4ff0-8b58-91827e70a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:29.352982 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9116059-2931-4332-bd07-f8f69a033074 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:29.356556 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 12/24] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:29.361187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-f9116059-2931-4332-bd07-f8f69a033074 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:50:29.366110 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 13/25] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:50:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:29.369199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a8c11-dc39-4ff0-8b58-91827e70a9d5 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:29.383880 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a8c11-dc39-4ff0-8b58-91827e70a9d5 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:29.396417 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bee3e-c90d-4bb1-a254-791c186ccd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:29.397035 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9116059-2931-4332-bd07-f8f69a033074 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:29.397502 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bee3e-c90d-4bb1-a254-791c186ccd6c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.398051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bee3e-c90d-4bb1-a254-791c186ccd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.398482 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bee3e-c90d-4bb1-a254-791c186ccd6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.399392 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bee3e-c90d-4bb1-a254-791c186ccd6c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:29.399847 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bee3e-c90d-4bb1-a254-791c186ccd6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:29.401718 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-5e0bee3e-c90d-4bb1-a254-791c186ccd6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:50:29.401718 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:50:29.401718 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:50:29.402881 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bee3e-c90d-4bb1-a254-791c186ccd6c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:29.411147 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9116059-2931-4332-bd07-f8f69a033074 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:29.419124 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 13/26] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:29.421149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b081a3-010d-4852-9b2f-2d19ac5a05c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:29.422687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b081a3-010d-4852-9b2f-2d19ac5a05c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.423111 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b081a3-010d-4852-9b2f-2d19ac5a05c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.423525 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b081a3-010d-4852-9b2f-2d19ac5a05c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.425824 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bee3e-c90d-4bb1-a254-791c186ccd6c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:29.443132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bee3e-c90d-4bb1-a254-791c186ccd6c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:29.447978 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b081a3-010d-4852-9b2f-2d19ac5a05c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:29.450382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b081a3-010d-4852-9b2f-2d19ac5a05c7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:29.462741 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41956fcc-a802-4118-b28f-71cc2b6a1c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:29.463882 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41956fcc-a802-4118-b28f-71cc2b6a1c07 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.464305 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41956fcc-a802-4118-b28f-71cc2b6a1c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.464715 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41956fcc-a802-4118-b28f-71cc2b6a1c07 admin admin] PATH_INFO: `/v3/users/3bbde01a62314e839f70db08ddf77996` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.466417 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41956fcc-a802-4118-b28f-71cc2b6a1c07 admin admin] RBAC: Authorizing `identity:get_user(user_id=3bbde01a62314e839f70db08ddf77996)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:29.468404 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41956fcc-a802-4118-b28f-71cc2b6a1c07 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:29.470107 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-97b081a3-010d-4852-9b2f-2d19ac5a05c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:50:29.470416 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 14/27] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:29 2021] GET /identity/v3/users/3bbde01a62314e839f70db08ddf77996 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:29.471600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf517874-e307-43b1-97db-8b3eec25854b None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.471881 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf517874-e307-43b1-97db-8b3eec25854b None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.472155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf517874-e307-43b1-97db-8b3eec25854b None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.472734 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 14/28] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:50:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:50:29.474018 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 15/29] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:29.479015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b081a3-010d-4852-9b2f-2d19ac5a05c7 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:29.480028 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf517874-e307-43b1-97db-8b3eec25854b None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:29.493949 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b081a3-010d-4852-9b2f-2d19ac5a05c7 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:29.496862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf517874-e307-43b1-97db-8b3eec25854b None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:29.504339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afadf15-106b-465c-8e2e-245c6194171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:29.505080 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d03db-b3f1-4a86-9a29-d941f450a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:29.506682 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d03db-b3f1-4a86-9a29-d941f450a434 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.507012 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afadf15-106b-465c-8e2e-245c6194171d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.507516 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afadf15-106b-465c-8e2e-245c6194171d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.507987 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d03db-b3f1-4a86-9a29-d941f450a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.508454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afadf15-106b-465c-8e2e-245c6194171d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.508921 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d03db-b3f1-4a86-9a29-d941f450a434 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.510695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d03db-b3f1-4a86-9a29-d941f450a434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:29.511569 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afadf15-106b-465c-8e2e-245c6194171d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:29.512088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d03db-b3f1-4a86-9a29-d941f450a434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:29.514011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afadf15-106b-465c-8e2e-245c6194171d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:29.516160 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 15/30] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:50:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:29.516992 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-f00d03db-b3f1-4a86-9a29-d941f450a434 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:50:29.516992 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:50:29.516992 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:50:29.517917 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d03db-b3f1-4a86-9a29-d941f450a434 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:29.518123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c48bd2-8c49-4e9f-8988-998dd6fafae8 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.518585 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c48bd2-8c49-4e9f-8988-998dd6fafae8 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.519052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c48bd2-8c49-4e9f-8988-998dd6fafae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.545269 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 16/31] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:50:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:29.546449 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d03db-b3f1-4a86-9a29-d941f450a434 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:29.550901 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-40c48bd2-8c49-4e9f-8988-998dd6fafae8 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:29.552317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-40c48bd2-8c49-4e9f-8988-998dd6fafae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:29.566371 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 16/32] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:29.567581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c48bd2-8c49-4e9f-8988-998dd6fafae8 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:29.570037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d03db-b3f1-4a86-9a29-d941f450a434 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:29.576844 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87680793-88b2-4133-bda0-4f847737e425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:29.578017 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87680793-88b2-4133-bda0-4f847737e425 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.578669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87680793-88b2-4133-bda0-4f847737e425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.579183 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87680793-88b2-4133-bda0-4f847737e425 admin admin] PATH_INFO: `/v3/domains/default/users/3bbde01a62314e839f70db08ddf77996/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.581781 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87680793-88b2-4133-bda0-4f847737e425 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3bbde01a62314e839f70db08ddf77996, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:29.587448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c48bd2-8c49-4e9f-8988-998dd6fafae8 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:29.589475 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-87680793-88b2-4133-bda0-4f847737e425 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:50:29.589475 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:50:29.589475 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:50:29.593298 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d5daf-63a2-45bd-a701-7464a9dbe013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:29.597868 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87680793-88b2-4133-bda0-4f847737e425 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:29.599005 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d5daf-63a2-45bd-a701-7464a9dbe013 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.599490 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d5daf-63a2-45bd-a701-7464a9dbe013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.599984 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d5daf-63a2-45bd-a701-7464a9dbe013 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.600913 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d5daf-63a2-45bd-a701-7464a9dbe013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:29.602170 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-374d5daf-63a2-45bd-a701-7464a9dbe013 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:50:29.602170 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:50:29.602170 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:50:29.603813 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d5daf-63a2-45bd-a701-7464a9dbe013 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:29.788461 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 17/33] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Dec 15 02:50:29 2021] POST /identity/v3/projects => generated 301 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:50:29.789839 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d5daf-63a2-45bd-a701-7464a9dbe013 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:29.864131 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 17/34] 10.222.0.18 () {58 vars in 1382 bytes} [Wed Dec 15 02:50:29 2021] PUT /identity/v3/domains/default/users/3bbde01a62314e839f70db08ddf77996/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:50:29.866306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158e155-4409-42e5-a487-7a1c1fd8d035 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.866786 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158e155-4409-42e5-a487-7a1c1fd8d035 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.867235 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158e155-4409-42e5-a487-7a1c1fd8d035 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.872608 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 18/35] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:29 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:29.878326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec468c6-1a9c-4b1e-ac8c-5b603d357fe0 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.878844 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec468c6-1a9c-4b1e-ac8c-5b603d357fe0 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.879277 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec468c6-1a9c-4b1e-ac8c-5b603d357fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.881681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d5daf-63a2-45bd-a701-7464a9dbe013 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:29.887143 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca5793-182b-47a0-a8bd-6b083f4af77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:29.888218 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca5793-182b-47a0-a8bd-6b083f4af77d admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.888770 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca5793-182b-47a0-a8bd-6b083f4af77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.889246 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca5793-182b-47a0-a8bd-6b083f4af77d admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.890400 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca5793-182b-47a0-a8bd-6b083f4af77d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:29.891918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-08ca5793-182b-47a0-a8bd-6b083f4af77d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:50:29.891918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:50:29.891918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:50:29.893254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca5793-182b-47a0-a8bd-6b083f4af77d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:29.912093 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-9ec468c6-1a9c-4b1e-ac8c-5b603d357fe0 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:29.914666 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-9ec468c6-1a9c-4b1e-ac8c-5b603d357fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:29.923284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 18/36] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 02:50:29 2021] POST /identity/v3/roles => generated 225 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:50:29.934397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 19/37] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:29.974950 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca5793-182b-47a0-a8bd-6b083f4af77d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:29.992294 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca5793-182b-47a0-a8bd-6b083f4af77d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:29.997378 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff9073-e400-4b31-8078-327194d77ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:29.998099 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff9073-e400-4b31-8078-327194d77ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:29.998382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff9073-e400-4b31-8078-327194d77ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:29.998656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff9073-e400-4b31-8078-327194d77ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:29.999471 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff9073-e400-4b31-8078-327194d77ab4 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:30.001273 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff9073-e400-4b31-8078-327194d77ab4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:30.033234 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 19/38] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 02:50:29 2021] POST /identity/v3/roles => generated 219 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:50:30.388135 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c0c26-9d27-41bd-bed0-0caa4ae58230 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:30.389155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c0c26-9d27-41bd-bed0-0caa4ae58230 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:30.389674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c0c26-9d27-41bd-bed0-0caa4ae58230 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:30.392631 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 20/39] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:30 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:30.399562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3c6fb-9103-4004-887d-cfdb3d47290a None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:30.400021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3c6fb-9103-4004-887d-cfdb3d47290a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:30.400245 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3c6fb-9103-4004-887d-cfdb3d47290a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:30.423582 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c5d3c6fb-9103-4004-887d-cfdb3d47290a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:30.425117 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c5d3c6fb-9103-4004-887d-cfdb3d47290a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:30.434473 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 20/40] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:30.461615 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c0c26-9d27-41bd-bed0-0caa4ae58230 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:30.474890 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c0c26-9d27-41bd-bed0-0caa4ae58230 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:30.479125 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc9944-b84e-4ce0-87cc-599110d5f4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:30.479781 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc9944-b84e-4ce0-87cc-599110d5f4aa admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:30.480061 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc9944-b84e-4ce0-87cc-599110d5f4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:30.480335 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc9944-b84e-4ce0-87cc-599110d5f4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:30.481113 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc9944-b84e-4ce0-87cc-599110d5f4aa admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:30.482350 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-a4cc9944-b84e-4ce0-87cc-599110d5f4aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:50:30.482350 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:50:30.482350 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:50:30.483277 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc9944-b84e-4ce0-87cc-599110d5f4aa admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:30.497404 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 21/41] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 02:50:30 2021] POST /identity/v3/roles => generated 223 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:50:30.743833 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7737668-ea75-483f-9656-bc50c58b9147 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:30.744083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7737668-ea75-483f-9656-bc50c58b9147 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:30.744321 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7737668-ea75-483f-9656-bc50c58b9147 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:30.746156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 21/42] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:30.752540 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516168e-23f4-4cd4-9ddf-13050dc2e6e4 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:30.752835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516168e-23f4-4cd4-9ddf-13050dc2e6e4 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:30.753120 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516168e-23f4-4cd4-9ddf-13050dc2e6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:30.771553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-c516168e-23f4-4cd4-9ddf-13050dc2e6e4 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:30.772741 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c516168e-23f4-4cd4-9ddf-13050dc2e6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:30.780144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 22/43] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:30.803614 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7737668-ea75-483f-9656-bc50c58b9147 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:30.815885 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7737668-ea75-483f-9656-bc50c58b9147 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:30.820035 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8164cbc-c92d-4e95-91b8-e196edfaa6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:30.820801 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8164cbc-c92d-4e95-91b8-e196edfaa6af admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:30.821082 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8164cbc-c92d-4e95-91b8-e196edfaa6af admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:30.821358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8164cbc-c92d-4e95-91b8-e196edfaa6af admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:30.822562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8164cbc-c92d-4e95-91b8-e196edfaa6af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:30.824263 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8164cbc-c92d-4e95-91b8-e196edfaa6af admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:30.825824 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 22/44] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:50:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:30.832287 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516168e-23f4-4cd4-9ddf-13050dc2e6e4 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:30.841083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516168e-23f4-4cd4-9ddf-13050dc2e6e4 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:30.845394 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c675f-fea5-4a79-8918-90c4f8c46707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:30.846071 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c675f-fea5-4a79-8918-90c4f8c46707 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:30.846356 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c675f-fea5-4a79-8918-90c4f8c46707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:30.846634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c675f-fea5-4a79-8918-90c4f8c46707 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:30.847355 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c675f-fea5-4a79-8918-90c4f8c46707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:30.848367 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-8f7c675f-fea5-4a79-8918-90c4f8c46707 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:50:30.848367 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:50:30.848367 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:50:30.849568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c675f-fea5-4a79-8918-90c4f8c46707 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:30.882393 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Dec 15 02:50:30 2021] POST /identity/v3/projects => generated 312 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 02:50:32.452973 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993f8ba-d86f-4a9b-b8b8-f664b02a046f None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:32.453967 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993f8ba-d86f-4a9b-b8b8-f664b02a046f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:32.454077 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993f8ba-d86f-4a9b-b8b8-f664b02a046f None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:32.455821 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 23/46] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:32.461636 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169967a1-7e51-4e83-aec4-f4f2c71bc60f None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:32.462102 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169967a1-7e51-4e83-aec4-f4f2c71bc60f None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:32.462191 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169967a1-7e51-4e83-aec4-f4f2c71bc60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:32.480062 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-169967a1-7e51-4e83-aec4-f4f2c71bc60f None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:32.481243 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-169967a1-7e51-4e83-aec4-f4f2c71bc60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:32.545665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 24/47] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:32.570577 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993f8ba-d86f-4a9b-b8b8-f664b02a046f None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:32.582284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993f8ba-d86f-4a9b-b8b8-f664b02a046f None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:32.586425 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e962d-d651-49c4-b3e1-7b0d3ca39ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:32.587191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e962d-d651-49c4-b3e1-7b0d3ca39ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:32.587480 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e962d-d651-49c4-b3e1-7b0d3ca39ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:32.587751 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e962d-d651-49c4-b3e1-7b0d3ca39ac8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:32.597874 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e962d-d651-49c4-b3e1-7b0d3ca39ac8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:32.604628 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-cf9e962d-d651-49c4-b3e1-7b0d3ca39ac8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:50:32.605782 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 24/48] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:50:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:32.612481 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169967a1-7e51-4e83-aec4-f4f2c71bc60f None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:32.621248 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169967a1-7e51-4e83-aec4-f4f2c71bc60f None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:32.626210 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f8124-824d-4ce3-be4e-904ab674a4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:32.626867 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f8124-824d-4ce3-be4e-904ab674a4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:32.627147 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f8124-824d-4ce3-be4e-904ab674a4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:32.627419 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f8124-824d-4ce3-be4e-904ab674a4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:32.628183 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f8124-824d-4ce3-be4e-904ab674a4f1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:32.628487 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f8124-824d-4ce3-be4e-904ab674a4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:32.630138 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f8124-824d-4ce3-be4e-904ab674a4f1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:32.639090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 25/49] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:32.644951 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e962d-d651-49c4-b3e1-7b0d3ca39ac8 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:32.655547 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e962d-d651-49c4-b3e1-7b0d3ca39ac8 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:32.659952 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69496b2-aa33-4719-965f-56ffc6312bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:32.660809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69496b2-aa33-4719-965f-56ffc6312bac admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:32.661089 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69496b2-aa33-4719-965f-56ffc6312bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:32.661361 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69496b2-aa33-4719-965f-56ffc6312bac admin admin] PATH_INFO: `/v3/users/3bbde01a62314e839f70db08ddf77996` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:32.662629 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69496b2-aa33-4719-965f-56ffc6312bac admin admin] RBAC: Authorizing `identity:get_user(user_id=3bbde01a62314e839f70db08ddf77996)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:32.664445 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69496b2-aa33-4719-965f-56ffc6312bac admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:32.666010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 25/50] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:32 2021] GET /identity/v3/users/3bbde01a62314e839f70db08ddf77996 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:32.672589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f8124-824d-4ce3-be4e-904ab674a4f1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:32.681991 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f8124-824d-4ce3-be4e-904ab674a4f1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:32.686367 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e48d6-8a17-4d2a-8aaa-26b6f84de9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:32.687134 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e48d6-8a17-4d2a-8aaa-26b6f84de9ea admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:32.687416 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e48d6-8a17-4d2a-8aaa-26b6f84de9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:32.687753 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e48d6-8a17-4d2a-8aaa-26b6f84de9ea admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:32.689428 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e48d6-8a17-4d2a-8aaa-26b6f84de9ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:32.691187 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e48d6-8a17-4d2a-8aaa-26b6f84de9ea admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:32.692752 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 26/51] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:50:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:32.698567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69496b2-aa33-4719-965f-56ffc6312bac admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:32.707907 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69496b2-aa33-4719-965f-56ffc6312bac admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:32.712190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52605ed3-9773-4922-b36d-3301c7d1f8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:32.712761 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52605ed3-9773-4922-b36d-3301c7d1f8ef admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:32.713039 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52605ed3-9773-4922-b36d-3301c7d1f8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:32.713314 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52605ed3-9773-4922-b36d-3301c7d1f8ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:32.714165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52605ed3-9773-4922-b36d-3301c7d1f8ef admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.domain.id=default, user.id=3bbde01a62314e839f70db08ddf77996) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:32.714472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52605ed3-9773-4922-b36d-3301c7d1f8ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:32.716303 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52605ed3-9773-4922-b36d-3301c7d1f8ef admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:32.722454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 26/52] 10.222.0.18 () {56 vars in 1343 bytes} [Wed Dec 15 02:50:32 2021] GET /identity/v3/role_assignments?user.id=3bbde01a62314e839f70db08ddf77996&scope.domain.id=default&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 530 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:33.218866 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6fef0-884b-4fa9-bfb0-8eb63997b340 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:33.219769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6fef0-884b-4fa9-bfb0-8eb63997b340 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:33.220052 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6fef0-884b-4fa9-bfb0-8eb63997b340 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:33.221851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 27/53] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:33.227496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3cb11-3e62-4963-b062-169c449b5acd None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:33.227791 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3cb11-3e62-4963-b062-169c449b5acd None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:33.228076 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3cb11-3e62-4963-b062-169c449b5acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:33.245193 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-b5e3cb11-3e62-4963-b062-169c449b5acd None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:33.246396 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b5e3cb11-3e62-4963-b062-169c449b5acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:33.254088 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 27/54] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:33.278222 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6fef0-884b-4fa9-bfb0-8eb63997b340 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:33.290449 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6fef0-884b-4fa9-bfb0-8eb63997b340 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:33.294660 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38839bea-dc27-462b-9e6f-a5d5a1b1a713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:33.295409 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839bea-dc27-462b-9e6f-a5d5a1b1a713 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:33.295694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839bea-dc27-462b-9e6f-a5d5a1b1a713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:33.295975 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839bea-dc27-462b-9e6f-a5d5a1b1a713 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:33.297143 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38839bea-dc27-462b-9e6f-a5d5a1b1a713 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:33.298887 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38839bea-dc27-462b-9e6f-a5d5a1b1a713 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:33.300425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:50:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:33.305792 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3cb11-3e62-4963-b062-169c449b5acd None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:33.314384 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3cb11-3e62-4963-b062-169c449b5acd None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:33.319524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cc818-d371-41f9-bd1d-2b83401170db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:33.320202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cc818-d371-41f9-bd1d-2b83401170db admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:33.320519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cc818-d371-41f9-bd1d-2b83401170db admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:33.320835 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cc818-d371-41f9-bd1d-2b83401170db admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:33.321643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cc818-d371-41f9-bd1d-2b83401170db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:33.323847 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cc818-d371-41f9-bd1d-2b83401170db admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:33.351830 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 28/56] 10.222.0.18 () {60 vars in 1161 bytes} [Wed Dec 15 02:50:33 2021] POST /identity/v3/projects => generated 298 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:50:35.661172 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77b39e-617a-4920-8bbf-cb5174d5f808 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:35.661677 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77b39e-617a-4920-8bbf-cb5174d5f808 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:35.661779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77b39e-617a-4920-8bbf-cb5174d5f808 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:35.663531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 29/57] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:35.669477 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca906604-3975-444d-a377-240b6ee1d29f None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:35.669887 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca906604-3975-444d-a377-240b6ee1d29f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:35.670068 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca906604-3975-444d-a377-240b6ee1d29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:35.690048 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-ca906604-3975-444d-a377-240b6ee1d29f None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:35.691240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-ca906604-3975-444d-a377-240b6ee1d29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:35.745109 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 29/58] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:35.770830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77b39e-617a-4920-8bbf-cb5174d5f808 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:35.782392 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77b39e-617a-4920-8bbf-cb5174d5f808 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:35.786501 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df121549-a068-4e98-80ef-0f824b453804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:35.787332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121549-a068-4e98-80ef-0f824b453804 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:35.787612 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121549-a068-4e98-80ef-0f824b453804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:35.787889 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121549-a068-4e98-80ef-0f824b453804 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:35.789052 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df121549-a068-4e98-80ef-0f824b453804 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:35.790769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df121549-a068-4e98-80ef-0f824b453804 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:35.792300 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 30/59] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:50:35 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:35.797749 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca906604-3975-444d-a377-240b6ee1d29f None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:35.806796 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca906604-3975-444d-a377-240b6ee1d29f None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:35.811150 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8cbb2-f6e3-417d-8b37-bec5f3837294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:35.811793 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8cbb2-f6e3-417d-8b37-bec5f3837294 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:35.812081 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8cbb2-f6e3-417d-8b37-bec5f3837294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:35.812359 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8cbb2-f6e3-417d-8b37-bec5f3837294 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:35.813581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8cbb2-f6e3-417d-8b37-bec5f3837294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:35.814630 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-f4b8cbb2-f6e3-417d-8b37-bec5f3837294 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:50:35.814630 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:50:35.814630 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:50:35.815847 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8cbb2-f6e3-417d-8b37-bec5f3837294 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:35.840151 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 30/60] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:50:35 2021] POST /identity/v3/users => generated 275 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:50:39.314898 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5aa6d-d7c5-4312-a468-6f1f38556978 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.315807 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5aa6d-d7c5-4312-a468-6f1f38556978 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.316290 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5aa6d-d7c5-4312-a468-6f1f38556978 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.318538 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 31/61] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:39.324401 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1372551-9f65-46b0-b50c-564c7909657a None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.324917 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1372551-9f65-46b0-b50c-564c7909657a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.324991 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1372551-9f65-46b0-b50c-564c7909657a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.351003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-e1372551-9f65-46b0-b50c-564c7909657a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:39.352217 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e1372551-9f65-46b0-b50c-564c7909657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:39.360826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 31/62] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:39.408689 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5aa6d-d7c5-4312-a468-6f1f38556978 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.425463 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5aa6d-d7c5-4312-a468-6f1f38556978 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:39.430265 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915f704-9dd6-4358-8a51-6d6013d13655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:39.431079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f704-9dd6-4358-8a51-6d6013d13655 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.431364 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f704-9dd6-4358-8a51-6d6013d13655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.431648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f704-9dd6-4358-8a51-6d6013d13655 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.451162 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915f704-9dd6-4358-8a51-6d6013d13655 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:39.458192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-4915f704-9dd6-4358-8a51-6d6013d13655 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:50:39.459636 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 32/63] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:39.465476 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1372551-9f65-46b0-b50c-564c7909657a None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.481014 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1372551-9f65-46b0-b50c-564c7909657a None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:39.495573 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86bcaf-5caa-401d-943c-4160c5f8f549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:39.496250 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86bcaf-5caa-401d-943c-4160c5f8f549 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.496539 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86bcaf-5caa-401d-943c-4160c5f8f549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.496821 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86bcaf-5caa-401d-943c-4160c5f8f549 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.497597 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86bcaf-5caa-401d-943c-4160c5f8f549 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:39.497906 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86bcaf-5caa-401d-943c-4160c5f8f549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:39.499583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86bcaf-5caa-401d-943c-4160c5f8f549 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:39.516612 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 32/64] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:39.519904 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702ce41-67cc-4369-b785-6c8f4eadc671 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.520192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702ce41-67cc-4369-b785-6c8f4eadc671 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.520471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702ce41-67cc-4369-b785-6c8f4eadc671 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.521934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86bcaf-5caa-401d-943c-4160c5f8f549 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.522560 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 33/65] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:39.528203 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01602d2-ab4a-4bbf-b1f6-d719587f8634 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.528489 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01602d2-ab4a-4bbf-b1f6-d719587f8634 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.528778 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01602d2-ab4a-4bbf-b1f6-d719587f8634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.537134 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86bcaf-5caa-401d-943c-4160c5f8f549 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:39.552415 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ebd89-b6b4-4379-9fb4-97b4b9be1958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:39.553285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ebd89-b6b4-4379-9fb4-97b4b9be1958 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.553573 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ebd89-b6b4-4379-9fb4-97b4b9be1958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.553853 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ebd89-b6b4-4379-9fb4-97b4b9be1958 admin admin] PATH_INFO: `/v3/users/7fde99a5ff1a40da963ed07b17b757a7` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.565930 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-e01602d2-ab4a-4bbf-b1f6-d719587f8634 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:39.567182 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e01602d2-ab4a-4bbf-b1f6-d719587f8634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:39.576367 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ebd89-b6b4-4379-9fb4-97b4b9be1958 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fde99a5ff1a40da963ed07b17b757a7)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:39.578601 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ebd89-b6b4-4379-9fb4-97b4b9be1958 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:39.580447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 33/66] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/users/7fde99a5ff1a40da963ed07b17b757a7 => generated 275 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:39.586262 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ebd89-b6b4-4379-9fb4-97b4b9be1958 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.588146 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 34/67] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:39.596342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ebd89-b6b4-4379-9fb4-97b4b9be1958 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:39.601030 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45799e9d-0047-4393-9bb4-e27800341ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:39.601670 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45799e9d-0047-4393-9bb4-e27800341ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.601957 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45799e9d-0047-4393-9bb4-e27800341ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.602266 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45799e9d-0047-4393-9bb4-e27800341ef3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.611177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45799e9d-0047-4393-9bb4-e27800341ef3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:39.613034 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45799e9d-0047-4393-9bb4-e27800341ef3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:39.622138 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 34/68] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:50:39.628393 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01602d2-ab4a-4bbf-b1f6-d719587f8634 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.634196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45799e9d-0047-4393-9bb4-e27800341ef3 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.648204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01602d2-ab4a-4bbf-b1f6-d719587f8634 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:39.651364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45799e9d-0047-4393-9bb4-e27800341ef3 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:39.658357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61e332-488c-4f20-b953-fb15ad3bbd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:39.659219 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61e332-488c-4f20-b953-fb15ad3bbd30 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.659505 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61e332-488c-4f20-b953-fb15ad3bbd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.659789 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61e332-488c-4f20-b953-fb15ad3bbd30 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.661434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61e332-488c-4f20-b953-fb15ad3bbd30 admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:39.663565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61e332-488c-4f20-b953-fb15ad3bbd30 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:39.665251 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 35/69] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:39.665908 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e8757-0f57-47f5-b566-c21e9bd43eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:39.666786 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e8757-0f57-47f5-b566-c21e9bd43eda admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.667077 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e8757-0f57-47f5-b566-c21e9bd43eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.667357 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e8757-0f57-47f5-b566-c21e9bd43eda admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.675147 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61e332-488c-4f20-b953-fb15ad3bbd30 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.686367 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e8757-0f57-47f5-b566-c21e9bd43eda admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:39.693303 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-6a8e8757-0f57-47f5-b566-c21e9bd43eda admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:50:39.694549 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 35/70] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:50:39.697608 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61e332-488c-4f20-b953-fb15ad3bbd30 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:39.700791 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e8757-0f57-47f5-b566-c21e9bd43eda admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.707874 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47facb7-c846-4a09-a89d-d62d493a088d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:39.708582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47facb7-c846-4a09-a89d-d62d493a088d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.708813 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47facb7-c846-4a09-a89d-d62d493a088d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.709089 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47facb7-c846-4a09-a89d-d62d493a088d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.709942 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47facb7-c846-4a09-a89d-d62d493a088d admin admin] RBAC: Adding query filter params (role.id=69edf382652b443c97811919233bb991, scope.project.id=4bec9401bcfa489d98020b66bccfa487, user.id=7fde99a5ff1a40da963ed07b17b757a7) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:39.710277 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47facb7-c846-4a09-a89d-d62d493a088d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:39.711294 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-b47facb7-c846-4a09-a89d-d62d493a088d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:50:39.711294 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:50:39.711294 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:50:39.712456 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47facb7-c846-4a09-a89d-d62d493a088d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:39.720076 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e8757-0f57-47f5-b566-c21e9bd43eda admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:39.720577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/role_assignments?user.id=7fde99a5ff1a40da963ed07b17b757a7&scope.project.id=4bec9401bcfa489d98020b66bccfa487&role.id=69edf382652b443c97811919233bb991 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:39.733572 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49690727-eb9f-471c-a055-13db67e39592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:39.734284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49690727-eb9f-471c-a055-13db67e39592 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.735359 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49690727-eb9f-471c-a055-13db67e39592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.735829 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49690727-eb9f-471c-a055-13db67e39592 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.736843 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49690727-eb9f-471c-a055-13db67e39592 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:39.737360 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49690727-eb9f-471c-a055-13db67e39592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:39.739300 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49690727-eb9f-471c-a055-13db67e39592 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:39.749368 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 36/72] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:39.755335 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47facb7-c846-4a09-a89d-d62d493a088d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.757755 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4650fcc-cf2d-4891-8ea3-682c3d94252f None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.758082 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4650fcc-cf2d-4891-8ea3-682c3d94252f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.758365 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4650fcc-cf2d-4891-8ea3-682c3d94252f None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.760412 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 37/73] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:50:39.766371 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d77d0-6e29-47ca-be3b-f495006a6eae None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.766639 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d77d0-6e29-47ca-be3b-f495006a6eae None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.766919 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d77d0-6e29-47ca-be3b-f495006a6eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.773897 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47facb7-c846-4a09-a89d-d62d493a088d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:39.789401 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec22da-4d2a-4ffa-a6a0-4e0b5b0cb096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:39.790332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec22da-4d2a-4ffa-a6a0-4e0b5b0cb096 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.790929 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec22da-4d2a-4ffa-a6a0-4e0b5b0cb096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.791415 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec22da-4d2a-4ffa-a6a0-4e0b5b0cb096 admin admin] PATH_INFO: `/v3/users/3bbde01a62314e839f70db08ddf77996` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.793353 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec22da-4d2a-4ffa-a6a0-4e0b5b0cb096 admin admin] RBAC: Authorizing `identity:get_user(user_id=3bbde01a62314e839f70db08ddf77996)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:39.795517 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec22da-4d2a-4ffa-a6a0-4e0b5b0cb096 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:39.796734 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-871d77d0-6e29-47ca-be3b-f495006a6eae None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:39.798304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 37/74] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/users/3bbde01a62314e839f70db08ddf77996 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:39.798996 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-871d77d0-6e29-47ca-be3b-f495006a6eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:39.799990 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b36bce-9c06-49a3-a755-04cd64a32fdd None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.800456 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b36bce-9c06-49a3-a755-04cd64a32fdd None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.800903 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b36bce-9c06-49a3-a755-04cd64a32fdd None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.803273 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 38/75] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:39.805858 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b36bce-9c06-49a3-a755-04cd64a32fdd None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.818103 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 38/76] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:39.823924 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9824fd-7463-4246-a907-9f17d9bcde8d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.825322 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9824fd-7463-4246-a907-9f17d9bcde8d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.825818 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9824fd-7463-4246-a907-9f17d9bcde8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.827772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b36bce-9c06-49a3-a755-04cd64a32fdd None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:39.838259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74437f11-b283-4fbb-b433-b5713952d15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:39.839274 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74437f11-b283-4fbb-b433-b5713952d15e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.839739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74437f11-b283-4fbb-b433-b5713952d15e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.840205 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74437f11-b283-4fbb-b433-b5713952d15e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.856692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74437f11-b283-4fbb-b433-b5713952d15e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:39.858411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-ae9824fd-7463-4246-a907-9f17d9bcde8d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:39.859206 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74437f11-b283-4fbb-b433-b5713952d15e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:39.859706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-ae9824fd-7463-4246-a907-9f17d9bcde8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:39.870225 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 39/77] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:50:39.871420 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74437f11-b283-4fbb-b433-b5713952d15e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.874996 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 39/78] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:39.882735 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74437f11-b283-4fbb-b433-b5713952d15e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:39.887018 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9824fd-7463-4246-a907-9f17d9bcde8d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.891546 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877a34d-63f9-4dc6-8750-a75f05d013ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:39.892455 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877a34d-63f9-4dc6-8750-a75f05d013ed admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.892816 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877a34d-63f9-4dc6-8750-a75f05d013ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.893165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877a34d-63f9-4dc6-8750-a75f05d013ed admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.899954 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9824fd-7463-4246-a907-9f17d9bcde8d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:39.904445 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0ede6-18ff-418d-be56-974da0345843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:39.905325 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0ede6-18ff-418d-be56-974da0345843 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.905596 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0ede6-18ff-418d-be56-974da0345843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.905869 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0ede6-18ff-418d-be56-974da0345843 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.906183 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877a34d-63f9-4dc6-8750-a75f05d013ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:39.907744 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0ede6-18ff-418d-be56-974da0345843 admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:39.909844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0ede6-18ff-418d-be56-974da0345843 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:39.911839 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 40/79] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:39.914072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802e80a-41dd-4049-8d6b-f3e073855578 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.914072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802e80a-41dd-4049-8d6b-f3e073855578 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.914072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802e80a-41dd-4049-8d6b-f3e073855578 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.914332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-5877a34d-63f9-4dc6-8750-a75f05d013ed admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:50:39.915201 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 41/80] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:39.915816 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802e80a-41dd-4049-8d6b-f3e073855578 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.918149 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 40/81] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:39.921376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c8c1c-6016-4581-a48c-1c8ede79212c None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.921661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c8c1c-6016-4581-a48c-1c8ede79212c None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.922008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c8c1c-6016-4581-a48c-1c8ede79212c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.930626 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802e80a-41dd-4049-8d6b-f3e073855578 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:39.934970 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452a1e3-850a-475a-989c-8d06d35c2846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:39.935780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452a1e3-850a-475a-989c-8d06d35c2846 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.936055 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452a1e3-850a-475a-989c-8d06d35c2846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.936418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452a1e3-850a-475a-989c-8d06d35c2846 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.940529 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-de2c8c1c-6016-4581-a48c-1c8ede79212c None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:39.941770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-de2c8c1c-6016-4581-a48c-1c8ede79212c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:39.947353 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452a1e3-850a-475a-989c-8d06d35c2846 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:39.949576 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 41/82] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:39.955183 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-9452a1e3-850a-475a-989c-8d06d35c2846 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 02:50:39.956395 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 42/83] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:39.957157 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452a1e3-850a-475a-989c-8d06d35c2846 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.957418 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c8c1c-6016-4581-a48c-1c8ede79212c None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.972261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452a1e3-850a-475a-989c-8d06d35c2846 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:39.975461 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c8c1c-6016-4581-a48c-1c8ede79212c None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:39.976787 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093680d4-4b3e-48c7-a768-2e04eb1fa176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:39.977487 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093680d4-4b3e-48c7-a768-2e04eb1fa176 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.977841 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093680d4-4b3e-48c7-a768-2e04eb1fa176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.978234 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093680d4-4b3e-48c7-a768-2e04eb1fa176 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.979142 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093680d4-4b3e-48c7-a768-2e04eb1fa176 admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=4bec9401bcfa489d98020b66bccfa487, user.id=3bbde01a62314e839f70db08ddf77996) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:39.979556 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093680d4-4b3e-48c7-a768-2e04eb1fa176 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:39.981473 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093680d4-4b3e-48c7-a768-2e04eb1fa176 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:39.981895 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dad311-e2dd-4422-8397-64d12155d3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:39.982595 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dad311-e2dd-4422-8397-64d12155d3fd admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:39.982931 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dad311-e2dd-4422-8397-64d12155d3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:39.983214 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dad311-e2dd-4422-8397-64d12155d3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:39.984012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dad311-e2dd-4422-8397-64d12155d3fd admin admin] RBAC: Adding query filter params (name=member) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:39.984356 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dad311-e2dd-4422-8397-64d12155d3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:39.985939 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dad311-e2dd-4422-8397-64d12155d3fd admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:39.987528 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 43/84] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/role_assignments?user.id=3bbde01a62314e839f70db08ddf77996&scope.project.id=4bec9401bcfa489d98020b66bccfa487&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:39.988317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093680d4-4b3e-48c7-a768-2e04eb1fa176 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.998034 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 42/85] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:39.998034 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dad311-e2dd-4422-8397-64d12155d3fd admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:39.998317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093680d4-4b3e-48c7-a768-2e04eb1fa176 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:40.002420 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258a2e4-44f9-4dec-8676-15c6f57d2acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:40.003084 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258a2e4-44f9-4dec-8676-15c6f57d2acc admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:40.003369 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258a2e4-44f9-4dec-8676-15c6f57d2acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:40.003645 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258a2e4-44f9-4dec-8676-15c6f57d2acc admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:40.004422 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258a2e4-44f9-4dec-8676-15c6f57d2acc admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:40.004735 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258a2e4-44f9-4dec-8676-15c6f57d2acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:40.006483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258a2e4-44f9-4dec-8676-15c6f57d2acc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:40.008225 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dad311-e2dd-4422-8397-64d12155d3fd admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:40.013565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c62f9e-b99b-4db4-a083-f2e7ae7d89fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:40.014797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c62f9e-b99b-4db4-a083-f2e7ae7d89fc admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:40.015353 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c62f9e-b99b-4db4-a083-f2e7ae7d89fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:40.016392 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c62f9e-b99b-4db4-a083-f2e7ae7d89fc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:40.016929 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 44/86] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:40.017472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258a2e4-44f9-4dec-8676-15c6f57d2acc admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:40.018811 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c62f9e-b99b-4db4-a083-f2e7ae7d89fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:40.020846 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c62f9e-b99b-4db4-a083-f2e7ae7d89fc admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:40.022895 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 43/87] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:50:39 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:40.024103 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c62f9e-b99b-4db4-a083-f2e7ae7d89fc admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:40.032880 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258a2e4-44f9-4dec-8676-15c6f57d2acc admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:40.037588 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a349d-fc62-41bd-8c43-65bc3bf61b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:40.038517 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a349d-fc62-41bd-8c43-65bc3bf61b5c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:40.038802 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a349d-fc62-41bd-8c43-65bc3bf61b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:40.039079 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a349d-fc62-41bd-8c43-65bc3bf61b5c admin admin] PATH_INFO: `/v3/users/7fde99a5ff1a40da963ed07b17b757a7` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:40.040368 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a349d-fc62-41bd-8c43-65bc3bf61b5c admin admin] RBAC: Authorizing `identity:get_user(user_id=7fde99a5ff1a40da963ed07b17b757a7)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:40.042636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a349d-fc62-41bd-8c43-65bc3bf61b5c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:40.043003 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c62f9e-b99b-4db4-a083-f2e7ae7d89fc admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:40.044354 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 45/88] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:40 2021] GET /identity/v3/users/7fde99a5ff1a40da963ed07b17b757a7 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:40.045129 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a349d-fc62-41bd-8c43-65bc3bf61b5c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:40.049562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301bc0e-9dae-40af-a862-769c5894d1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:40.051462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301bc0e-9dae-40af-a862-769c5894d1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:40.052208 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301bc0e-9dae-40af-a862-769c5894d1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:40.052899 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301bc0e-9dae-40af-a862-769c5894d1f7 admin admin] PATH_INFO: `/v3/users/7fde99a5ff1a40da963ed07b17b757a7` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:40.054962 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301bc0e-9dae-40af-a862-769c5894d1f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fde99a5ff1a40da963ed07b17b757a7)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:40.056229 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a349d-fc62-41bd-8c43-65bc3bf61b5c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:40.057791 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301bc0e-9dae-40af-a862-769c5894d1f7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:40.060544 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 44/89] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:40 2021] GET /identity/v3/users/7fde99a5ff1a40da963ed07b17b757a7 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:40.060855 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fdd4c-13e0-4acd-bb96-6a6bde90e699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:40.061617 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fdd4c-13e0-4acd-bb96-6a6bde90e699 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:40.061972 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fdd4c-13e0-4acd-bb96-6a6bde90e699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:40.062230 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301bc0e-9dae-40af-a862-769c5894d1f7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:40.062335 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fdd4c-13e0-4acd-bb96-6a6bde90e699 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:40.063706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fdd4c-13e0-4acd-bb96-6a6bde90e699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:40.065902 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fdd4c-13e0-4acd-bb96-6a6bde90e699 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:40.074220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301bc0e-9dae-40af-a862-769c5894d1f7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:40.079942 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59384b5c-1c01-46cb-8393-2f5d64b9308e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:40.080850 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59384b5c-1c01-46cb-8393-2f5d64b9308e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:40.081284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59384b5c-1c01-46cb-8393-2f5d64b9308e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:40.081646 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59384b5c-1c01-46cb-8393-2f5d64b9308e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:40.094076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59384b5c-1c01-46cb-8393-2f5d64b9308e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:40.094076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59384b5c-1c01-46cb-8393-2f5d64b9308e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:40.094428 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 46/90] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:50:40 2021] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:50:40.095551 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fdd4c-13e0-4acd-bb96-6a6bde90e699 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:40.104794 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 45/91] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:40 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:50:40.112309 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59384b5c-1c01-46cb-8393-2f5d64b9308e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:40.112609 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fdd4c-13e0-4acd-bb96-6a6bde90e699 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:40.122483 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59384b5c-1c01-46cb-8393-2f5d64b9308e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:40.128986 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022692df-b66e-4dba-b656-1e2cb4224ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:40.129859 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf70893-fef1-4400-9b8a-c3861d49e288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:40.131149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf70893-fef1-4400-9b8a-c3861d49e288 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:40.131847 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf70893-fef1-4400-9b8a-c3861d49e288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:40.132494 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022692df-b66e-4dba-b656-1e2cb4224ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:40.133135 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf70893-fef1-4400-9b8a-c3861d49e288 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:40.133437 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022692df-b66e-4dba-b656-1e2cb4224ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:40.134516 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022692df-b66e-4dba-b656-1e2cb4224ab5 admin admin] PATH_INFO: `/v3/projects/3d23926ac3d4471999077c568ca431c0` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:40.136798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022692df-b66e-4dba-b656-1e2cb4224ab5 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d23926ac3d4471999077c568ca431c0)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:40.143769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022692df-b66e-4dba-b656-1e2cb4224ab5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:40.147336 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 46/92] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:40 2021] GET /identity/v3/projects/3d23926ac3d4471999077c568ca431c0 => generated 312 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:40.151799 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf70893-fef1-4400-9b8a-c3861d49e288 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:40.153860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022692df-b66e-4dba-b656-1e2cb4224ab5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:40.156249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf70893-fef1-4400-9b8a-c3861d49e288 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:40.173307 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022692df-b66e-4dba-b656-1e2cb4224ab5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:40.179630 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 47/93] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:40 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:50:40.182852 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908d6a4-d16e-4062-b0b1-9972a52ab2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:40.183531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908d6a4-d16e-4062-b0b1-9972a52ab2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:40.183817 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908d6a4-d16e-4062-b0b1-9972a52ab2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:40.184099 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908d6a4-d16e-4062-b0b1-9972a52ab2e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:40.186211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf70893-fef1-4400-9b8a-c3861d49e288 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:40.190990 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908d6a4-d16e-4062-b0b1-9972a52ab2e8 admin admin] RBAC: Adding query filter params (role.id=69edf382652b443c97811919233bb991, scope.project.id=3d23926ac3d4471999077c568ca431c0, user.id=7fde99a5ff1a40da963ed07b17b757a7) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:40.191414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908d6a4-d16e-4062-b0b1-9972a52ab2e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:40.193856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908d6a4-d16e-4062-b0b1-9972a52ab2e8 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:40.202094 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf70893-fef1-4400-9b8a-c3861d49e288 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:40.208082 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 47/94] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:50:40 2021] GET /identity/v3/role_assignments?user.id=7fde99a5ff1a40da963ed07b17b757a7&scope.project.id=3d23926ac3d4471999077c568ca431c0&role.id=69edf382652b443c97811919233bb991 => generated 259 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:40.210598 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091ff5b-4ef5-4c2b-aa81-372bc6413dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:40.212085 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ff5b-4ef5-4c2b-aa81-372bc6413dda admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:40.212606 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ff5b-4ef5-4c2b-aa81-372bc6413dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:40.213080 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ff5b-4ef5-4c2b-aa81-372bc6413dda admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:40.214832 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091ff5b-4ef5-4c2b-aa81-372bc6413dda admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:40.217164 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091ff5b-4ef5-4c2b-aa81-372bc6413dda admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:40.219745 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 48/95] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:40 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:40.226806 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908d6a4-d16e-4062-b0b1-9972a52ab2e8 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:40.238790 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908d6a4-d16e-4062-b0b1-9972a52ab2e8 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:40.243829 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65073255-ab6a-45b2-badb-15e29d9db775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:40.244617 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65073255-ab6a-45b2-badb-15e29d9db775 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:40.244908 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65073255-ab6a-45b2-badb-15e29d9db775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:40.245455 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65073255-ab6a-45b2-badb-15e29d9db775 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:40.246452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65073255-ab6a-45b2-badb-15e29d9db775 admin admin] RBAC: Adding query filter params (role.id=bcbedb9e465844d2a8baa6af3760e916, scope.project.id=4bec9401bcfa489d98020b66bccfa487, user.id=7fde99a5ff1a40da963ed07b17b757a7) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:40.246766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65073255-ab6a-45b2-badb-15e29d9db775 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:40.248865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65073255-ab6a-45b2-badb-15e29d9db775 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:40.255877 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 48/96] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:50:40 2021] GET /identity/v3/role_assignments?user.id=7fde99a5ff1a40da963ed07b17b757a7&scope.project.id=4bec9401bcfa489d98020b66bccfa487&role.id=bcbedb9e465844d2a8baa6af3760e916 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:42.785477 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe28c27-6cd9-4335-84d6-ca15535762c9 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:42.786009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe28c27-6cd9-4335-84d6-ca15535762c9 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:42.786086 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe28c27-6cd9-4335-84d6-ca15535762c9 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:42.788154 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 49/97] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:42.793550 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a69534-0d1f-4c71-be49-a5db9b1a1172 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:42.793933 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a69534-0d1f-4c71-be49-a5db9b1a1172 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:42.794157 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a69534-0d1f-4c71-be49-a5db9b1a1172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:42.819005 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-55a69534-0d1f-4c71-be49-a5db9b1a1172 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:42.820213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-55a69534-0d1f-4c71-be49-a5db9b1a1172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:42.828932 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 49/98] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:42.875895 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe28c27-6cd9-4335-84d6-ca15535762c9 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:42.894664 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe28c27-6cd9-4335-84d6-ca15535762c9 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:42.899165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf24677-50fe-4db7-978f-d43db5fc10db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:42.899950 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf24677-50fe-4db7-978f-d43db5fc10db admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:42.900231 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf24677-50fe-4db7-978f-d43db5fc10db admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:42.900509 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf24677-50fe-4db7-978f-d43db5fc10db admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:42.916232 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf24677-50fe-4db7-978f-d43db5fc10db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:42.923202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-ccf24677-50fe-4db7-978f-d43db5fc10db admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:50:42.924622 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 50/99] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:42.930612 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a69534-0d1f-4c71-be49-a5db9b1a1172 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:42.939688 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a69534-0d1f-4c71-be49-a5db9b1a1172 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:42.946172 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ea13d-541a-4e6b-b2de-135f78336d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:42.946845 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ea13d-541a-4e6b-b2de-135f78336d3f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:42.947129 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ea13d-541a-4e6b-b2de-135f78336d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:42.947409 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ea13d-541a-4e6b-b2de-135f78336d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:42.948184 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ea13d-541a-4e6b-b2de-135f78336d3f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:42.948492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ea13d-541a-4e6b-b2de-135f78336d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:42.950124 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ea13d-541a-4e6b-b2de-135f78336d3f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:42.961403 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 50/100] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:50:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:42.967856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf24677-50fe-4db7-978f-d43db5fc10db admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:42.978706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf24677-50fe-4db7-978f-d43db5fc10db admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:42.986391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621f5ab-d608-4cd5-b3d0-fd90f59d8d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:42.987281 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621f5ab-d608-4cd5-b3d0-fd90f59d8d59 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:42.987571 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621f5ab-d608-4cd5-b3d0-fd90f59d8d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:42.987853 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621f5ab-d608-4cd5-b3d0-fd90f59d8d59 admin admin] PATH_INFO: `/v3/users/7fde99a5ff1a40da963ed07b17b757a7` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:42.989184 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621f5ab-d608-4cd5-b3d0-fd90f59d8d59 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fde99a5ff1a40da963ed07b17b757a7)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:42.991402 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621f5ab-d608-4cd5-b3d0-fd90f59d8d59 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:42.993072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 51/101] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:42 2021] GET /identity/v3/users/7fde99a5ff1a40da963ed07b17b757a7 => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:42.999128 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ea13d-541a-4e6b-b2de-135f78336d3f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:43.009012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ea13d-541a-4e6b-b2de-135f78336d3f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:43.018681 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4226d3-7316-462d-9f18-ce50c9fa54db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:43.019531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4226d3-7316-462d-9f18-ce50c9fa54db admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.019816 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4226d3-7316-462d-9f18-ce50c9fa54db admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.020094 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4226d3-7316-462d-9f18-ce50c9fa54db admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.021319 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4226d3-7316-462d-9f18-ce50c9fa54db admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:43.023423 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4226d3-7316-462d-9f18-ce50c9fa54db admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:43.025098 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 51/102] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:42 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:43.031199 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621f5ab-d608-4cd5-b3d0-fd90f59d8d59 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:43.043048 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621f5ab-d608-4cd5-b3d0-fd90f59d8d59 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:43.051826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def395c0-3062-4a8e-8a72-244b8bd2bfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:43.052944 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def395c0-3062-4a8e-8a72-244b8bd2bfec admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.053418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def395c0-3062-4a8e-8a72-244b8bd2bfec admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.053890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def395c0-3062-4a8e-8a72-244b8bd2bfec admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487/users/7fde99a5ff1a40da963ed07b17b757a7/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.059274 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def395c0-3062-4a8e-8a72-244b8bd2bfec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bec9401bcfa489d98020b66bccfa487, user_id=7fde99a5ff1a40da963ed07b17b757a7, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:43.060514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-def395c0-3062-4a8e-8a72-244b8bd2bfec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:50:43.060514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:50:43.060514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:50:43.062911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def395c0-3062-4a8e-8a72-244b8bd2bfec admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:43.097565 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 52/103] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:50:43 2021] PUT /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487/users/7fde99a5ff1a40da963ed07b17b757a7/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:50:43.163185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aa4d5-01f3-4516-ba6a-9e2d10e94c24 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.163519 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aa4d5-01f3-4516-ba6a-9e2d10e94c24 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.163757 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aa4d5-01f3-4516-ba6a-9e2d10e94c24 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.165752 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 52/104] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:43.176605 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f17c15-38d8-43ac-995d-2e7574151006 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.177241 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f17c15-38d8-43ac-995d-2e7574151006 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.177711 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f17c15-38d8-43ac-995d-2e7574151006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.210548 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df53c74-7fad-4a85-9705-c724b34d6eea None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.210930 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df53c74-7fad-4a85-9705-c724b34d6eea None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.211106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df53c74-7fad-4a85-9705-c724b34d6eea None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.214447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-10f17c15-38d8-43ac-995d-2e7574151006 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:43.219005 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-10f17c15-38d8-43ac-995d-2e7574151006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:43.219144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 53/105] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:43.227762 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b87e2-1772-4d61-91d2-4a96e014d589 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.228061 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b87e2-1772-4d61-91d2-4a96e014d589 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.228328 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b87e2-1772-4d61-91d2-4a96e014d589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.265084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-6d3b87e2-1772-4d61-91d2-4a96e014d589 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:43.266987 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6d3b87e2-1772-4d61-91d2-4a96e014d589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:43.386067 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 53/106] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:43.418776 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 54/107] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:43.425609 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f17c15-38d8-43ac-995d-2e7574151006 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:43.436261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f17c15-38d8-43ac-995d-2e7574151006 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:43.442768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5345cb-a470-4a92-ab9b-1e5151bc4911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:43.443611 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5345cb-a470-4a92-ab9b-1e5151bc4911 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.443859 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5345cb-a470-4a92-ab9b-1e5151bc4911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.444135 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5345cb-a470-4a92-ab9b-1e5151bc4911 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.460551 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5345cb-a470-4a92-ab9b-1e5151bc4911 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:43.467882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-5b5345cb-a470-4a92-ab9b-1e5151bc4911 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 02:50:43.469622 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 54/108] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:50:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:43.473704 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b87e2-1772-4d61-91d2-4a96e014d589 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:43.481065 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5345cb-a470-4a92-ab9b-1e5151bc4911 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:43.485438 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b87e2-1772-4d61-91d2-4a96e014d589 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:43.490764 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a46c2-6959-4dd0-a46e-d58974bb30c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:43.491561 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a46c2-6959-4dd0-a46e-d58974bb30c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.491847 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a46c2-6959-4dd0-a46e-d58974bb30c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.492128 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a46c2-6959-4dd0-a46e-d58974bb30c7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.496395 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5345cb-a470-4a92-ab9b-1e5151bc4911 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:43.509676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab7add-2b26-45b4-8e6c-33c41f64e201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:43.510639 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab7add-2b26-45b4-8e6c-33c41f64e201 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.510923 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab7add-2b26-45b4-8e6c-33c41f64e201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.511200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab7add-2b26-45b4-8e6c-33c41f64e201 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.511972 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab7add-2b26-45b4-8e6c-33c41f64e201 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:43.512285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab7add-2b26-45b4-8e6c-33c41f64e201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:43.513931 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab7add-2b26-45b4-8e6c-33c41f64e201 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:43.516928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a46c2-6959-4dd0-a46e-d58974bb30c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:43.527323 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-fc6a46c2-6959-4dd0-a46e-d58974bb30c7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:50:43.528713 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 55/109] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:50:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:43.536016 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 55/110] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:50:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:43.537064 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a46c2-6959-4dd0-a46e-d58974bb30c7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:43.542099 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab7add-2b26-45b4-8e6c-33c41f64e201 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:43.554010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab7add-2b26-45b4-8e6c-33c41f64e201 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:43.556862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a46c2-6959-4dd0-a46e-d58974bb30c7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:43.563190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a42e1a-d9d2-48e4-9662-53b687f4c09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:43.564049 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a42e1a-d9d2-48e4-9662-53b687f4c09f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.564334 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a42e1a-d9d2-48e4-9662-53b687f4c09f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.564613 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a42e1a-d9d2-48e4-9662-53b687f4c09f admin admin] PATH_INFO: `/v3/users/7fde99a5ff1a40da963ed07b17b757a7` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.566272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a42e1a-d9d2-48e4-9662-53b687f4c09f admin admin] RBAC: Authorizing `identity:get_user(user_id=7fde99a5ff1a40da963ed07b17b757a7)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:43.568425 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a42e1a-d9d2-48e4-9662-53b687f4c09f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:43.570198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 56/111] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:43 2021] GET /identity/v3/users/7fde99a5ff1a40da963ed07b17b757a7 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:43.570683 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20df98-db77-4717-818f-92a45c58d1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:43.571410 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20df98-db77-4717-818f-92a45c58d1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.571697 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20df98-db77-4717-818f-92a45c58d1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.571974 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20df98-db77-4717-818f-92a45c58d1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.572739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20df98-db77-4717-818f-92a45c58d1f0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:43.573056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20df98-db77-4717-818f-92a45c58d1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:43.574769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20df98-db77-4717-818f-92a45c58d1f0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:43.576942 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a42e1a-d9d2-48e4-9662-53b687f4c09f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:43.591564 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 56/112] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:43.594426 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a42e1a-d9d2-48e4-9662-53b687f4c09f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:43.598859 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20df98-db77-4717-818f-92a45c58d1f0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:43.605442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aee53c-49dd-4af0-b0f7-046982a04bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:43.606322 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aee53c-49dd-4af0-b0f7-046982a04bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.606608 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aee53c-49dd-4af0-b0f7-046982a04bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.606885 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aee53c-49dd-4af0-b0f7-046982a04bb9 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.609048 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aee53c-49dd-4af0-b0f7-046982a04bb9 admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:43.611200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aee53c-49dd-4af0-b0f7-046982a04bb9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:43.612886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 57/113] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:43 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:43.615425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20df98-db77-4717-818f-92a45c58d1f0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:43.619465 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aee53c-49dd-4af0-b0f7-046982a04bb9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:43.625604 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75af160-6222-4d3d-bddf-7a596134ec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:43.626505 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af160-6222-4d3d-bddf-7a596134ec73 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.626785 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af160-6222-4d3d-bddf-7a596134ec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.627059 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af160-6222-4d3d-bddf-7a596134ec73 admin admin] PATH_INFO: `/v3/users/3bbde01a62314e839f70db08ddf77996` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.629811 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75af160-6222-4d3d-bddf-7a596134ec73 admin admin] RBAC: Authorizing `identity:get_user(user_id=3bbde01a62314e839f70db08ddf77996)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:43.631667 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75af160-6222-4d3d-bddf-7a596134ec73 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:43.633271 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 57/114] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:43 2021] GET /identity/v3/users/3bbde01a62314e839f70db08ddf77996 => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:43.637138 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aee53c-49dd-4af0-b0f7-046982a04bb9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:43.639516 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75af160-6222-4d3d-bddf-7a596134ec73 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:43.649622 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1fb77-ce83-49d7-a698-3666973ab9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:43.650533 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1fb77-ce83-49d7-a698-3666973ab9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.650816 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1fb77-ce83-49d7-a698-3666973ab9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.651092 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1fb77-ce83-49d7-a698-3666973ab9e5 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487/users/7fde99a5ff1a40da963ed07b17b757a7/roles/bcbedb9e465844d2a8baa6af3760e916` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.653560 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75af160-6222-4d3d-bddf-7a596134ec73 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:43.657033 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1fb77-ce83-49d7-a698-3666973ab9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bec9401bcfa489d98020b66bccfa487, user_id=7fde99a5ff1a40da963ed07b17b757a7, role_id=bcbedb9e465844d2a8baa6af3760e916)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:43.659747 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1fb77-ce83-49d7-a698-3666973ab9e5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:43.665312 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ca04f-d915-4030-a7bd-fc3d2a171da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:43.666176 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ca04f-d915-4030-a7bd-fc3d2a171da8 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.666456 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ca04f-d915-4030-a7bd-fc3d2a171da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.666732 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ca04f-d915-4030-a7bd-fc3d2a171da8 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.668924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ca04f-d915-4030-a7bd-fc3d2a171da8 admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:43.671057 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ca04f-d915-4030-a7bd-fc3d2a171da8 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:43.673834 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 58/115] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:43 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:43.682625 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ca04f-d915-4030-a7bd-fc3d2a171da8 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:43.689691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 58/116] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:50:43 2021] PUT /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487/users/7fde99a5ff1a40da963ed07b17b757a7/roles/bcbedb9e465844d2a8baa6af3760e916 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:50:43.696694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ca04f-d915-4030-a7bd-fc3d2a171da8 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:43.770493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d8ece-08a4-49b0-b56d-87c57ccdda94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:43.771493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d8ece-08a4-49b0-b56d-87c57ccdda94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.771784 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d8ece-08a4-49b0-b56d-87c57ccdda94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.772068 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d8ece-08a4-49b0-b56d-87c57ccdda94 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487/users/3bbde01a62314e839f70db08ddf77996/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.774213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d8ece-08a4-49b0-b56d-87c57ccdda94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bec9401bcfa489d98020b66bccfa487, user_id=3bbde01a62314e839f70db08ddf77996, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:43.777069 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d8ece-08a4-49b0-b56d-87c57ccdda94 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:43.793324 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 59/117] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:50:43 2021] PUT /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487/users/3bbde01a62314e839f70db08ddf77996/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:50:43.873886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6c824-7545-4ad8-8ad5-99864d746af6 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.874545 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6c824-7545-4ad8-8ad5-99864d746af6 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.874545 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6c824-7545-4ad8-8ad5-99864d746af6 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.877338 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 59/118] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:43.884036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4feb3-503b-465d-a77f-3ddf2cd7cc92 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.884654 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4feb3-503b-465d-a77f-3ddf2cd7cc92 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.884654 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4feb3-503b-465d-a77f-3ddf2cd7cc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.910199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-c8a4feb3-503b-465d-a77f-3ddf2cd7cc92 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:43.911589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c8a4feb3-503b-465d-a77f-3ddf2cd7cc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:43.966934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f043625-2bd2-4915-b5cf-804b4ea48c5b None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.967233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f043625-2bd2-4915-b5cf-804b4ea48c5b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.967486 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f043625-2bd2-4915-b5cf-804b4ea48c5b None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:43.970074 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 60/119] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:50:43.984250 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff92971-5c93-4d2b-b25a-1bf760110c73 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:43.985038 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff92971-5c93-4d2b-b25a-1bf760110c73 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:43.985382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff92971-5c93-4d2b-b25a-1bf760110c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:44.008090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 60/120] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:44.023041 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-8ff92971-5c93-4d2b-b25a-1bf760110c73 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:44.024251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8ff92971-5c93-4d2b-b25a-1bf760110c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:44.034634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4feb3-503b-465d-a77f-3ddf2cd7cc92 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:44.043211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 61/121] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:44.044786 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4feb3-503b-465d-a77f-3ddf2cd7cc92 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:44.050577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcdabc-a48e-45ee-a9d5-67fdb32d59e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:44.051494 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcdabc-a48e-45ee-a9d5-67fdb32d59e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:44.051834 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcdabc-a48e-45ee-a9d5-67fdb32d59e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:44.052161 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcdabc-a48e-45ee-a9d5-67fdb32d59e1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:44.064610 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcdabc-a48e-45ee-a9d5-67fdb32d59e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:44.072067 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-3adcdabc-a48e-45ee-a9d5-67fdb32d59e1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:50:44.073747 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 61/122] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:50:44.080367 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff92971-5c93-4d2b-b25a-1bf760110c73 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:44.084032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcdabc-a48e-45ee-a9d5-67fdb32d59e1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:44.101132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcdabc-a48e-45ee-a9d5-67fdb32d59e1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:44.104376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff92971-5c93-4d2b-b25a-1bf760110c73 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:44.113171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db9228-a7e7-4764-9dea-16da5af30d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:44.113822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa4dfb-043f-4be4-a0a1-1adf002777b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:44.114661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4dfb-043f-4be4-a0a1-1adf002777b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:44.114946 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4dfb-043f-4be4-a0a1-1adf002777b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:44.115242 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db9228-a7e7-4764-9dea-16da5af30d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:44.115525 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db9228-a7e7-4764-9dea-16da5af30d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:44.115802 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db9228-a7e7-4764-9dea-16da5af30d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:44.116590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db9228-a7e7-4764-9dea-16da5af30d9c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:44.116779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4dfb-043f-4be4-a0a1-1adf002777b2 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:44.117940 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db9228-a7e7-4764-9dea-16da5af30d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:44.120934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db9228-a7e7-4764-9dea-16da5af30d9c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:44.141895 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 62/123] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:50:44 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:44.142963 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa4dfb-043f-4be4-a0a1-1adf002777b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:44.150492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-b7aa4dfb-043f-4be4-a0a1-1adf002777b2 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 02:50:44.152130 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 62/124] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:44 2021] GET /identity/v3/roles/reader => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:44.158620 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db9228-a7e7-4764-9dea-16da5af30d9c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:44.161474 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa4dfb-043f-4be4-a0a1-1adf002777b2 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:44.169012 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db9228-a7e7-4764-9dea-16da5af30d9c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:44.178240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad633f6-af7f-45b3-815c-a8fddef8faf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:44.178240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad633f6-af7f-45b3-815c-a8fddef8faf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:44.178657 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad633f6-af7f-45b3-815c-a8fddef8faf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:44.178657 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad633f6-af7f-45b3-815c-a8fddef8faf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:44.179466 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad633f6-af7f-45b3-815c-a8fddef8faf5 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:44.182433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad633f6-af7f-45b3-815c-a8fddef8faf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:44.182433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad633f6-af7f-45b3-815c-a8fddef8faf5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:44.183836 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa4dfb-043f-4be4-a0a1-1adf002777b2 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:44.190331 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be44af-8a3a-4b2e-ad28-20940c04945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:44.190764 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 63/125] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:50:44 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:44.191706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be44af-8a3a-4b2e-ad28-20940c04945c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:44.192208 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be44af-8a3a-4b2e-ad28-20940c04945c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:44.192678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be44af-8a3a-4b2e-ad28-20940c04945c admin admin] PATH_INFO: `/v3/users/7fde99a5ff1a40da963ed07b17b757a7` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:44.196704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad633f6-af7f-45b3-815c-a8fddef8faf5 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:44.197724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be44af-8a3a-4b2e-ad28-20940c04945c admin admin] RBAC: Authorizing `identity:get_user(user_id=7fde99a5ff1a40da963ed07b17b757a7)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:44.207679 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be44af-8a3a-4b2e-ad28-20940c04945c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:44.208561 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad633f6-af7f-45b3-815c-a8fddef8faf5 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:44.209835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 63/126] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:44 2021] GET /identity/v3/users/7fde99a5ff1a40da963ed07b17b757a7 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:44.214009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720a441-df9f-4e7c-b684-52bf506401c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:44.214162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720a441-df9f-4e7c-b684-52bf506401c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:44.214431 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720a441-df9f-4e7c-b684-52bf506401c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:44.214704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720a441-df9f-4e7c-b684-52bf506401c1 admin admin] PATH_INFO: `/v3/users/173ad3bb1cfe428dbeae05cefe9b8c37` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:44.216059 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be44af-8a3a-4b2e-ad28-20940c04945c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:44.231108 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720a441-df9f-4e7c-b684-52bf506401c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=173ad3bb1cfe428dbeae05cefe9b8c37)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:44.233392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720a441-df9f-4e7c-b684-52bf506401c1 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:44.235725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be44af-8a3a-4b2e-ad28-20940c04945c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:44.236114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 64/127] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:44 2021] GET /identity/v3/users/173ad3bb1cfe428dbeae05cefe9b8c37 => generated 289 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:44.242335 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720a441-df9f-4e7c-b684-52bf506401c1 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:44.251419 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115be50d-9e06-473f-8067-16078f8741ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:44.252695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115be50d-9e06-473f-8067-16078f8741ec admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:44.253177 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115be50d-9e06-473f-8067-16078f8741ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:44.253278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720a441-df9f-4e7c-b684-52bf506401c1 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:44.253744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115be50d-9e06-473f-8067-16078f8741ec admin admin] PATH_INFO: `/v3/projects/3d23926ac3d4471999077c568ca431c0` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:44.258320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d404672-4c1d-45cf-bccb-3f263a94c2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:44.258981 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d404672-4c1d-45cf-bccb-3f263a94c2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:44.259313 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d404672-4c1d-45cf-bccb-3f263a94c2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:44.259590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d404672-4c1d-45cf-bccb-3f263a94c2a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:44.259881 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115be50d-9e06-473f-8067-16078f8741ec admin admin] RBAC: Authorizing `identity:get_project(project_id=3d23926ac3d4471999077c568ca431c0)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:44.262559 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115be50d-9e06-473f-8067-16078f8741ec admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:44.264841 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 64/128] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:44 2021] GET /identity/v3/projects/3d23926ac3d4471999077c568ca431c0 => generated 312 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:44.268920 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d404672-4c1d-45cf-bccb-3f263a94c2a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:44.270864 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115be50d-9e06-473f-8067-16078f8741ec admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:44.270982 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d404672-4c1d-45cf-bccb-3f263a94c2a8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:44.282505 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 65/129] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:44 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 02:50:44.287669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115be50d-9e06-473f-8067-16078f8741ec admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:44.288912 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d404672-4c1d-45cf-bccb-3f263a94c2a8 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:44.300763 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d404672-4c1d-45cf-bccb-3f263a94c2a8 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:44.302618 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce39224-bb49-4c84-b581-fd56e45cabae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:44.303517 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce39224-bb49-4c84-b581-fd56e45cabae admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:44.303800 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce39224-bb49-4c84-b581-fd56e45cabae admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:44.304077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce39224-bb49-4c84-b581-fd56e45cabae admin admin] PATH_INFO: `/v3/projects/3d23926ac3d4471999077c568ca431c0/users/7fde99a5ff1a40da963ed07b17b757a7/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:44.306896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fc2d1-8163-47d5-9870-88d4c08715fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:44.307992 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fc2d1-8163-47d5-9870-88d4c08715fc admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:44.308503 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fc2d1-8163-47d5-9870-88d4c08715fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:44.308967 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fc2d1-8163-47d5-9870-88d4c08715fc admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:44.310475 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fc2d1-8163-47d5-9870-88d4c08715fc admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:44.311414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce39224-bb49-4c84-b581-fd56e45cabae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d23926ac3d4471999077c568ca431c0, user_id=7fde99a5ff1a40da963ed07b17b757a7, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:44.313215 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fc2d1-8163-47d5-9870-88d4c08715fc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:44.314323 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce39224-bb49-4c84-b581-fd56e45cabae admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:44.315588 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 66/130] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:44 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:44.322143 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fc2d1-8163-47d5-9870-88d4c08715fc admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:44.337502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fc2d1-8163-47d5-9870-88d4c08715fc admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:44.346624 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e8336-1273-48f4-a0d4-5b2b132650c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:44.347784 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8336-1273-48f4-a0d4-5b2b132650c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:44.348368 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8336-1273-48f4-a0d4-5b2b132650c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:44.348849 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8336-1273-48f4-a0d4-5b2b132650c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:44.350033 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e8336-1273-48f4-a0d4-5b2b132650c2 admin admin] RBAC: Adding query filter params (role.id=1298b7f1875942e5baa6f96892b35aa9, scope.project.id=4bec9401bcfa489d98020b66bccfa487, user.id=173ad3bb1cfe428dbeae05cefe9b8c37) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:44.354351 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e8336-1273-48f4-a0d4-5b2b132650c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:44.356273 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 65/131] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:50:44 2021] PUT /identity/v3/projects/3d23926ac3d4471999077c568ca431c0/users/7fde99a5ff1a40da963ed07b17b757a7/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 02:50:44.357082 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e8336-1273-48f4-a0d4-5b2b132650c2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:44.363894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 67/132] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:50:44 2021] GET /identity/v3/role_assignments?user.id=173ad3bb1cfe428dbeae05cefe9b8c37&scope.project.id=4bec9401bcfa489d98020b66bccfa487&role.id=1298b7f1875942e5baa6f96892b35aa9 => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:45.005597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421391e6-93ec-4c8b-8e4c-8efa78cc0f64 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:45.006639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421391e6-93ec-4c8b-8e4c-8efa78cc0f64 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:45.007123 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421391e6-93ec-4c8b-8e4c-8efa78cc0f64 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:45.009106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 66/133] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:45.020783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017dfd8-83b4-437d-a7db-9188489dfbe9 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:45.021246 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017dfd8-83b4-437d-a7db-9188489dfbe9 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:45.021340 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017dfd8-83b4-437d-a7db-9188489dfbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:45.043249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-b017dfd8-83b4-437d-a7db-9188489dfbe9 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:45.044425 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b017dfd8-83b4-437d-a7db-9188489dfbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:45.121516 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 68/134] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:45.161032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421391e6-93ec-4c8b-8e4c-8efa78cc0f64 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:45.183599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421391e6-93ec-4c8b-8e4c-8efa78cc0f64 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:45.193146 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece7074-9692-4a58-9ec9-97d8840421aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:45.194192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece7074-9692-4a58-9ec9-97d8840421aa admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:45.194673 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece7074-9692-4a58-9ec9-97d8840421aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:45.195164 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece7074-9692-4a58-9ec9-97d8840421aa admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:45.196538 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece7074-9692-4a58-9ec9-97d8840421aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:45.198888 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece7074-9692-4a58-9ec9-97d8840421aa admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:45.201145 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 67/135] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:50:45 2021] GET /identity/v3/domains/default => generated 199 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:45.208794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017dfd8-83b4-437d-a7db-9188489dfbe9 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:45.218957 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017dfd8-83b4-437d-a7db-9188489dfbe9 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:45.228398 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1bbaa-1610-4fae-b5e6-1c95976fb362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:45.229050 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1bbaa-1610-4fae-b5e6-1c95976fb362 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:45.229329 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1bbaa-1610-4fae-b5e6-1c95976fb362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:45.229601 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1bbaa-1610-4fae-b5e6-1c95976fb362 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:45.230357 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1bbaa-1610-4fae-b5e6-1c95976fb362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:45.232289 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1bbaa-1610-4fae-b5e6-1c95976fb362 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:45.281895 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 69/136] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Dec 15 02:50:45 2021] POST /identity/v3/projects => generated 302 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:50:46.297267 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23011a-b6fe-4aef-bb72-66babfbbcabf None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:46.297771 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23011a-b6fe-4aef-bb72-66babfbbcabf None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:46.297842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23011a-b6fe-4aef-bb72-66babfbbcabf None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:46.299609 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 68/137] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:46.307386 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ab159-2566-4624-8e24-b9b5a1f237fc None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:46.307835 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ab159-2566-4624-8e24-b9b5a1f237fc None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:46.307932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ab159-2566-4624-8e24-b9b5a1f237fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:46.330959 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-9d1ab159-2566-4624-8e24-b9b5a1f237fc None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:46.332129 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9d1ab159-2566-4624-8e24-b9b5a1f237fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:46.405805 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 70/138] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:46.455425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23011a-b6fe-4aef-bb72-66babfbbcabf None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:46.467528 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23011a-b6fe-4aef-bb72-66babfbbcabf None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:46.474071 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61578c8e-e615-406c-9699-de290c366709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:46.475101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61578c8e-e615-406c-9699-de290c366709 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:46.475584 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61578c8e-e615-406c-9699-de290c366709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:46.476101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61578c8e-e615-406c-9699-de290c366709 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:46.491957 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61578c8e-e615-406c-9699-de290c366709 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:46.499236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-61578c8e-e615-406c-9699-de290c366709 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:50:46.501463 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 69/139] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:50:46.507645 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ab159-2566-4624-8e24-b9b5a1f237fc None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:46.522975 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ab159-2566-4624-8e24-b9b5a1f237fc None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:46.530321 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897be41-15d1-471b-91ec-fe90b00c4caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:46.531072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897be41-15d1-471b-91ec-fe90b00c4caf admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:46.531354 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897be41-15d1-471b-91ec-fe90b00c4caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:46.531628 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897be41-15d1-471b-91ec-fe90b00c4caf admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:46.532414 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897be41-15d1-471b-91ec-fe90b00c4caf admin admin] RBAC: Adding query filter params (name=member) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:46.532718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897be41-15d1-471b-91ec-fe90b00c4caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:46.534396 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897be41-15d1-471b-91ec-fe90b00c4caf admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:46.550261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 71/140] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:50:46 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:46.556428 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61578c8e-e615-406c-9699-de290c366709 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:46.568432 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61578c8e-e615-406c-9699-de290c366709 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:46.574233 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4eb8b4-f165-47ec-a89d-c85e520504e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:46.575513 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4eb8b4-f165-47ec-a89d-c85e520504e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:46.576063 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4eb8b4-f165-47ec-a89d-c85e520504e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:46.576555 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4eb8b4-f165-47ec-a89d-c85e520504e0 admin admin] PATH_INFO: `/v3/users/7fde99a5ff1a40da963ed07b17b757a7` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:46.578688 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4eb8b4-f165-47ec-a89d-c85e520504e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fde99a5ff1a40da963ed07b17b757a7)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:46.581096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4eb8b4-f165-47ec-a89d-c85e520504e0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:46.583009 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 70/141] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:46 2021] GET /identity/v3/users/7fde99a5ff1a40da963ed07b17b757a7 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:46.589249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897be41-15d1-471b-91ec-fe90b00c4caf admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:46.602843 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897be41-15d1-471b-91ec-fe90b00c4caf admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:46.610443 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee77ee7-a2f3-4ff8-921c-2979478088ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:46.611079 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee77ee7-a2f3-4ff8-921c-2979478088ae admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:46.611356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee77ee7-a2f3-4ff8-921c-2979478088ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:46.611630 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee77ee7-a2f3-4ff8-921c-2979478088ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:46.626579 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee77ee7-a2f3-4ff8-921c-2979478088ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:46.628348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee77ee7-a2f3-4ff8-921c-2979478088ae admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:46.643277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 72/142] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:46 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:50:46.649491 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4eb8b4-f165-47ec-a89d-c85e520504e0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:46.662504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4eb8b4-f165-47ec-a89d-c85e520504e0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:46.669574 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bd246-7009-4bf5-a793-60f2908dd977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:46.670827 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bd246-7009-4bf5-a793-60f2908dd977 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:46.671313 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bd246-7009-4bf5-a793-60f2908dd977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:46.672353 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bd246-7009-4bf5-a793-60f2908dd977 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:46.673798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bd246-7009-4bf5-a793-60f2908dd977 admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:46.676159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bd246-7009-4bf5-a793-60f2908dd977 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:46.678101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 71/143] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:46 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:46.684654 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee77ee7-a2f3-4ff8-921c-2979478088ae admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:46.698914 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee77ee7-a2f3-4ff8-921c-2979478088ae admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:46.706015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd16ee9-1464-4022-a31e-862819157d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:46.706661 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd16ee9-1464-4022-a31e-862819157d74 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:46.706943 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd16ee9-1464-4022-a31e-862819157d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:46.707219 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd16ee9-1464-4022-a31e-862819157d74 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:46.708050 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd16ee9-1464-4022-a31e-862819157d74 admin admin] RBAC: Adding query filter params (role.id=69edf382652b443c97811919233bb991, scope.project.id=4bec9401bcfa489d98020b66bccfa487, user.id=7fde99a5ff1a40da963ed07b17b757a7) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:46.708358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd16ee9-1464-4022-a31e-862819157d74 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:46.710218 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd16ee9-1464-4022-a31e-862819157d74 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:46.722634 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 73/144] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:50:46 2021] GET /identity/v3/role_assignments?user.id=7fde99a5ff1a40da963ed07b17b757a7&scope.project.id=4bec9401bcfa489d98020b66bccfa487&role.id=69edf382652b443c97811919233bb991 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:47.293010 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538bd9e-035a-477b-8375-dabe094ef0fd None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.293676 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538bd9e-035a-477b-8375-dabe094ef0fd None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.294178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538bd9e-035a-477b-8375-dabe094ef0fd None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.296188 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 72/145] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:47.307861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2be22-4006-4c0d-8d43-4fd2be760b0b None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.308765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2be22-4006-4c0d-8d43-4fd2be760b0b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.309258 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2be22-4006-4c0d-8d43-4fd2be760b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.330681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-bbf2be22-4006-4c0d-8d43-4fd2be760b0b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:47.332416 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-bbf2be22-4006-4c0d-8d43-4fd2be760b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:47.344872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 74/146] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:47.363206 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efc051-99a1-41b0-b89d-aca20ace35a6 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.364178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efc051-99a1-41b0-b89d-aca20ace35a6 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.364658 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efc051-99a1-41b0-b89d-aca20ace35a6 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.367226 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 73/147] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:47.373474 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959a5c5-5e1f-4afd-b3a3-0fba1655997b None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.374117 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959a5c5-5e1f-4afd-b3a3-0fba1655997b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.374626 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959a5c5-5e1f-4afd-b3a3-0fba1655997b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.377308 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efc051-99a1-41b0-b89d-aca20ace35a6 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:47.392869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efc051-99a1-41b0-b89d-aca20ace35a6 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:47.405391 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e40e7-c0eb-429b-beb5-6726212012b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:47.407182 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e40e7-c0eb-429b-beb5-6726212012b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.407709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e40e7-c0eb-429b-beb5-6726212012b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.408239 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e40e7-c0eb-429b-beb5-6726212012b9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.419140 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-5959a5c5-5e1f-4afd-b3a3-0fba1655997b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:47.422515 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-5959a5c5-5e1f-4afd-b3a3-0fba1655997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:47.429037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e40e7-c0eb-429b-beb5-6726212012b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:47.439326 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 75/148] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:47.444093 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-069e40e7-c0eb-429b-beb5-6726212012b9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 02:50:47.445541 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 74/149] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:50:47 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:50:47.452283 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959a5c5-5e1f-4afd-b3a3-0fba1655997b None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:47.464028 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e40e7-c0eb-429b-beb5-6726212012b9 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:47.466264 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959a5c5-5e1f-4afd-b3a3-0fba1655997b None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:47.478191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd977368-0cfb-46fc-9bdf-ba20a1723c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:47.478191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd977368-0cfb-46fc-9bdf-ba20a1723c14 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.478191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd977368-0cfb-46fc-9bdf-ba20a1723c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.478191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd977368-0cfb-46fc-9bdf-ba20a1723c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.478533 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd977368-0cfb-46fc-9bdf-ba20a1723c14 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:47.478533 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd977368-0cfb-46fc-9bdf-ba20a1723c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:47.479921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd977368-0cfb-46fc-9bdf-ba20a1723c14 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:47.481859 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e40e7-c0eb-429b-beb5-6726212012b9 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:47.491418 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52320f4-91ac-4b38-8d2e-0c69f9f29033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:47.492505 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52320f4-91ac-4b38-8d2e-0c69f9f29033 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.494067 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52320f4-91ac-4b38-8d2e-0c69f9f29033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.496718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 76/150] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:50:47 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:47.496961 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52320f4-91ac-4b38-8d2e-0c69f9f29033 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.503327 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd977368-0cfb-46fc-9bdf-ba20a1723c14 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:47.516677 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd977368-0cfb-46fc-9bdf-ba20a1723c14 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:47.521875 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fb526-996a-4450-842e-bd69dd8b47f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:47.523216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fb526-996a-4450-842e-bd69dd8b47f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.523700 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fb526-996a-4450-842e-bd69dd8b47f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.524250 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fb526-996a-4450-842e-bd69dd8b47f8 admin admin] PATH_INFO: `/v3/users/7fde99a5ff1a40da963ed07b17b757a7` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.525929 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fb526-996a-4450-842e-bd69dd8b47f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fde99a5ff1a40da963ed07b17b757a7)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:47.527118 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52320f4-91ac-4b38-8d2e-0c69f9f29033 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:47.528900 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fb526-996a-4450-842e-bd69dd8b47f8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:47.531672 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 77/151] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:47 2021] GET /identity/v3/users/7fde99a5ff1a40da963ed07b17b757a7 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:47.542050 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-c52320f4-91ac-4b38-8d2e-0c69f9f29033 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:50:47.543260 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fb526-996a-4450-842e-bd69dd8b47f8 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:47.543714 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 75/152] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:50:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:50:47.550106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52320f4-91ac-4b38-8d2e-0c69f9f29033 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:47.555782 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fb526-996a-4450-842e-bd69dd8b47f8 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:47.564678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52320f4-91ac-4b38-8d2e-0c69f9f29033 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:47.567961 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc78c60-8587-425a-ad27-85f377f6a623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:47.568694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc78c60-8587-425a-ad27-85f377f6a623 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.568973 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc78c60-8587-425a-ad27-85f377f6a623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.569300 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc78c60-8587-425a-ad27-85f377f6a623 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.579298 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751a46c-0a39-4031-89fc-6e3b60763748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:47.580147 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751a46c-0a39-4031-89fc-6e3b60763748 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.583128 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751a46c-0a39-4031-89fc-6e3b60763748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.583128 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751a46c-0a39-4031-89fc-6e3b60763748 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.583128 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751a46c-0a39-4031-89fc-6e3b60763748 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:47.583128 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751a46c-0a39-4031-89fc-6e3b60763748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:47.583643 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751a46c-0a39-4031-89fc-6e3b60763748 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:47.584407 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc78c60-8587-425a-ad27-85f377f6a623 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:47.586239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc78c60-8587-425a-ad27-85f377f6a623 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:47.601382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 78/153] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 02:50:47.608168 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 76/154] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:47.610202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc78c60-8587-425a-ad27-85f377f6a623 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:47.614977 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751a46c-0a39-4031-89fc-6e3b60763748 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:47.625593 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc78c60-8587-425a-ad27-85f377f6a623 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:47.627888 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751a46c-0a39-4031-89fc-6e3b60763748 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:47.633725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2bd2b-137d-4d6d-990b-957d758f1767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:47.634085 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6f2fa-c624-4bca-814c-ecbff966e5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:47.634621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2bd2b-137d-4d6d-990b-957d758f1767 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.634958 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2bd2b-137d-4d6d-990b-957d758f1767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.635492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2bd2b-137d-4d6d-990b-957d758f1767 admin admin] PATH_INFO: `/v3/users/3bbde01a62314e839f70db08ddf77996` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.635979 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6f2fa-c624-4bca-814c-ecbff966e5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.636461 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6f2fa-c624-4bca-814c-ecbff966e5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.636758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2bd2b-137d-4d6d-990b-957d758f1767 admin admin] RBAC: Authorizing `identity:get_user(user_id=3bbde01a62314e839f70db08ddf77996)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:47.637130 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6f2fa-c624-4bca-814c-ecbff966e5b3 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.638567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6f2fa-c624-4bca-814c-ecbff966e5b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:47.638739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2bd2b-137d-4d6d-990b-957d758f1767 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:47.641089 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 77/155] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:47 2021] GET /identity/v3/users/3bbde01a62314e839f70db08ddf77996 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:47.641850 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6f2fa-c624-4bca-814c-ecbff966e5b3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:47.645197 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 79/156] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:47 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:47.648709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2bd2b-137d-4d6d-990b-957d758f1767 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:47.650174 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6f2fa-c624-4bca-814c-ecbff966e5b3 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:47.660169 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2bd2b-137d-4d6d-990b-957d758f1767 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:47.663447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6f2fa-c624-4bca-814c-ecbff966e5b3 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:47.671678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9249c2-6cbf-47ff-8bf1-76a3933eea81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:47.672607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9249c2-6cbf-47ff-8bf1-76a3933eea81 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.673599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9249c2-6cbf-47ff-8bf1-76a3933eea81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.674691 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9249c2-6cbf-47ff-8bf1-76a3933eea81 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.677246 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359c8d7-670b-489b-896f-5d10c0591e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:47.679354 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359c8d7-670b-489b-896f-5d10c0591e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.679889 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359c8d7-670b-489b-896f-5d10c0591e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.682043 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359c8d7-670b-489b-896f-5d10c0591e8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.683157 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359c8d7-670b-489b-896f-5d10c0591e8b admin admin] RBAC: Adding query filter params (role.id=bcbedb9e465844d2a8baa6af3760e916, scope.project.id=4bec9401bcfa489d98020b66bccfa487, user.id=7fde99a5ff1a40da963ed07b17b757a7) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:47.684989 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359c8d7-670b-489b-896f-5d10c0591e8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:47.687710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359c8d7-670b-489b-896f-5d10c0591e8b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:47.693669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9249c2-6cbf-47ff-8bf1-76a3933eea81 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:47.695866 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9249c2-6cbf-47ff-8bf1-76a3933eea81 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:47.701849 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 80/157] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:50:47 2021] GET /identity/v3/role_assignments?user.id=7fde99a5ff1a40da963ed07b17b757a7&scope.project.id=4bec9401bcfa489d98020b66bccfa487&role.id=bcbedb9e465844d2a8baa6af3760e916 => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:47.709398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 78/158] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:50:47.718706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359c8d7-670b-489b-896f-5d10c0591e8b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:47.734124 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359c8d7-670b-489b-896f-5d10c0591e8b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:47.743316 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeb443-aa3f-458d-bd1e-f2635a4406d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:47.744556 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeb443-aa3f-458d-bd1e-f2635a4406d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.745056 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeb443-aa3f-458d-bd1e-f2635a4406d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.745614 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeb443-aa3f-458d-bd1e-f2635a4406d0 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.747305 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aeb443-aa3f-458d-bd1e-f2635a4406d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:47.750251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aeb443-aa3f-458d-bd1e-f2635a4406d0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:47.752329 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 81/159] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:47 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:47.758904 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9249c2-6cbf-47ff-8bf1-76a3933eea81 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:47.771781 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9249c2-6cbf-47ff-8bf1-76a3933eea81 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:47.778650 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8bccc-b338-474d-825c-960d564e728a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:47.779738 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8bccc-b338-474d-825c-960d564e728a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.780226 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8bccc-b338-474d-825c-960d564e728a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.780704 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8bccc-b338-474d-825c-960d564e728a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.781853 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8bccc-b338-474d-825c-960d564e728a admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=4bec9401bcfa489d98020b66bccfa487, user.id=3bbde01a62314e839f70db08ddf77996) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:47.782447 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8bccc-b338-474d-825c-960d564e728a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:47.784663 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8bccc-b338-474d-825c-960d564e728a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:47.795030 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 79/160] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:50:47 2021] GET /identity/v3/role_assignments?user.id=3bbde01a62314e839f70db08ddf77996&scope.project.id=4bec9401bcfa489d98020b66bccfa487&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:47.894780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94cf77-512f-44d4-900a-541e9416abdd None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.895420 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94cf77-512f-44d4-900a-541e9416abdd None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.895896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94cf77-512f-44d4-900a-541e9416abdd None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.898025 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 82/161] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:47.904876 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598e9ce-c378-4e2b-8bf9-d6fd5effd568 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:47.905493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598e9ce-c378-4e2b-8bf9-d6fd5effd568 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:47.906049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598e9ce-c378-4e2b-8bf9-d6fd5effd568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:47.936101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-e598e9ce-c378-4e2b-8bf9-d6fd5effd568 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:47.938277 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e598e9ce-c378-4e2b-8bf9-d6fd5effd568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:47.946840 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 80/162] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:47.981629 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94cf77-512f-44d4-900a-541e9416abdd None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:47.994856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94cf77-512f-44d4-900a-541e9416abdd None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:48.000364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257d408-a777-4cc4-96fe-a2db3fa83f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:48.001496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257d408-a777-4cc4-96fe-a2db3fa83f2f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:48.002052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257d408-a777-4cc4-96fe-a2db3fa83f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:48.002525 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257d408-a777-4cc4-96fe-a2db3fa83f2f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:48.021864 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257d408-a777-4cc4-96fe-a2db3fa83f2f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:48.029889 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-1257d408-a777-4cc4-96fe-a2db3fa83f2f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:50:48.031704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 83/163] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:47 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:48.038583 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598e9ce-c378-4e2b-8bf9-d6fd5effd568 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:48.048462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598e9ce-c378-4e2b-8bf9-d6fd5effd568 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:48.053816 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaf37c-d33d-4cd2-8022-b418d99f7f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:48.055002 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaf37c-d33d-4cd2-8022-b418d99f7f2a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:48.056597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaf37c-d33d-4cd2-8022-b418d99f7f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:48.056884 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaf37c-d33d-4cd2-8022-b418d99f7f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:48.057230 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2a614-b51d-4b65-9acf-2df2ae91d064 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:48.057699 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaf37c-d33d-4cd2-8022-b418d99f7f2a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:48.057917 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2a614-b51d-4b65-9acf-2df2ae91d064 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:48.058054 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaf37c-d33d-4cd2-8022-b418d99f7f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:48.058515 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2a614-b51d-4b65-9acf-2df2ae91d064 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:48.059970 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaf37c-d33d-4cd2-8022-b418d99f7f2a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:48.060822 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 84/164] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:48.071266 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777cc0-e03c-4867-a3b5-68df05f34ece None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:48.071947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777cc0-e03c-4867-a3b5-68df05f34ece None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:48.072421 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777cc0-e03c-4867-a3b5-68df05f34ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:48.073175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 81/165] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:50:48 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:48.080087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaf37c-d33d-4cd2-8022-b418d99f7f2a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:48.089924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaf37c-d33d-4cd2-8022-b418d99f7f2a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:48.096936 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-71777cc0-e03c-4867-a3b5-68df05f34ece None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:48.097113 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4e1a7-01ad-41b3-b0c3-2635b253433b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:48.098049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4e1a7-01ad-41b3-b0c3-2635b253433b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:48.098334 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4e1a7-01ad-41b3-b0c3-2635b253433b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:48.098829 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4e1a7-01ad-41b3-b0c3-2635b253433b admin admin] PATH_INFO: `/v3/users/7fde99a5ff1a40da963ed07b17b757a7` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:48.099251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-71777cc0-e03c-4867-a3b5-68df05f34ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:48.100217 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4e1a7-01ad-41b3-b0c3-2635b253433b admin admin] RBAC: Authorizing `identity:get_user(user_id=7fde99a5ff1a40da963ed07b17b757a7)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:48.102859 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4e1a7-01ad-41b3-b0c3-2635b253433b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:48.107846 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 82/166] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:48 2021] GET /identity/v3/users/7fde99a5ff1a40da963ed07b17b757a7 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:48.108367 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 85/167] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:48.114806 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4e1a7-01ad-41b3-b0c3-2635b253433b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:48.125764 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4e1a7-01ad-41b3-b0c3-2635b253433b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:48.132793 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de531d6-2277-4aa8-86cf-085de08bc620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:48.133485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de531d6-2277-4aa8-86cf-085de08bc620 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:48.133771 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de531d6-2277-4aa8-86cf-085de08bc620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:48.134076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de531d6-2277-4aa8-86cf-085de08bc620 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:48.135471 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71777cc0-e03c-4867-a3b5-68df05f34ece None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:48.143589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de531d6-2277-4aa8-86cf-085de08bc620 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:48.145372 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de531d6-2277-4aa8-86cf-085de08bc620 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:48.148075 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71777cc0-e03c-4867-a3b5-68df05f34ece None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:48.153297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da23198-f00e-4596-a916-91aeaab49c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:48.154175 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da23198-f00e-4596-a916-91aeaab49c5d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:48.154451 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da23198-f00e-4596-a916-91aeaab49c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:48.154717 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da23198-f00e-4596-a916-91aeaab49c5d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:48.156999 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 83/168] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:48 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:50:48.163450 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de531d6-2277-4aa8-86cf-085de08bc620 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:48.172793 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de531d6-2277-4aa8-86cf-085de08bc620 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:48.173015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da23198-f00e-4596-a916-91aeaab49c5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:48.178363 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd348023-5d49-4f7b-820b-d3357ccf8de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:48.179200 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd348023-5d49-4f7b-820b-d3357ccf8de7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:48.179477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd348023-5d49-4f7b-820b-d3357ccf8de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:48.179749 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd348023-5d49-4f7b-820b-d3357ccf8de7 admin admin] PATH_INFO: `/v3/projects/3d23926ac3d4471999077c568ca431c0` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:48.179902 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-4da23198-f00e-4596-a916-91aeaab49c5d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 02:50:48.180936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd348023-5d49-4f7b-820b-d3357ccf8de7 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d23926ac3d4471999077c568ca431c0)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:48.181109 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 86/169] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:48 2021] GET /identity/v3/roles/reader => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:48.183050 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd348023-5d49-4f7b-820b-d3357ccf8de7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:48.184711 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 84/170] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:48 2021] GET /identity/v3/projects/3d23926ac3d4471999077c568ca431c0 => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:48.189260 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da23198-f00e-4596-a916-91aeaab49c5d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:48.197636 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd348023-5d49-4f7b-820b-d3357ccf8de7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:48.202351 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da23198-f00e-4596-a916-91aeaab49c5d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:48.207327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd348023-5d49-4f7b-820b-d3357ccf8de7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:48.210019 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eb397-9f87-434a-b72e-343c5d0fadb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:48.210019 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eb397-9f87-434a-b72e-343c5d0fadb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:48.210019 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eb397-9f87-434a-b72e-343c5d0fadb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:48.210019 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eb397-9f87-434a-b72e-343c5d0fadb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:48.210349 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eb397-9f87-434a-b72e-343c5d0fadb4 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:48.210349 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eb397-9f87-434a-b72e-343c5d0fadb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:48.211888 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eb397-9f87-434a-b72e-343c5d0fadb4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:48.214765 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ebf9d-deb9-473b-b401-cac3948a910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:48.215578 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ebf9d-deb9-473b-b401-cac3948a910c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:48.216071 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ebf9d-deb9-473b-b401-cac3948a910c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:48.216533 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ebf9d-deb9-473b-b401-cac3948a910c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:48.217548 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ebf9d-deb9-473b-b401-cac3948a910c admin admin] RBAC: Adding query filter params (role.id=69edf382652b443c97811919233bb991, scope.project.id=3d23926ac3d4471999077c568ca431c0, user.id=7fde99a5ff1a40da963ed07b17b757a7) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:48.218066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ebf9d-deb9-473b-b401-cac3948a910c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:48.220218 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ebf9d-deb9-473b-b401-cac3948a910c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:48.222583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 87/171] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:50:48 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:48.231608 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eb397-9f87-434a-b72e-343c5d0fadb4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:48.231784 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 85/172] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:50:48 2021] GET /identity/v3/role_assignments?user.id=7fde99a5ff1a40da963ed07b17b757a7&scope.project.id=3d23926ac3d4471999077c568ca431c0&role.id=69edf382652b443c97811919233bb991 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:48.241913 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eb397-9f87-434a-b72e-343c5d0fadb4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:48.246494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcfddd-b7f3-4d46-9b5e-1f12a8f9b9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:48.247374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcfddd-b7f3-4d46-9b5e-1f12a8f9b9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:48.247651 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcfddd-b7f3-4d46-9b5e-1f12a8f9b9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:48.247922 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcfddd-b7f3-4d46-9b5e-1f12a8f9b9e9 admin admin] PATH_INFO: `/v3/users/173ad3bb1cfe428dbeae05cefe9b8c37` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:48.249189 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcfddd-b7f3-4d46-9b5e-1f12a8f9b9e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=173ad3bb1cfe428dbeae05cefe9b8c37)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:48.252118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcfddd-b7f3-4d46-9b5e-1f12a8f9b9e9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:48.254070 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 88/173] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:48 2021] GET /identity/v3/users/173ad3bb1cfe428dbeae05cefe9b8c37 => generated 289 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:48.260261 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ebf9d-deb9-473b-b401-cac3948a910c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:48.270268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ebf9d-deb9-473b-b401-cac3948a910c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:48.274772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c763f88-ac37-46af-ab14-2b1640ee6ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:48.275641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c763f88-ac37-46af-ab14-2b1640ee6ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:48.275925 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c763f88-ac37-46af-ab14-2b1640ee6ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:48.276201 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c763f88-ac37-46af-ab14-2b1640ee6ef0 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:48.277449 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c763f88-ac37-46af-ab14-2b1640ee6ef0 admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:48.279564 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c763f88-ac37-46af-ab14-2b1640ee6ef0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:48.281531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 86/174] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:48 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:48.287589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcfddd-b7f3-4d46-9b5e-1f12a8f9b9e9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:48.298226 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcfddd-b7f3-4d46-9b5e-1f12a8f9b9e9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:48.302670 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187071ac-9741-47d5-b768-de3be323e346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:48.303558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187071ac-9741-47d5-b768-de3be323e346 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:48.303828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187071ac-9741-47d5-b768-de3be323e346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:48.304093 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187071ac-9741-47d5-b768-de3be323e346 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487/users/173ad3bb1cfe428dbeae05cefe9b8c37/roles/1298b7f1875942e5baa6f96892b35aa9` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:48.306436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187071ac-9741-47d5-b768-de3be323e346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bec9401bcfa489d98020b66bccfa487, user_id=173ad3bb1cfe428dbeae05cefe9b8c37, role_id=1298b7f1875942e5baa6f96892b35aa9)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:48.309124 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187071ac-9741-47d5-b768-de3be323e346 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:48.324973 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 89/175] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:50:48 2021] PUT /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487/users/173ad3bb1cfe428dbeae05cefe9b8c37/roles/1298b7f1875942e5baa6f96892b35aa9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:50:48.925851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba9af4-8044-4ce4-b697-6018deb8d00d None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:48.926401 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba9af4-8044-4ce4-b697-6018deb8d00d None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:48.926482 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba9af4-8044-4ce4-b697-6018deb8d00d None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:48.928209 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 87/176] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:48.933869 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23079627-9b4b-4d6e-a76f-705356d4063e None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:48.934255 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23079627-9b4b-4d6e-a76f-705356d4063e None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:48.934600 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23079627-9b4b-4d6e-a76f-705356d4063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:48.951702 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-23079627-9b4b-4d6e-a76f-705356d4063e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:48.953376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-23079627-9b4b-4d6e-a76f-705356d4063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:49.006537 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 90/177] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:49.032226 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba9af4-8044-4ce4-b697-6018deb8d00d None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:49.043949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba9af4-8044-4ce4-b697-6018deb8d00d None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:49.048127 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b82a0-c822-4c3b-b54d-09e510c49f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:49.048896 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b82a0-c822-4c3b-b54d-09e510c49f08 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:49.049177 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b82a0-c822-4c3b-b54d-09e510c49f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:49.049450 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b82a0-c822-4c3b-b54d-09e510c49f08 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:49.050615 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b82a0-c822-4c3b-b54d-09e510c49f08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:49.052324 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b82a0-c822-4c3b-b54d-09e510c49f08 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:49.054051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 88/178] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:50:49 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:49.059500 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23079627-9b4b-4d6e-a76f-705356d4063e None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:49.068371 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23079627-9b4b-4d6e-a76f-705356d4063e None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:49.072604 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a750d6b-2cf3-456e-b5c9-10cf72e541cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:49.073249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a750d6b-2cf3-456e-b5c9-10cf72e541cf admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:49.073529 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a750d6b-2cf3-456e-b5c9-10cf72e541cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:49.073802 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a750d6b-2cf3-456e-b5c9-10cf72e541cf admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:49.074562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a750d6b-2cf3-456e-b5c9-10cf72e541cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:49.076481 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a750d6b-2cf3-456e-b5c9-10cf72e541cf admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:49.096370 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 91/179] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:50:49 2021] POST /identity/v3/users => generated 283 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:50:50.668926 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb697ff3-6909-4bd1-ba39-9ba48266bd91 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:50.669921 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb697ff3-6909-4bd1-ba39-9ba48266bd91 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:50.670430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb697ff3-6909-4bd1-ba39-9ba48266bd91 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:50.672483 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 89/180] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:50.678383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33579a0c-d7a9-49ba-a6bc-ae45fefdcc48 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:50.678812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33579a0c-d7a9-49ba-a6bc-ae45fefdcc48 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:50.678993 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33579a0c-d7a9-49ba-a6bc-ae45fefdcc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:50.696687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-33579a0c-d7a9-49ba-a6bc-ae45fefdcc48 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:50.697843 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-33579a0c-d7a9-49ba-a6bc-ae45fefdcc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:50.705840 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 92/181] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:50.729138 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb697ff3-6909-4bd1-ba39-9ba48266bd91 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:50.741142 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb697ff3-6909-4bd1-ba39-9ba48266bd91 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:50.745382 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c1663-bfb4-4f2b-a930-3bd066a46fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:50.746259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c1663-bfb4-4f2b-a930-3bd066a46fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:50.746599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c1663-bfb4-4f2b-a930-3bd066a46fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:50.746932 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c1663-bfb4-4f2b-a930-3bd066a46fb5 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:50.758171 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c1663-bfb4-4f2b-a930-3bd066a46fb5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:50.765296 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-bf4c1663-bfb4-4f2b-a930-3bd066a46fb5 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 02:50:50.767051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 90/182] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:50 2021] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:50.773118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33579a0c-d7a9-49ba-a6bc-ae45fefdcc48 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:50.781897 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33579a0c-d7a9-49ba-a6bc-ae45fefdcc48 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:50.786297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacf963-079c-4549-be6e-acf296ba74d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:50.786999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacf963-079c-4549-be6e-acf296ba74d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:50.787341 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacf963-079c-4549-be6e-acf296ba74d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:50.787676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacf963-079c-4549-be6e-acf296ba74d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:50.788507 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacf963-079c-4549-be6e-acf296ba74d9 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:50.788869 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacf963-079c-4549-be6e-acf296ba74d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:50.790543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacf963-079c-4549-be6e-acf296ba74d9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:50.798770 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 93/183] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:50:50 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:50.804511 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c1663-bfb4-4f2b-a930-3bd066a46fb5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:50.814547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c1663-bfb4-4f2b-a930-3bd066a46fb5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:50.819087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02488753-4c22-41da-9e02-d287683001e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:50.820051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02488753-4c22-41da-9e02-d287683001e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:50.820400 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02488753-4c22-41da-9e02-d287683001e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:50.820742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02488753-4c22-41da-9e02-d287683001e5 admin admin] PATH_INFO: `/v3/users/173ad3bb1cfe428dbeae05cefe9b8c37` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:50.822021 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02488753-4c22-41da-9e02-d287683001e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=173ad3bb1cfe428dbeae05cefe9b8c37)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:50.824224 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02488753-4c22-41da-9e02-d287683001e5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:50.825859 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 91/184] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:50 2021] GET /identity/v3/users/173ad3bb1cfe428dbeae05cefe9b8c37 => generated 289 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:50.832259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacf963-079c-4549-be6e-acf296ba74d9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:50.841840 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacf963-079c-4549-be6e-acf296ba74d9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:50.846230 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba6e90-abfa-486b-8772-b03ad0286293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:50.846925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba6e90-abfa-486b-8772-b03ad0286293 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:50.847269 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba6e90-abfa-486b-8772-b03ad0286293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:50.847608 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba6e90-abfa-486b-8772-b03ad0286293 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:50.855203 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba6e90-abfa-486b-8772-b03ad0286293 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:50.857003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba6e90-abfa-486b-8772-b03ad0286293 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:50.865799 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 94/185] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:50:50.871559 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02488753-4c22-41da-9e02-d287683001e5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:50.881549 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02488753-4c22-41da-9e02-d287683001e5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:50.886303 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91068c8e-2087-4c75-ba13-48525cf01603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:50.887255 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91068c8e-2087-4c75-ba13-48525cf01603 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:50.887598 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91068c8e-2087-4c75-ba13-48525cf01603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:50.887932 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91068c8e-2087-4c75-ba13-48525cf01603 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:50.889216 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91068c8e-2087-4c75-ba13-48525cf01603 admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:50.892035 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91068c8e-2087-4c75-ba13-48525cf01603 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:50.893965 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 92/186] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:50 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:50.899973 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba6e90-abfa-486b-8772-b03ad0286293 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:50.908658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba6e90-abfa-486b-8772-b03ad0286293 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:50.913138 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499553e-6d9e-4ed3-9343-a063bbfa8052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:50.913831 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499553e-6d9e-4ed3-9343-a063bbfa8052 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:50.914199 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499553e-6d9e-4ed3-9343-a063bbfa8052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:50.914536 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499553e-6d9e-4ed3-9343-a063bbfa8052 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:50.915488 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499553e-6d9e-4ed3-9343-a063bbfa8052 admin admin] RBAC: Adding query filter params (role.id=1298b7f1875942e5baa6f96892b35aa9, scope.project.id=4bec9401bcfa489d98020b66bccfa487, user.id=173ad3bb1cfe428dbeae05cefe9b8c37) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:50.915857 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499553e-6d9e-4ed3-9343-a063bbfa8052 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:50.917730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499553e-6d9e-4ed3-9343-a063bbfa8052 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:50.923941 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 95/187] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:50:50 2021] GET /identity/v3/role_assignments?user.id=173ad3bb1cfe428dbeae05cefe9b8c37&scope.project.id=4bec9401bcfa489d98020b66bccfa487&role.id=1298b7f1875942e5baa6f96892b35aa9 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:51.566275 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa903c-9fac-48d0-86f5-5fdbdaa04728 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.566660 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa903c-9fac-48d0-86f5-5fdbdaa04728 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.566849 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa903c-9fac-48d0-86f5-5fdbdaa04728 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.568611 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 93/188] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:51.574377 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abfd80-b068-4760-9e6e-412e53d9b1d9 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.574739 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abfd80-b068-4760-9e6e-412e53d9b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.575083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abfd80-b068-4760-9e6e-412e53d9b1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.593078 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c6abfd80-b068-4760-9e6e-412e53d9b1d9 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:51.594272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c6abfd80-b068-4760-9e6e-412e53d9b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:51.601774 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 96/189] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:51.626332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa903c-9fac-48d0-86f5-5fdbdaa04728 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:51.638754 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa903c-9fac-48d0-86f5-5fdbdaa04728 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:51.643615 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9806b39-9766-465b-8a88-9e718d94ad15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:51.644389 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9806b39-9766-465b-8a88-9e718d94ad15 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.644672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9806b39-9766-465b-8a88-9e718d94ad15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.644947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9806b39-9766-465b-8a88-9e718d94ad15 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.655739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9806b39-9766-465b-8a88-9e718d94ad15 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:51.663101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-b9806b39-9766-465b-8a88-9e718d94ad15 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:50:51.664440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 94/190] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:50:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:51.670626 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abfd80-b068-4760-9e6e-412e53d9b1d9 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:51.679752 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abfd80-b068-4760-9e6e-412e53d9b1d9 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:51.684145 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e6e9d-f4d4-4a2b-bff1-b8b0758d2ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:51.684292 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71843e2-eb35-49e1-b5be-f5f38fef8a51 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.684641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71843e2-eb35-49e1-b5be-f5f38fef8a51 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.684804 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71843e2-eb35-49e1-b5be-f5f38fef8a51 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.684894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e6e9d-f4d4-4a2b-bff1-b8b0758d2ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.685208 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e6e9d-f4d4-4a2b-bff1-b8b0758d2ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.685548 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e6e9d-f4d4-4a2b-bff1-b8b0758d2ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.686413 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e6e9d-f4d4-4a2b-bff1-b8b0758d2ff7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:51.686803 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 95/191] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:50:51.686899 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e6e9d-f4d4-4a2b-bff1-b8b0758d2ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:51.688798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e6e9d-f4d4-4a2b-bff1-b8b0758d2ff7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:51.692603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b302977-98a8-4a7d-b837-c9dcb747b009 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.692892 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b302977-98a8-4a7d-b837-c9dcb747b009 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.693172 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b302977-98a8-4a7d-b837-c9dcb747b009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.702154 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 97/192] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:51.703989 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e6e9d-f4d4-4a2b-bff1-b8b0758d2ff7 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:51.713594 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e6e9d-f4d4-4a2b-bff1-b8b0758d2ff7 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:51.715661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-0b302977-98a8-4a7d-b837-c9dcb747b009 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:51.716820 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-0b302977-98a8-4a7d-b837-c9dcb747b009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:51.718193 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d28ae-2afd-4d98-9310-60ec95a6da31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:51.719264 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d28ae-2afd-4d98-9310-60ec95a6da31 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.719546 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d28ae-2afd-4d98-9310-60ec95a6da31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.719882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d28ae-2afd-4d98-9310-60ec95a6da31 admin admin] PATH_INFO: `/v3/users/4085812f294c44f89f07cf2267011ffa` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.724522 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 96/193] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:51.733511 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d28ae-2afd-4d98-9310-60ec95a6da31 admin admin] RBAC: Authorizing `identity:get_user(user_id=4085812f294c44f89f07cf2267011ffa)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:51.735704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d28ae-2afd-4d98-9310-60ec95a6da31 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:51.737496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 98/194] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:51 2021] GET /identity/v3/users/4085812f294c44f89f07cf2267011ffa => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:51.743365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b302977-98a8-4a7d-b837-c9dcb747b009 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:51.747664 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d28ae-2afd-4d98-9310-60ec95a6da31 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:51.753822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b302977-98a8-4a7d-b837-c9dcb747b009 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:51.757358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d28ae-2afd-4d98-9310-60ec95a6da31 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:51.758154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8af71-36a3-49cb-a211-523ecf4611b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:51.758805 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8af71-36a3-49cb-a211-523ecf4611b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.759090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8af71-36a3-49cb-a211-523ecf4611b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.759651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8af71-36a3-49cb-a211-523ecf4611b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.762047 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b859b-856c-49be-95d1-242a891568ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:51.762825 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b859b-856c-49be-95d1-242a891568ff admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.763100 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b859b-856c-49be-95d1-242a891568ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.763367 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b859b-856c-49be-95d1-242a891568ff admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.768338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8af71-36a3-49cb-a211-523ecf4611b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:51.770194 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8af71-36a3-49cb-a211-523ecf4611b5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:51.774046 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b859b-856c-49be-95d1-242a891568ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:51.778838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 97/195] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:50:51.780023 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff09f04-1bda-45d6-945f-e4663b5afbb3 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.780308 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff09f04-1bda-45d6-945f-e4663b5afbb3 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.780583 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff09f04-1bda-45d6-945f-e4663b5afbb3 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.781712 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-244b859b-856c-49be-95d1-242a891568ff admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 02:50:51.782278 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 98/196] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:51.785579 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 99/197] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:50:51 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:50:51.785676 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff09f04-1bda-45d6-945f-e4663b5afbb3 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:51.787890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58896fbf-a449-41a4-a39b-da2dda3754b7 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.788167 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58896fbf-a449-41a4-a39b-da2dda3754b7 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.788439 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58896fbf-a449-41a4-a39b-da2dda3754b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.796651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff09f04-1bda-45d6-945f-e4663b5afbb3 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:51.800736 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128191b-e39f-40c5-b72e-05621517917c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:51.801538 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128191b-e39f-40c5-b72e-05621517917c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.801816 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128191b-e39f-40c5-b72e-05621517917c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.802119 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128191b-e39f-40c5-b72e-05621517917c admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.803277 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128191b-e39f-40c5-b72e-05621517917c admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:51.805243 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-58896fbf-a449-41a4-a39b-da2dda3754b7 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:51.805353 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128191b-e39f-40c5-b72e-05621517917c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:51.806413 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-58896fbf-a449-41a4-a39b-da2dda3754b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:51.807080 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 99/198] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:51 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:51.807624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128191b-e39f-40c5-b72e-05621517917c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:51.814425 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 100/199] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:51.815177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58896fbf-a449-41a4-a39b-da2dda3754b7 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:51.817312 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128191b-e39f-40c5-b72e-05621517917c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:51.821456 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c7fe5-ee8d-4cc5-9be9-20577de0c6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:51.822223 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c7fe5-ee8d-4cc5-9be9-20577de0c6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.822382 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c7fe5-ee8d-4cc5-9be9-20577de0c6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.822635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c7fe5-ee8d-4cc5-9be9-20577de0c6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.823369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c7fe5-ee8d-4cc5-9be9-20577de0c6a2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:51.823671 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c7fe5-ee8d-4cc5-9be9-20577de0c6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:51.823771 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58896fbf-a449-41a4-a39b-da2dda3754b7 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:51.825202 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c7fe5-ee8d-4cc5-9be9-20577de0c6a2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:51.828401 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec90c1-b911-473b-9f96-17495b6a23b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:51.828990 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec90c1-b911-473b-9f96-17495b6a23b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.829263 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec90c1-b911-473b-9f96-17495b6a23b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.829534 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec90c1-b911-473b-9f96-17495b6a23b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.830376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec90c1-b911-473b-9f96-17495b6a23b8 admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0, user.id=4085812f294c44f89f07cf2267011ffa) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:51.831044 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec90c1-b911-473b-9f96-17495b6a23b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:51.832478 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec90c1-b911-473b-9f96-17495b6a23b8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:51.834157 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 100/200] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:50:51 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:51.837873 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 101/201] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:50:51 2021] GET /identity/v3/role_assignments?user.id=4085812f294c44f89f07cf2267011ffa&scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:51.844100 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c7fe5-ee8d-4cc5-9be9-20577de0c6a2 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:51.844292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec90c1-b911-473b-9f96-17495b6a23b8 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:51.854126 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec90c1-b911-473b-9f96-17495b6a23b8 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:51.858806 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a9dcf-b05e-4c5b-b9e5-9d5ea17ecd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:51.860238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a9dcf-b05e-4c5b-b9e5-9d5ea17ecd3f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.860508 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c7fe5-ee8d-4cc5-9be9-20577de0c6a2 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:51.860631 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a9dcf-b05e-4c5b-b9e5-9d5ea17ecd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.860907 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a9dcf-b05e-4c5b-b9e5-9d5ea17ecd3f admin admin] PATH_INFO: `/v3/users/4085812f294c44f89f07cf2267011ffa` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.862006 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a9dcf-b05e-4c5b-b9e5-9d5ea17ecd3f admin admin] RBAC: Authorizing `identity:get_user(user_id=4085812f294c44f89f07cf2267011ffa)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:51.864163 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a9dcf-b05e-4c5b-b9e5-9d5ea17ecd3f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:51.864996 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa68f59-d6e7-466d-b0a8-b92095bd890c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:51.866080 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa68f59-d6e7-466d-b0a8-b92095bd890c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.866183 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 102/202] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:51 2021] GET /identity/v3/users/4085812f294c44f89f07cf2267011ffa => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:51.866252 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa68f59-d6e7-466d-b0a8-b92095bd890c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.866448 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa68f59-d6e7-466d-b0a8-b92095bd890c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.867657 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa68f59-d6e7-466d-b0a8-b92095bd890c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:51.869392 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa68f59-d6e7-466d-b0a8-b92095bd890c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:51.876655 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 101/203] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:50:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:51.876929 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a9dcf-b05e-4c5b-b9e5-9d5ea17ecd3f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:51.878444 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa68f59-d6e7-466d-b0a8-b92095bd890c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:51.882708 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a9dcf-b05e-4c5b-b9e5-9d5ea17ecd3f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:51.887381 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f5f56-2dc1-4a32-8aec-262ced844910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:51.888018 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f5f56-2dc1-4a32-8aec-262ced844910 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.888297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f5f56-2dc1-4a32-8aec-262ced844910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.888571 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f5f56-2dc1-4a32-8aec-262ced844910 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.888866 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa68f59-d6e7-466d-b0a8-b92095bd890c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:51.893318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0733df-9cc1-4ea2-b639-2398f2d0c979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:51.894119 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0733df-9cc1-4ea2-b639-2398f2d0c979 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.894466 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0733df-9cc1-4ea2-b639-2398f2d0c979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.894816 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0733df-9cc1-4ea2-b639-2398f2d0c979 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.895635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0733df-9cc1-4ea2-b639-2398f2d0c979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:51.896747 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-4f0733df-9cc1-4ea2-b639-2398f2d0c979 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:50:51.896747 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:50:51.896747 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:50:51.897907 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f5f56-2dc1-4a32-8aec-262ced844910 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:51.898218 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0733df-9cc1-4ea2-b639-2398f2d0c979 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:51.899824 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f5f56-2dc1-4a32-8aec-262ced844910 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:51.909971 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 103/204] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 02:50:51.915932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f5f56-2dc1-4a32-8aec-262ced844910 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:51.925795 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f5f56-2dc1-4a32-8aec-262ced844910 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:51.938325 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 102/205] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:50:51 2021] POST /identity/v3/users => generated 297 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 02:50:51.938566 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7c322-8aad-4afc-a1d7-d46686ff89c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:51.938566 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7c322-8aad-4afc-a1d7-d46686ff89c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.938566 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7c322-8aad-4afc-a1d7-d46686ff89c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.938566 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7c322-8aad-4afc-a1d7-d46686ff89c6 admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.938882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7c322-8aad-4afc-a1d7-d46686ff89c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:51.938882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7c322-8aad-4afc-a1d7-d46686ff89c6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:51.939308 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 104/206] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:51 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:51.946036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0733df-9cc1-4ea2-b639-2398f2d0c979 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:51.956386 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0733df-9cc1-4ea2-b639-2398f2d0c979 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:51.961137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d521726-e616-4c31-9239-df0e919bf422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:51.961817 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d521726-e616-4c31-9239-df0e919bf422 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:51.962159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d521726-e616-4c31-9239-df0e919bf422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:51.962442 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d521726-e616-4c31-9239-df0e919bf422 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:51.963323 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d521726-e616-4c31-9239-df0e919bf422 admin admin] RBAC: Adding query filter params (role.id=bcbedb9e465844d2a8baa6af3760e916, scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0, user.id=4085812f294c44f89f07cf2267011ffa) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:51.963639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d521726-e616-4c31-9239-df0e919bf422 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:51.965671 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d521726-e616-4c31-9239-df0e919bf422 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:51.972783 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 103/207] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:50:51 2021] GET /identity/v3/role_assignments?user.id=4085812f294c44f89f07cf2267011ffa&scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0&role.id=bcbedb9e465844d2a8baa6af3760e916 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:54.217959 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e85b7-0ca0-4093-97b7-75a23e8c4151 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.218479 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e85b7-0ca0-4093-97b7-75a23e8c4151 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.218551 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e85b7-0ca0-4093-97b7-75a23e8c4151 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.220568 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 105/208] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:54.226388 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135a62f-f427-419d-b91b-8e186ddf4872 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.227208 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135a62f-f427-419d-b91b-8e186ddf4872 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.227685 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135a62f-f427-419d-b91b-8e186ddf4872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.247262 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-c135a62f-f427-419d-b91b-8e186ddf4872 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:54.248769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c135a62f-f427-419d-b91b-8e186ddf4872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:54.257183 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 104/209] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:54.280581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e85b7-0ca0-4093-97b7-75a23e8c4151 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.292510 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e85b7-0ca0-4093-97b7-75a23e8c4151 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.297230 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f913b-ca4e-43bb-bdcb-fb6f3bbdefb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.298005 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f913b-ca4e-43bb-bdcb-fb6f3bbdefb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.298327 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f913b-ca4e-43bb-bdcb-fb6f3bbdefb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.298596 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f913b-ca4e-43bb-bdcb-fb6f3bbdefb3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.308621 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f913b-ca4e-43bb-bdcb-fb6f3bbdefb3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:54.315926 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-158f913b-ca4e-43bb-bdcb-fb6f3bbdefb3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:50:54.317410 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 106/210] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:50:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:54.323566 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135a62f-f427-419d-b91b-8e186ddf4872 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.332657 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135a62f-f427-419d-b91b-8e186ddf4872 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.336993 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aee9b-e412-4966-8e16-d093362b10dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.337647 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aee9b-e412-4966-8e16-d093362b10dd admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.337923 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aee9b-e412-4966-8e16-d093362b10dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.338221 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aee9b-e412-4966-8e16-d093362b10dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.339025 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3aee9b-e412-4966-8e16-d093362b10dd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:54.339326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3aee9b-e412-4966-8e16-d093362b10dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:54.340924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3aee9b-e412-4966-8e16-d093362b10dd admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:54.343809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cb038-38dd-4484-ae13-c29b59b48c6b None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.344132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cb038-38dd-4484-ae13-c29b59b48c6b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.344418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cb038-38dd-4484-ae13-c29b59b48c6b None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.346278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 107/211] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:50:54.349890 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 105/212] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:54.352840 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87f936-5e34-44b8-9fb7-1aa816fedc51 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.353280 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87f936-5e34-44b8-9fb7-1aa816fedc51 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.353696 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87f936-5e34-44b8-9fb7-1aa816fedc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.356180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aee9b-e412-4966-8e16-d093362b10dd admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.366628 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aee9b-e412-4966-8e16-d093362b10dd admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.370969 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a254f1-2ad1-43af-ac5d-612405604ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.371817 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a254f1-2ad1-43af-ac5d-612405604ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.372091 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a254f1-2ad1-43af-ac5d-612405604ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.372361 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a254f1-2ad1-43af-ac5d-612405604ca6 admin admin] PATH_INFO: `/v3/users/4085812f294c44f89f07cf2267011ffa` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.373547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a254f1-2ad1-43af-ac5d-612405604ca6 admin admin] RBAC: Authorizing `identity:get_user(user_id=4085812f294c44f89f07cf2267011ffa)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:54.375382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-be87f936-5e34-44b8-9fb7-1aa816fedc51 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:54.376326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a254f1-2ad1-43af-ac5d-612405604ca6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:54.376884 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-be87f936-5e34-44b8-9fb7-1aa816fedc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:54.377907 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 106/213] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:54 2021] GET /identity/v3/users/4085812f294c44f89f07cf2267011ffa => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:54.383788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a254f1-2ad1-43af-ac5d-612405604ca6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.388594 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 108/214] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:54.399051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a254f1-2ad1-43af-ac5d-612405604ca6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.403512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652822f-017a-4e18-8b39-cda30c077cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.404514 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652822f-017a-4e18-8b39-cda30c077cbf admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.404927 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652822f-017a-4e18-8b39-cda30c077cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.405341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652822f-017a-4e18-8b39-cda30c077cbf admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.406695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652822f-017a-4e18-8b39-cda30c077cbf admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:54.408860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652822f-017a-4e18-8b39-cda30c077cbf admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:54.410678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 107/215] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:54 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:54.412660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87f936-5e34-44b8-9fb7-1aa816fedc51 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.419965 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652822f-017a-4e18-8b39-cda30c077cbf admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.422162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87f936-5e34-44b8-9fb7-1aa816fedc51 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.426489 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785903b-d10b-4e45-a8fb-5ed84629fa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.427483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785903b-d10b-4e45-a8fb-5ed84629fa20 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.427757 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785903b-d10b-4e45-a8fb-5ed84629fa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.428025 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785903b-d10b-4e45-a8fb-5ed84629fa20 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.433268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652822f-017a-4e18-8b39-cda30c077cbf admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.441672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a76e70-9911-471f-90b3-95df1d139245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.443098 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a76e70-9911-471f-90b3-95df1d139245 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.443363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785903b-d10b-4e45-a8fb-5ed84629fa20 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:54.443798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a76e70-9911-471f-90b3-95df1d139245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.444258 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a76e70-9911-471f-90b3-95df1d139245 admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0/users/4085812f294c44f89f07cf2267011ffa/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.446464 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a76e70-9911-471f-90b3-95df1d139245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec39c8c2a0a4950925dcf994f4875e0, user_id=4085812f294c44f89f07cf2267011ffa, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:54.449248 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a76e70-9911-471f-90b3-95df1d139245 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:54.450965 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-1785903b-d10b-4e45-a8fb-5ed84629fa20 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 02:50:54.452173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 109/216] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:50:54 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:54.458756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785903b-d10b-4e45-a8fb-5ed84629fa20 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.466867 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 108/217] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:50:54 2021] PUT /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0/users/4085812f294c44f89f07cf2267011ffa/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:50:54.467126 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff66ae4-1686-48ea-9cf7-f864338e8433 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.467557 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff66ae4-1686-48ea-9cf7-f864338e8433 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.467659 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff66ae4-1686-48ea-9cf7-f864338e8433 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.469915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 109/218] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:54.472717 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785903b-d10b-4e45-a8fb-5ed84629fa20 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.476138 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed25c80-41cb-4d48-972e-422636edd41f None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.476425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed25c80-41cb-4d48-972e-422636edd41f None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.476691 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed25c80-41cb-4d48-972e-422636edd41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.497936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-3ed25c80-41cb-4d48-972e-422636edd41f None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:54.499241 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3ed25c80-41cb-4d48-972e-422636edd41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:54.534424 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346f881-14cd-4e1f-bb6f-57b6cc5a378a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.535394 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346f881-14cd-4e1f-bb6f-57b6cc5a378a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.535676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346f881-14cd-4e1f-bb6f-57b6cc5a378a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.535950 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346f881-14cd-4e1f-bb6f-57b6cc5a378a admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.536999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346f881-14cd-4e1f-bb6f-57b6cc5a378a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:54.538254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346f881-14cd-4e1f-bb6f-57b6cc5a378a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:54.540016 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346f881-14cd-4e1f-bb6f-57b6cc5a378a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:54.551853 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 110/219] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:50:54 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:54.558020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ff1ae-e4b0-4fd8-ab71-a7c71b9cf5c7 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.558020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ff1ae-e4b0-4fd8-ab71-a7c71b9cf5c7 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.558020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ff1ae-e4b0-4fd8-ab71-a7c71b9cf5c7 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.558020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 111/220] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:54.558632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ff1ae-e4b0-4fd8-ab71-a7c71b9cf5c7 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.568450 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 110/221] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:54.569783 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f70ab0-3884-4c22-8015-8476d0a5e349 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.570131 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f70ab0-3884-4c22-8015-8476d0a5e349 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.570413 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f70ab0-3884-4c22-8015-8476d0a5e349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.578792 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ff1ae-e4b0-4fd8-ab71-a7c71b9cf5c7 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.586548 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416751b-c33b-4686-b55d-c0d0d616eab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.588182 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416751b-c33b-4686-b55d-c0d0d616eab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.588298 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-f8f70ab0-3884-4c22-8015-8476d0a5e349 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:54.588771 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416751b-c33b-4686-b55d-c0d0d616eab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.589240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416751b-c33b-4686-b55d-c0d0d616eab2 admin admin] PATH_INFO: `/v3/users/4085812f294c44f89f07cf2267011ffa` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.589444 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f8f70ab0-3884-4c22-8015-8476d0a5e349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:54.591054 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416751b-c33b-4686-b55d-c0d0d616eab2 admin admin] RBAC: Authorizing `identity:get_user(user_id=4085812f294c44f89f07cf2267011ffa)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:54.594385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416751b-c33b-4686-b55d-c0d0d616eab2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:54.596287 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 112/222] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:54 2021] GET /identity/v3/users/4085812f294c44f89f07cf2267011ffa => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:54.597770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 111/223] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:54.598921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416751b-c33b-4686-b55d-c0d0d616eab2 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.603015 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f70ab0-3884-4c22-8015-8476d0a5e349 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.611138 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416751b-c33b-4686-b55d-c0d0d616eab2 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.613344 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f70ab0-3884-4c22-8015-8476d0a5e349 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.616894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54686906-492f-4d8a-a789-f9f8675d4532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.618068 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03846aea-6bed-497e-9e2c-319a980382e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.618434 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54686906-492f-4d8a-a789-f9f8675d4532 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.618924 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54686906-492f-4d8a-a789-f9f8675d4532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.619026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03846aea-6bed-497e-9e2c-319a980382e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.619208 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03846aea-6bed-497e-9e2c-319a980382e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.619489 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03846aea-6bed-497e-9e2c-319a980382e2 admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.619866 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54686906-492f-4d8a-a789-f9f8675d4532 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.620801 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03846aea-6bed-497e-9e2c-319a980382e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:54.623480 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03846aea-6bed-497e-9e2c-319a980382e2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:54.625320 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 112/224] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:54 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:54.627563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03846aea-6bed-497e-9e2c-319a980382e2 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.633004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54686906-492f-4d8a-a789-f9f8675d4532 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:54.640008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03846aea-6bed-497e-9e2c-319a980382e2 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.640333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-54686906-492f-4d8a-a789-f9f8675d4532 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:50:54.641537 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 113/225] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:54 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:54.644894 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa17e2e-9131-4c40-830d-d2b9d754d843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.645707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa17e2e-9131-4c40-830d-d2b9d754d843 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.646025 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa17e2e-9131-4c40-830d-d2b9d754d843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.646290 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa17e2e-9131-4c40-830d-d2b9d754d843 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.647566 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa17e2e-9131-4c40-830d-d2b9d754d843 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:54.647693 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54686906-492f-4d8a-a789-f9f8675d4532 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.649423 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa17e2e-9131-4c40-830d-d2b9d754d843 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:54.651301 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 113/226] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:50:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:54.654806 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa17e2e-9131-4c40-830d-d2b9d754d843 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.662222 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54686906-492f-4d8a-a789-f9f8675d4532 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.665322 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa17e2e-9131-4c40-830d-d2b9d754d843 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.667150 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22363a-25bb-40a9-acee-837a0f7309f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.668029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22363a-25bb-40a9-acee-837a0f7309f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.668301 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22363a-25bb-40a9-acee-837a0f7309f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.668740 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22363a-25bb-40a9-acee-837a0f7309f3 admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0/users/4085812f294c44f89f07cf2267011ffa/roles/bcbedb9e465844d2a8baa6af3760e916` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.669746 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a236f3-7fa1-4c9e-ac40-d3f12780ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.670456 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a236f3-7fa1-4c9e-ac40-d3f12780ce2b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.670741 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a236f3-7fa1-4c9e-ac40-d3f12780ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.670967 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22363a-25bb-40a9-acee-837a0f7309f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec39c8c2a0a4950925dcf994f4875e0, user_id=4085812f294c44f89f07cf2267011ffa, role_id=bcbedb9e465844d2a8baa6af3760e916)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:54.671061 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a236f3-7fa1-4c9e-ac40-d3f12780ce2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.672353 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a236f3-7fa1-4c9e-ac40-d3f12780ce2b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:54.672694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a236f3-7fa1-4c9e-ac40-d3f12780ce2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:54.674220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22363a-25bb-40a9-acee-837a0f7309f3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:54.674317 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a236f3-7fa1-4c9e-ac40-d3f12780ce2b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:54.683789 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 114/227] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:50:54 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:54.684551 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a236f3-7fa1-4c9e-ac40-d3f12780ce2b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.691521 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 114/228] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:50:54 2021] PUT /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0/users/4085812f294c44f89f07cf2267011ffa/roles/bcbedb9e465844d2a8baa6af3760e916 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:50:54.694871 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22363a-25bb-40a9-acee-837a0f7309f3 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.700464 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a236f3-7fa1-4c9e-ac40-d3f12780ce2b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.770597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e0411-d1d9-4d1a-8036-a74a786a6fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.770833 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e0411-d1d9-4d1a-8036-a74a786a6fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.771137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e0411-d1d9-4d1a-8036-a74a786a6fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.771288 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e0411-d1d9-4d1a-8036-a74a786a6fd2 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.772011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e0411-d1d9-4d1a-8036-a74a786a6fd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:54.774194 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e0411-d1d9-4d1a-8036-a74a786a6fd2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:54.775923 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22363a-25bb-40a9-acee-837a0f7309f3 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.782250 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115f284-718c-4ff9-83fe-317ae8900c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.784676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115f284-718c-4ff9-83fe-317ae8900c65 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.785920 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115f284-718c-4ff9-83fe-317ae8900c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.786699 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115f284-718c-4ff9-83fe-317ae8900c65 admin admin] PATH_INFO: `/v3/users/f1a0972375444b6fac3cb17b90d85fb5` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.800894 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 115/229] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:50:54 2021] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:50:54.806963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115f284-718c-4ff9-83fe-317ae8900c65 admin admin] RBAC: Authorizing `identity:get_user(user_id=f1a0972375444b6fac3cb17b90d85fb5)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:54.809328 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115f284-718c-4ff9-83fe-317ae8900c65 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:54.811280 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 115/230] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:54 2021] GET /identity/v3/users/f1a0972375444b6fac3cb17b90d85fb5 => generated 297 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:54.818038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e0411-d1d9-4d1a-8036-a74a786a6fd2 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.829508 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e0411-d1d9-4d1a-8036-a74a786a6fd2 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.835012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b7b6a-3082-4f69-ad11-08961d7a98b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.835941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b7b6a-3082-4f69-ad11-08961d7a98b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.836378 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b7b6a-3082-4f69-ad11-08961d7a98b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.836841 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b7b6a-3082-4f69-ad11-08961d7a98b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.847014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b7b6a-3082-4f69-ad11-08961d7a98b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:54.849180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b7b6a-3082-4f69-ad11-08961d7a98b2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:54.859779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 116/231] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:54 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:50:54.866169 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115f284-718c-4ff9-83fe-317ae8900c65 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.877173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115f284-718c-4ff9-83fe-317ae8900c65 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.882449 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadd6af-06cb-4f62-a997-18bbb0a10891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.883368 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadd6af-06cb-4f62-a997-18bbb0a10891 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.883647 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadd6af-06cb-4f62-a997-18bbb0a10891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.883917 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadd6af-06cb-4f62-a997-18bbb0a10891 admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.885555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadd6af-06cb-4f62-a997-18bbb0a10891 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:54.887738 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadd6af-06cb-4f62-a997-18bbb0a10891 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:54.889597 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 116/232] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:54 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:54.897027 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b7b6a-3082-4f69-ad11-08961d7a98b2 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:54.907495 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b7b6a-3082-4f69-ad11-08961d7a98b2 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:54.912397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70faf483-d2ba-42bf-b306-9d56c725072e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:54.913174 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faf483-d2ba-42bf-b306-9d56c725072e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:54.913461 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faf483-d2ba-42bf-b306-9d56c725072e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:54.913740 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faf483-d2ba-42bf-b306-9d56c725072e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:54.914648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70faf483-d2ba-42bf-b306-9d56c725072e admin admin] RBAC: Adding query filter params (role.id=69edf382652b443c97811919233bb991, scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0, user.id=f1a0972375444b6fac3cb17b90d85fb5) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:54.915033 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70faf483-d2ba-42bf-b306-9d56c725072e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:54.917003 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70faf483-d2ba-42bf-b306-9d56c725072e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:54.923792 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 117/233] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:50:54 2021] GET /identity/v3/role_assignments?user.id=f1a0972375444b6fac3cb17b90d85fb5&scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0&role.id=69edf382652b443c97811919233bb991 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:57.124047 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b7763-b507-43c3-95b5-7a573957aec7 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.124589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b7763-b507-43c3-95b5-7a573957aec7 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.124686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b7763-b507-43c3-95b5-7a573957aec7 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.126473 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 117/234] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:57.132480 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5b15-472c-46ea-84a3-d7441640208e None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.132892 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5b15-472c-46ea-84a3-d7441640208e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.133053 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5b15-472c-46ea-84a3-d7441640208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.156357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-eecb5b15-472c-46ea-84a3-d7441640208e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:57.157562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-eecb5b15-472c-46ea-84a3-d7441640208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:57.168314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 118/235] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:57.192479 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b7763-b507-43c3-95b5-7a573957aec7 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:57.219421 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b7763-b507-43c3-95b5-7a573957aec7 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:57.224204 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05035114-5dc1-49e5-9233-319a05c2170c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:57.225019 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035114-5dc1-49e5-9233-319a05c2170c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.225299 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035114-5dc1-49e5-9233-319a05c2170c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.225570 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035114-5dc1-49e5-9233-319a05c2170c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.247645 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05035114-5dc1-49e5-9233-319a05c2170c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:57.254808 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-05035114-5dc1-49e5-9233-319a05c2170c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:50:57.256079 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 118/236] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:50:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:57.262816 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb5b15-472c-46ea-84a3-d7441640208e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:57.272864 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb5b15-472c-46ea-84a3-d7441640208e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:57.282656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd40878-a04b-46e3-8875-0e6bc51ca7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:57.283329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd40878-a04b-46e3-8875-0e6bc51ca7ac admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.283608 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd40878-a04b-46e3-8875-0e6bc51ca7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.283882 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd40878-a04b-46e3-8875-0e6bc51ca7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.284651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd40878-a04b-46e3-8875-0e6bc51ca7ac admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:57.284955 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd40878-a04b-46e3-8875-0e6bc51ca7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:57.286579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd40878-a04b-46e3-8875-0e6bc51ca7ac admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:57.295721 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 119/237] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:57.301950 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05035114-5dc1-49e5-9233-319a05c2170c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:57.312456 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05035114-5dc1-49e5-9233-319a05c2170c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:57.322643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4f748-35ee-405d-8b54-7da3d9f02d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:57.323510 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4f748-35ee-405d-8b54-7da3d9f02d08 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.323785 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4f748-35ee-405d-8b54-7da3d9f02d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.324126 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4f748-35ee-405d-8b54-7da3d9f02d08 admin admin] PATH_INFO: `/v3/users/4085812f294c44f89f07cf2267011ffa` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.326766 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4f748-35ee-405d-8b54-7da3d9f02d08 admin admin] RBAC: Authorizing `identity:get_user(user_id=4085812f294c44f89f07cf2267011ffa)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:57.330102 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4f748-35ee-405d-8b54-7da3d9f02d08 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:57.332109 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 119/238] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:57 2021] GET /identity/v3/users/4085812f294c44f89f07cf2267011ffa => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:57.338339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd40878-a04b-46e3-8875-0e6bc51ca7ac admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:57.355154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd40878-a04b-46e3-8875-0e6bc51ca7ac admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:57.360471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08032e95-7f80-44a7-a9b8-0515b68488ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:57.361242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08032e95-7f80-44a7-a9b8-0515b68488ce admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.361526 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08032e95-7f80-44a7-a9b8-0515b68488ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.361803 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08032e95-7f80-44a7-a9b8-0515b68488ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.370837 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08032e95-7f80-44a7-a9b8-0515b68488ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:57.372732 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08032e95-7f80-44a7-a9b8-0515b68488ce admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:57.382494 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 120/239] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:50:57.388771 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4f748-35ee-405d-8b54-7da3d9f02d08 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:57.399162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4f748-35ee-405d-8b54-7da3d9f02d08 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:57.409180 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6f731-ae65-43ea-abc5-41488352c8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:57.410323 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6f731-ae65-43ea-abc5-41488352c8bd admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.410801 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6f731-ae65-43ea-abc5-41488352c8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.411285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6f731-ae65-43ea-abc5-41488352c8bd admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.412692 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6f731-ae65-43ea-abc5-41488352c8bd admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:57.414954 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6f731-ae65-43ea-abc5-41488352c8bd admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:57.416824 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 120/240] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:57 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:57.423193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08032e95-7f80-44a7-a9b8-0515b68488ce admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:57.432535 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08032e95-7f80-44a7-a9b8-0515b68488ce admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:57.441907 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83b9a9-1fc4-40be-aae0-c19e09d0ded9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:57.442836 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83b9a9-1fc4-40be-aae0-c19e09d0ded9 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.443312 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83b9a9-1fc4-40be-aae0-c19e09d0ded9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.443795 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83b9a9-1fc4-40be-aae0-c19e09d0ded9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.444830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83b9a9-1fc4-40be-aae0-c19e09d0ded9 admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0, user.id=4085812f294c44f89f07cf2267011ffa) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:57.445335 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83b9a9-1fc4-40be-aae0-c19e09d0ded9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:57.447391 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83b9a9-1fc4-40be-aae0-c19e09d0ded9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:57.454419 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 121/241] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:50:57 2021] GET /identity/v3/role_assignments?user.id=4085812f294c44f89f07cf2267011ffa&scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:57.674458 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb967e8c-4138-4483-b572-04cf81433305 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.675053 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb967e8c-4138-4483-b572-04cf81433305 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.675534 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb967e8c-4138-4483-b572-04cf81433305 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.677766 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 121/242] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:57.684260 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a662ad5-43b6-4a8c-a1cb-70b658a0b185 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.684876 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a662ad5-43b6-4a8c-a1cb-70b658a0b185 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.685348 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a662ad5-43b6-4a8c-a1cb-70b658a0b185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.711719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-9a662ad5-43b6-4a8c-a1cb-70b658a0b185 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:57.713288 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-9a662ad5-43b6-4a8c-a1cb-70b658a0b185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:57.718307 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c01d3-57df-455f-a8c1-f4f4281f54bc None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.718895 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c01d3-57df-455f-a8c1-f4f4281f54bc None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.719367 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c01d3-57df-455f-a8c1-f4f4281f54bc None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.721702 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 122/243] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:57.727753 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df277ed-6fd7-45ce-a7ca-d75c229b15e1 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.728046 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df277ed-6fd7-45ce-a7ca-d75c229b15e1 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.728298 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df277ed-6fd7-45ce-a7ca-d75c229b15e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.745555 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 122/244] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:57.759259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-6df277ed-6fd7-45ce-a7ca-d75c229b15e1 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:57.760790 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6df277ed-6fd7-45ce-a7ca-d75c229b15e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:57.771907 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a662ad5-43b6-4a8c-a1cb-70b658a0b185 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:57.772996 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 123/245] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:57.782405 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a662ad5-43b6-4a8c-a1cb-70b658a0b185 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:57.790671 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3670b54-82ac-458b-b63d-213f28a98adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:57.791526 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3670b54-82ac-458b-b63d-213f28a98adf admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.791810 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3670b54-82ac-458b-b63d-213f28a98adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.792086 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3670b54-82ac-458b-b63d-213f28a98adf admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.799297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df277ed-6fd7-45ce-a7ca-d75c229b15e1 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:57.803285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3670b54-82ac-458b-b63d-213f28a98adf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:57.809276 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df277ed-6fd7-45ce-a7ca-d75c229b15e1 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:57.815580 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-a3670b54-82ac-458b-b63d-213f28a98adf admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:50:57.815580 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 123/246] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:57 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:50:57.819748 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2003d82-48dd-4c43-9284-648b33ead198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:57.820563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2003d82-48dd-4c43-9284-648b33ead198 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.820896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2003d82-48dd-4c43-9284-648b33ead198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.821177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2003d82-48dd-4c43-9284-648b33ead198 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.822294 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3670b54-82ac-458b-b63d-213f28a98adf admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:57.832983 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3670b54-82ac-458b-b63d-213f28a98adf admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:57.839006 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2003d82-48dd-4c43-9284-648b33ead198 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:57.844346 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8364ca-0167-4459-8435-dd818b639268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:57.845178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8364ca-0167-4459-8435-dd818b639268 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.845597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8364ca-0167-4459-8435-dd818b639268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.846036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8364ca-0167-4459-8435-dd818b639268 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.846941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8364ca-0167-4459-8435-dd818b639268 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:57.847413 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8364ca-0167-4459-8435-dd818b639268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:57.848161 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-c2003d82-48dd-4c43-9284-648b33ead198 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 02:50:57.849425 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 124/247] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:50:57 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:57.849596 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8364ca-0167-4459-8435-dd818b639268 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:57.859514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2003d82-48dd-4c43-9284-648b33ead198 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:57.860597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 124/248] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:50:57 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:57.866618 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8364ca-0167-4459-8435-dd818b639268 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:57.872032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2003d82-48dd-4c43-9284-648b33ead198 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:57.877551 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8364ca-0167-4459-8435-dd818b639268 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:57.880303 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2dbfb-ea10-4af9-9b38-c5ad531251ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:57.880949 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2dbfb-ea10-4af9-9b38-c5ad531251ce admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.881240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2dbfb-ea10-4af9-9b38-c5ad531251ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.881519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2dbfb-ea10-4af9-9b38-c5ad531251ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.882442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2dbfb-ea10-4af9-9b38-c5ad531251ce admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:57.882848 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2dbfb-ea10-4af9-9b38-c5ad531251ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:57.884781 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650e5d8-2a34-4dda-92cc-babe28b17665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:57.885216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2dbfb-ea10-4af9-9b38-c5ad531251ce admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:57.886348 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650e5d8-2a34-4dda-92cc-babe28b17665 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.886857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650e5d8-2a34-4dda-92cc-babe28b17665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.887314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650e5d8-2a34-4dda-92cc-babe28b17665 admin admin] PATH_INFO: `/v3/users/f1a0972375444b6fac3cb17b90d85fb5` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.891779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650e5d8-2a34-4dda-92cc-babe28b17665 admin admin] RBAC: Authorizing `identity:get_user(user_id=f1a0972375444b6fac3cb17b90d85fb5)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:57.894236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650e5d8-2a34-4dda-92cc-babe28b17665 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:57.896150 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 125/249] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:57 2021] GET /identity/v3/users/f1a0972375444b6fac3cb17b90d85fb5 => generated 297 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:57.897651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec3b80-6846-41e4-897e-e143aebf9373 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.898149 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec3b80-6846-41e4-897e-e143aebf9373 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.898382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 125/250] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:50:57 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:57.898832 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec3b80-6846-41e4-897e-e143aebf9373 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.900814 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 126/251] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:57.904880 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2dbfb-ea10-4af9-9b38-c5ad531251ce admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:57.905133 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec3b80-6846-41e4-897e-e143aebf9373 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:57.916069 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2dbfb-ea10-4af9-9b38-c5ad531251ce admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:57.920523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec3b80-6846-41e4-897e-e143aebf9373 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:57.923675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39afe1-18eb-4508-8d64-08c6b296f0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:57.925085 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39afe1-18eb-4508-8d64-08c6b296f0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.925577 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39afe1-18eb-4508-8d64-08c6b296f0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.925859 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39afe1-18eb-4508-8d64-08c6b296f0a2 admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.926855 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aaabe-da88-4c5a-9cee-8e1a52988a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:57.927205 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39afe1-18eb-4508-8d64-08c6b296f0a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:57.928531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aaabe-da88-4c5a-9cee-8e1a52988a98 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.928922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aaabe-da88-4c5a-9cee-8e1a52988a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.928922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aaabe-da88-4c5a-9cee-8e1a52988a98 admin admin] PATH_INFO: `/v3/users/4085812f294c44f89f07cf2267011ffa` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.929299 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39afe1-18eb-4508-8d64-08c6b296f0a2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:57.930897 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aaabe-da88-4c5a-9cee-8e1a52988a98 admin admin] RBAC: Authorizing `identity:get_user(user_id=4085812f294c44f89f07cf2267011ffa)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:57.931374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 126/252] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:57 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:57.932432 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b49c6b-b727-4a1b-a4ee-f333ea34ec77 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.932713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b49c6b-b727-4a1b-a4ee-f333ea34ec77 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.932987 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b49c6b-b727-4a1b-a4ee-f333ea34ec77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.939973 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aaabe-da88-4c5a-9cee-8e1a52988a98 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:57.939973 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 127/253] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:57 2021] GET /identity/v3/users/4085812f294c44f89f07cf2267011ffa => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:57.940674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aaabe-da88-4c5a-9cee-8e1a52988a98 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:57.950105 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aaabe-da88-4c5a-9cee-8e1a52988a98 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:57.954828 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d763cd-6f80-4c05-bb7c-4dcf9b1ad48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:57.955309 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-48b49c6b-b727-4a1b-a4ee-f333ea34ec77 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:57.956092 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d763cd-6f80-4c05-bb7c-4dcf9b1ad48c admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:57.956437 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d763cd-6f80-4c05-bb7c-4dcf9b1ad48c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:57.956533 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-48b49c6b-b727-4a1b-a4ee-f333ea34ec77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:57.956879 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d763cd-6f80-4c05-bb7c-4dcf9b1ad48c admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0/users/f1a0972375444b6fac3cb17b90d85fb5/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:57.958988 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d763cd-6f80-4c05-bb7c-4dcf9b1ad48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec39c8c2a0a4950925dcf994f4875e0, user_id=f1a0972375444b6fac3cb17b90d85fb5, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:57.961788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d763cd-6f80-4c05-bb7c-4dcf9b1ad48c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:57.967400 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 127/254] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:50:57.967400 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b49c6b-b727-4a1b-a4ee-f333ea34ec77 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:57.980832 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b49c6b-b727-4a1b-a4ee-f333ea34ec77 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:57.983287 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 128/255] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:50:57 2021] PUT /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0/users/f1a0972375444b6fac3cb17b90d85fb5/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:50:58.009248 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d763cd-6f80-4c05-bb7c-4dcf9b1ad48c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:58.057561 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed2642-f8f8-4f8f-b483-8a5f67e192a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:58.059055 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed2642-f8f8-4f8f-b483-8a5f67e192a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:58.059513 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed2642-f8f8-4f8f-b483-8a5f67e192a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:58.059932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed2642-f8f8-4f8f-b483-8a5f67e192a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:58.072494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed2642-f8f8-4f8f-b483-8a5f67e192a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:58.075540 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed2642-f8f8-4f8f-b483-8a5f67e192a4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:58.089601 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d763cd-6f80-4c05-bb7c-4dcf9b1ad48c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:58.094052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 128/256] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:50:58.098108 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed2642-f8f8-4f8f-b483-8a5f67e192a4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:58.098470 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd6514-638c-4266-89cf-b7450a79897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:58.099609 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd6514-638c-4266-89cf-b7450a79897b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:58.100079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd6514-638c-4266-89cf-b7450a79897b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:58.100573 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd6514-638c-4266-89cf-b7450a79897b admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:58.107907 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed2642-f8f8-4f8f-b483-8a5f67e192a4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:58.113387 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b89a3-7d91-417e-a9c2-b82c181e0d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:58.114518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b89a3-7d91-417e-a9c2-b82c181e0d8d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:58.114930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b89a3-7d91-417e-a9c2-b82c181e0d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:58.115315 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b89a3-7d91-417e-a9c2-b82c181e0d8d admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:58.115848 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd6514-638c-4266-89cf-b7450a79897b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:50:58.116860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b89a3-7d91-417e-a9c2-b82c181e0d8d admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:58.119442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b89a3-7d91-417e-a9c2-b82c181e0d8d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:58.121649 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 129/257] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:58 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:58.125020 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-9ebd6514-638c-4266-89cf-b7450a79897b admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 02:50:58.126503 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 129/258] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:50:58 2021] GET /identity/v3/roles/reader => generated 84 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:50:58.131571 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b89a3-7d91-417e-a9c2-b82c181e0d8d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:58.135277 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd6514-638c-4266-89cf-b7450a79897b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:58.145287 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b89a3-7d91-417e-a9c2-b82c181e0d8d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:58.145474 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd6514-638c-4266-89cf-b7450a79897b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:58.150711 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbce488-cd64-4ae6-9ba4-1abd887d4553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:58.151343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82079de-83e2-480d-8f8a-9232882fa96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:58.151464 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbce488-cd64-4ae6-9ba4-1abd887d4553 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:58.151651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbce488-cd64-4ae6-9ba4-1abd887d4553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:58.151919 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbce488-cd64-4ae6-9ba4-1abd887d4553 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:58.152025 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82079de-83e2-480d-8f8a-9232882fa96e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:58.152293 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82079de-83e2-480d-8f8a-9232882fa96e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:58.152563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82079de-83e2-480d-8f8a-9232882fa96e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:58.152720 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbce488-cd64-4ae6-9ba4-1abd887d4553 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:58.152996 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbce488-cd64-4ae6-9ba4-1abd887d4553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:58.153406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82079de-83e2-480d-8f8a-9232882fa96e admin admin] RBAC: Adding query filter params (role.id=bcbedb9e465844d2a8baa6af3760e916, scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0, user.id=4085812f294c44f89f07cf2267011ffa) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:58.153716 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82079de-83e2-480d-8f8a-9232882fa96e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:58.154679 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbce488-cd64-4ae6-9ba4-1abd887d4553 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:58.155648 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82079de-83e2-480d-8f8a-9232882fa96e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:58.162034 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 130/259] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:50:58 2021] GET /identity/v3/role_assignments?user.id=4085812f294c44f89f07cf2267011ffa&scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0&role.id=bcbedb9e465844d2a8baa6af3760e916 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:58.163204 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fe930-9930-419b-b9d0-c28034bdff7c None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:58.163490 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fe930-9930-419b-b9d0-c28034bdff7c None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:58.166043 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 130/260] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:50:58 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:58.170342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fe930-9930-419b-b9d0-c28034bdff7c None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:58.170791 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbce488-cd64-4ae6-9ba4-1abd887d4553 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:58.173439 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 131/261] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:50:58 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:50:58.180282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bf164-cbc6-46a4-8821-bfb65c6971a0 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:58.180640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bf164-cbc6-46a4-8821-bfb65c6971a0 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:58.181018 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bf164-cbc6-46a4-8821-bfb65c6971a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:58.188414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbce488-cd64-4ae6-9ba4-1abd887d4553 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:58.193784 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a9fce-a8c1-48cb-b5be-010babb5f795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:58.195061 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a9fce-a8c1-48cb-b5be-010babb5f795 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:58.195495 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a9fce-a8c1-48cb-b5be-010babb5f795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:58.195910 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a9fce-a8c1-48cb-b5be-010babb5f795 admin admin] PATH_INFO: `/v3/users/0028e90bec894b81bfaadbc896c4ec7b` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:58.212329 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-9a7bf164-cbc6-46a4-8821-bfb65c6971a0 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:50:58.213964 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9a7bf164-cbc6-46a4-8821-bfb65c6971a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:50:58.217614 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a9fce-a8c1-48cb-b5be-010babb5f795 admin admin] RBAC: Authorizing `identity:get_user(user_id=0028e90bec894b81bfaadbc896c4ec7b)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:58.220338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a9fce-a8c1-48cb-b5be-010babb5f795 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:58.222250 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 131/262] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:50:58 2021] GET /identity/v3/users/0028e90bec894b81bfaadbc896c4ec7b => generated 297 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:50:58.223384 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 132/263] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:50:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:50:58.229086 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a9fce-a8c1-48cb-b5be-010babb5f795 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:58.241590 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a9fce-a8c1-48cb-b5be-010babb5f795 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:58.246228 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd8e09-28b7-401b-aa48-74d363196200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:58.246897 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd8e09-28b7-401b-aa48-74d363196200 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:58.247177 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd8e09-28b7-401b-aa48-74d363196200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:58.247448 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd8e09-28b7-401b-aa48-74d363196200 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:58.254955 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bf164-cbc6-46a4-8821-bfb65c6971a0 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:58.256973 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd8e09-28b7-401b-aa48-74d363196200 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:58.258817 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd8e09-28b7-401b-aa48-74d363196200 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:58.264738 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bf164-cbc6-46a4-8821-bfb65c6971a0 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:58.269394 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4de41-7483-44d6-9f54-c859f6446bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:58.270374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 132/264] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:50:58 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:50:58.270485 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4de41-7483-44d6-9f54-c859f6446bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:58.270485 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4de41-7483-44d6-9f54-c859f6446bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:58.270748 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4de41-7483-44d6-9f54-c859f6446bc9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:58.272018 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4de41-7483-44d6-9f54-c859f6446bc9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:58.273735 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4de41-7483-44d6-9f54-c859f6446bc9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:58.275619 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 133/265] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:50:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:58.277233 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd8e09-28b7-401b-aa48-74d363196200 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:58.281890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4de41-7483-44d6-9f54-c859f6446bc9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:58.287648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd8e09-28b7-401b-aa48-74d363196200 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:58.291833 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4de41-7483-44d6-9f54-c859f6446bc9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:58.292255 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69911ccd-5397-4bd4-ac37-f775c634e0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:58.293165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69911ccd-5397-4bd4-ac37-f775c634e0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:58.293447 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69911ccd-5397-4bd4-ac37-f775c634e0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:58.293719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69911ccd-5397-4bd4-ac37-f775c634e0c2 admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:58.295108 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69911ccd-5397-4bd4-ac37-f775c634e0c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:58.296344 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9877ed-b040-40ea-aab1-f7a2a475ef55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:58.297564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9877ed-b040-40ea-aab1-f7a2a475ef55 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:58.297915 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9877ed-b040-40ea-aab1-f7a2a475ef55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:58.298042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69911ccd-5397-4bd4-ac37-f775c634e0c2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:58.298328 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9877ed-b040-40ea-aab1-f7a2a475ef55 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:58.299130 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9877ed-b040-40ea-aab1-f7a2a475ef55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:58.299849 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 133/266] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:50:58 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:50:58.301382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9877ed-b040-40ea-aab1-f7a2a475ef55 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:58.306464 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69911ccd-5397-4bd4-ac37-f775c634e0c2 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:50:58.316979 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69911ccd-5397-4bd4-ac37-f775c634e0c2 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:50:58.330018 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2aa6bf-cc2a-48a8-9ffe-9ae812e4f0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:50:58.330018 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aa6bf-cc2a-48a8-9ffe-9ae812e4f0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:50:58.330018 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aa6bf-cc2a-48a8-9ffe-9ae812e4f0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:50:58.330018 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aa6bf-cc2a-48a8-9ffe-9ae812e4f0b5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:50:58.330388 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2aa6bf-cc2a-48a8-9ffe-9ae812e4f0b5 admin admin] RBAC: Adding query filter params (role.id=1298b7f1875942e5baa6f96892b35aa9, scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0, user.id=0028e90bec894b81bfaadbc896c4ec7b) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:50:58.330388 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2aa6bf-cc2a-48a8-9ffe-9ae812e4f0b5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:50:58.330388 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2aa6bf-cc2a-48a8-9ffe-9ae812e4f0b5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:50:58.332701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 134/267] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:50:58 2021] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 02:50:58.333487 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 134/268] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:50:58 2021] GET /identity/v3/role_assignments?user.id=0028e90bec894b81bfaadbc896c4ec7b&scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0&role.id=1298b7f1875942e5baa6f96892b35aa9 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:00.571835 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0a063-4af4-438a-b386-1e09af8ad66e None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.572355 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0a063-4af4-438a-b386-1e09af8ad66e None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.572355 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0a063-4af4-438a-b386-1e09af8ad66e None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.574418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 135/269] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:00.580842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aae463-7625-472e-af84-a2a75f6f8266 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.581242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aae463-7625-472e-af84-a2a75f6f8266 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.581409 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aae463-7625-472e-af84-a2a75f6f8266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.599276 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-e5aae463-7625-472e-af84-a2a75f6f8266 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:00.600464 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e5aae463-7625-472e-af84-a2a75f6f8266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:00.608123 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 135/270] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:51:00.633307 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0a063-4af4-438a-b386-1e09af8ad66e None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:00.646826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0a063-4af4-438a-b386-1e09af8ad66e None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:00.651199 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691f9ab-7b20-4358-ab64-de6aff67d684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:00.651976 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691f9ab-7b20-4358-ab64-de6aff67d684 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.652255 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691f9ab-7b20-4358-ab64-de6aff67d684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.652527 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691f9ab-7b20-4358-ab64-de6aff67d684 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.663304 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691f9ab-7b20-4358-ab64-de6aff67d684 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:00.670118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-f691f9ab-7b20-4358-ab64-de6aff67d684 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:51:00.671334 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 136/271] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:00.677530 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aae463-7625-472e-af84-a2a75f6f8266 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:00.686580 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aae463-7625-472e-af84-a2a75f6f8266 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:00.691607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f664f2-bfc6-4eaa-a64d-8ccc340ae761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:00.692258 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f664f2-bfc6-4eaa-a64d-8ccc340ae761 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.692536 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f664f2-bfc6-4eaa-a64d-8ccc340ae761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.692807 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f664f2-bfc6-4eaa-a64d-8ccc340ae761 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.693569 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f664f2-bfc6-4eaa-a64d-8ccc340ae761 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:00.693880 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f664f2-bfc6-4eaa-a64d-8ccc340ae761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:00.695516 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f664f2-bfc6-4eaa-a64d-8ccc340ae761 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:00.705051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 136/272] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:51:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:00.710898 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691f9ab-7b20-4358-ab64-de6aff67d684 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:00.721226 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691f9ab-7b20-4358-ab64-de6aff67d684 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:00.725607 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a535b-a0e4-47ae-9b56-4b5a0bb2e46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:00.726485 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a535b-a0e4-47ae-9b56-4b5a0bb2e46f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.726765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a535b-a0e4-47ae-9b56-4b5a0bb2e46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.727036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a535b-a0e4-47ae-9b56-4b5a0bb2e46f admin admin] PATH_INFO: `/v3/users/f1a0972375444b6fac3cb17b90d85fb5` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.728243 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a535b-a0e4-47ae-9b56-4b5a0bb2e46f admin admin] RBAC: Authorizing `identity:get_user(user_id=f1a0972375444b6fac3cb17b90d85fb5)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:00.730388 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a535b-a0e4-47ae-9b56-4b5a0bb2e46f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:00.732271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 137/273] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:51:00 2021] GET /identity/v3/users/f1a0972375444b6fac3cb17b90d85fb5 => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:00.738238 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f664f2-bfc6-4eaa-a64d-8ccc340ae761 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:00.748086 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f664f2-bfc6-4eaa-a64d-8ccc340ae761 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:00.753019 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d55586-f7d0-463e-9b21-0d9d1bb75b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:00.753658 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d55586-f7d0-463e-9b21-0d9d1bb75b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.753938 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d55586-f7d0-463e-9b21-0d9d1bb75b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.754242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d55586-f7d0-463e-9b21-0d9d1bb75b86 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.762745 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d55586-f7d0-463e-9b21-0d9d1bb75b86 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:00.764640 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d55586-f7d0-463e-9b21-0d9d1bb75b86 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:00.774125 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 137/274] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:00.779784 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609b81e-f77e-4aaf-919e-5ad41453fd28 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.780074 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609b81e-f77e-4aaf-919e-5ad41453fd28 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.780348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609b81e-f77e-4aaf-919e-5ad41453fd28 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.782675 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d55586-f7d0-463e-9b21-0d9d1bb75b86 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:00.782800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 138/275] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:51:00.791630 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d55586-f7d0-463e-9b21-0d9d1bb75b86 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:00.791768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab48677-e8e7-4696-9742-9fd0716678d8 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.792101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab48677-e8e7-4696-9742-9fd0716678d8 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.792446 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab48677-e8e7-4696-9742-9fd0716678d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.796725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cb497-92d1-49d6-ac3f-1c9a20424d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:00.797730 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cb497-92d1-49d6-ac3f-1c9a20424d9e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.798193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cb497-92d1-49d6-ac3f-1c9a20424d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.798629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cb497-92d1-49d6-ac3f-1c9a20424d9e admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.799998 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370cb497-92d1-49d6-ac3f-1c9a20424d9e admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:00.802227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370cb497-92d1-49d6-ac3f-1c9a20424d9e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:00.809311 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 138/276] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:00 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:00.810668 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cb497-92d1-49d6-ac3f-1c9a20424d9e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:00.812638 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-0ab48677-e8e7-4696-9742-9fd0716678d8 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:00.813908 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0ab48677-e8e7-4696-9742-9fd0716678d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:00.821301 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cb497-92d1-49d6-ac3f-1c9a20424d9e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:00.822024 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 139/277] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:51:00.829492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa580b5b-0b3b-4536-8de9-c4cd7b3eb2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:00.830392 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa580b5b-0b3b-4536-8de9-c4cd7b3eb2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.830856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa580b5b-0b3b-4536-8de9-c4cd7b3eb2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.831310 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa580b5b-0b3b-4536-8de9-c4cd7b3eb2e7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.832318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa580b5b-0b3b-4536-8de9-c4cd7b3eb2e7 admin admin] RBAC: Adding query filter params (role.id=69edf382652b443c97811919233bb991, scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0, user.id=f1a0972375444b6fac3cb17b90d85fb5) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:00.832813 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa580b5b-0b3b-4536-8de9-c4cd7b3eb2e7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:00.834855 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa580b5b-0b3b-4536-8de9-c4cd7b3eb2e7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:00.841126 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 139/278] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:00 2021] GET /identity/v3/role_assignments?user.id=f1a0972375444b6fac3cb17b90d85fb5&scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0&role.id=69edf382652b443c97811919233bb991 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:00.846758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab48677-e8e7-4696-9742-9fd0716678d8 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:00.856583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab48677-e8e7-4696-9742-9fd0716678d8 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:00.861968 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe20c05-dcf2-4f49-b743-afe581361046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:00.862918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe20c05-dcf2-4f49-b743-afe581361046 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.863270 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe20c05-dcf2-4f49-b743-afe581361046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.863610 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe20c05-dcf2-4f49-b743-afe581361046 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.876796 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe20c05-dcf2-4f49-b743-afe581361046 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:00.884220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-5fe20c05-dcf2-4f49-b743-afe581361046 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 02:51:00.886216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 140/279] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:00 2021] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:00.891162 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30271db8-8f5f-492e-b9f8-a25c75c4d60e None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.891766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30271db8-8f5f-492e-b9f8-a25c75c4d60e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.892118 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30271db8-8f5f-492e-b9f8-a25c75c4d60e None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.892319 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe20c05-dcf2-4f49-b743-afe581361046 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:00.894211 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 140/280] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:00.899946 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f8dba-ab4d-431e-9c5a-173ba866e348 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.900236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f8dba-ab4d-431e-9c5a-173ba866e348 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.900517 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f8dba-ab4d-431e-9c5a-173ba866e348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.906366 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe20c05-dcf2-4f49-b743-afe581361046 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:00.911417 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e94ec-1147-45c3-99f4-8ff448b4f0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:00.912510 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e94ec-1147-45c3-99f4-8ff448b4f0fc admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.913015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e94ec-1147-45c3-99f4-8ff448b4f0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.913535 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e94ec-1147-45c3-99f4-8ff448b4f0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.914572 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e94ec-1147-45c3-99f4-8ff448b4f0fc admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:00.915139 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e94ec-1147-45c3-99f4-8ff448b4f0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:00.917137 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e94ec-1147-45c3-99f4-8ff448b4f0fc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:00.920390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-f29f8dba-ab4d-431e-9c5a-173ba866e348 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:00.922221 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f29f8dba-ab4d-431e-9c5a-173ba866e348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:00.930231 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 141/281] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:51:00 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:00.937647 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e94ec-1147-45c3-99f4-8ff448b4f0fc admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:00.940314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 141/282] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:51:00.949473 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e94ec-1147-45c3-99f4-8ff448b4f0fc admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:00.954679 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1a205-2e2b-46d8-844c-d4f09f284353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:00.955979 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1a205-2e2b-46d8-844c-d4f09f284353 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.956461 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1a205-2e2b-46d8-844c-d4f09f284353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.956963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1a205-2e2b-46d8-844c-d4f09f284353 admin admin] PATH_INFO: `/v3/users/0028e90bec894b81bfaadbc896c4ec7b` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.958500 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1a205-2e2b-46d8-844c-d4f09f284353 admin admin] RBAC: Authorizing `identity:get_user(user_id=0028e90bec894b81bfaadbc896c4ec7b)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:00.960896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1a205-2e2b-46d8-844c-d4f09f284353 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:00.962876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 142/283] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:51:00 2021] GET /identity/v3/users/0028e90bec894b81bfaadbc896c4ec7b => generated 297 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:00.967172 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f8dba-ab4d-431e-9c5a-173ba866e348 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:00.969306 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1a205-2e2b-46d8-844c-d4f09f284353 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:00.977487 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f8dba-ab4d-431e-9c5a-173ba866e348 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:00.980246 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1a205-2e2b-46d8-844c-d4f09f284353 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:00.982568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a27929-e72b-40cd-a6d4-15680383de94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:00.983559 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a27929-e72b-40cd-a6d4-15680383de94 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.984553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a27929-e72b-40cd-a6d4-15680383de94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.984945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a27929-e72b-40cd-a6d4-15680383de94 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.986720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d23f3-e4b3-4b1d-913a-747bf863c5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:00.987800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d23f3-e4b3-4b1d-913a-747bf863c5bf admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:00.988226 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d23f3-e4b3-4b1d-913a-747bf863c5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:00.988639 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d23f3-e4b3-4b1d-913a-747bf863c5bf admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:00.990121 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d23f3-e4b3-4b1d-913a-747bf863c5bf admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:00.992373 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d23f3-e4b3-4b1d-913a-747bf863c5bf admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:00.994645 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 143/284] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:00 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:00.999944 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a27929-e72b-40cd-a6d4-15680383de94 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:01.001637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d23f3-e4b3-4b1d-913a-747bf863c5bf admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:01.007712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-67a27929-e72b-40cd-a6d4-15680383de94 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:51:01.012421 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d23f3-e4b3-4b1d-913a-747bf863c5bf admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:01.014848 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 142/285] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:01.016347 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a27929-e72b-40cd-a6d4-15680383de94 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:01.018222 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cd70e-11e8-49d7-a3dd-6c4ced40fe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:01.019374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cd70e-11e8-49d7-a3dd-6c4ced40fe1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:01.019857 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cd70e-11e8-49d7-a3dd-6c4ced40fe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:01.020372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cd70e-11e8-49d7-a3dd-6c4ced40fe1a admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0/users/0028e90bec894b81bfaadbc896c4ec7b/roles/1298b7f1875942e5baa6f96892b35aa9` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:01.022712 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cd70e-11e8-49d7-a3dd-6c4ced40fe1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec39c8c2a0a4950925dcf994f4875e0, user_id=0028e90bec894b81bfaadbc896c4ec7b, role_id=1298b7f1875942e5baa6f96892b35aa9)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:01.025610 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cd70e-11e8-49d7-a3dd-6c4ced40fe1a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:01.026931 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a27929-e72b-40cd-a6d4-15680383de94 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:01.032332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d140bf6-2066-4593-bfbc-c1917330a8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:01.034215 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d140bf6-2066-4593-bfbc-c1917330a8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:01.034329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d140bf6-2066-4593-bfbc-c1917330a8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:01.034609 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d140bf6-2066-4593-bfbc-c1917330a8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:01.035460 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d140bf6-2066-4593-bfbc-c1917330a8a4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:01.035777 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d140bf6-2066-4593-bfbc-c1917330a8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:01.037433 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d140bf6-2066-4593-bfbc-c1917330a8a4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:01.041474 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 144/286] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:51:01 2021] PUT /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0/users/0028e90bec894b81bfaadbc896c4ec7b/roles/1298b7f1875942e5baa6f96892b35aa9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:51:01.043095 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e7ee5-204a-4e36-804d-298f03973cb8 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:01.043560 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e7ee5-204a-4e36-804d-298f03973cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:01.044028 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e7ee5-204a-4e36-804d-298f03973cb8 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:01.051578 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 145/288] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:01 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:01.053395 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10c394-a41f-4bae-ad27-14ad997c8b20 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:01.053525 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 143/288] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:51:01 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:01.054095 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10c394-a41f-4bae-ad27-14ad997c8b20 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:01.054552 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10c394-a41f-4bae-ad27-14ad997c8b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:01.054981 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d140bf6-2066-4593-bfbc-c1917330a8a4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:01.066313 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d140bf6-2066-4593-bfbc-c1917330a8a4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:01.078860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-bd10c394-a41f-4bae-ad27-14ad997c8b20 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:01.081071 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-bd10c394-a41f-4bae-ad27-14ad997c8b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:01.150722 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97194cb1-a233-4b35-987a-56855669f00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:01.151770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97194cb1-a233-4b35-987a-56855669f00a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:01.152056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97194cb1-a233-4b35-987a-56855669f00a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:01.152335 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97194cb1-a233-4b35-987a-56855669f00a admin admin] PATH_INFO: `/v3/users/dec4ba53e1b44a099e24ce89f382ac82` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:01.157282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 146/289] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:01.168948 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97194cb1-a233-4b35-987a-56855669f00a admin admin] RBAC: Authorizing `identity:get_user(user_id=dec4ba53e1b44a099e24ce89f382ac82)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:01.171155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97194cb1-a233-4b35-987a-56855669f00a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:01.173114 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 144/290] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:51:01 2021] GET /identity/v3/users/dec4ba53e1b44a099e24ce89f382ac82 => generated 293 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:01.180038 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10c394-a41f-4bae-ad27-14ad997c8b20 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:01.185086 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97194cb1-a233-4b35-987a-56855669f00a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:01.190824 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10c394-a41f-4bae-ad27-14ad997c8b20 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:01.195405 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542306a-c247-42c8-89db-b7c5f60446b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:01.196068 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542306a-c247-42c8-89db-b7c5f60446b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:01.196347 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542306a-c247-42c8-89db-b7c5f60446b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:01.196623 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542306a-c247-42c8-89db-b7c5f60446b5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:01.197480 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542306a-c247-42c8-89db-b7c5f60446b5 admin admin] RBAC: Adding query filter params (role.id=69edf382652b443c97811919233bb991, user.id=dec4ba53e1b44a099e24ce89f382ac82, scope.system=all) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:01.197794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542306a-c247-42c8-89db-b7c5f60446b5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:01.198844 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97194cb1-a233-4b35-987a-56855669f00a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:01.199732 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542306a-c247-42c8-89db-b7c5f60446b5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:01.207989 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697e62e-8731-4bad-91e9-157233638b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:01.208746 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 147/291] 10.222.0.18 () {56 vars in 1329 bytes} [Wed Dec 15 02:51:01 2021] GET /identity/v3/role_assignments?user.id=dec4ba53e1b44a099e24ce89f382ac82&scope.system=all&role.id=69edf382652b443c97811919233bb991 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:01.209529 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697e62e-8731-4bad-91e9-157233638b03 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:01.210534 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697e62e-8731-4bad-91e9-157233638b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:01.210954 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697e62e-8731-4bad-91e9-157233638b03 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:01.212480 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697e62e-8731-4bad-91e9-157233638b03 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:01.214569 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697e62e-8731-4bad-91e9-157233638b03 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:01.216551 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 145/292] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:01 2021] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:01.223017 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542306a-c247-42c8-89db-b7c5f60446b5 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:01.233444 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542306a-c247-42c8-89db-b7c5f60446b5 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:01.238175 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c9e39-f7d3-41ee-8590-6ddeaf6a10f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:01.238896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c9e39-f7d3-41ee-8590-6ddeaf6a10f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:01.239181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c9e39-f7d3-41ee-8590-6ddeaf6a10f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:01.239492 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c9e39-f7d3-41ee-8590-6ddeaf6a10f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:01.240236 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c9e39-f7d3-41ee-8590-6ddeaf6a10f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:01.242353 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c9e39-f7d3-41ee-8590-6ddeaf6a10f4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:01.266279 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 148/293] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:51:01 2021] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:51:03.456342 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a21de-a45f-4ef3-8df1-6bdc407159d3 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.456828 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a21de-a45f-4ef3-8df1-6bdc407159d3 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.456828 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a21de-a45f-4ef3-8df1-6bdc407159d3 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.458835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 146/294] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:03.464673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a2eb2-250f-4de7-aabe-69d44a1bb61c None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.465068 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a2eb2-250f-4de7-aabe-69d44a1bb61c None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.465249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a2eb2-250f-4de7-aabe-69d44a1bb61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.484955 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-4b9a2eb2-250f-4de7-aabe-69d44a1bb61c None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:03.486246 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-4b9a2eb2-250f-4de7-aabe-69d44a1bb61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:03.494046 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 149/295] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:03.517872 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a21de-a45f-4ef3-8df1-6bdc407159d3 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:03.529821 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a21de-a45f-4ef3-8df1-6bdc407159d3 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:03.534628 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587a8e2-8770-40db-b698-0db7c069fb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:03.535410 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587a8e2-8770-40db-b698-0db7c069fb5a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.535691 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587a8e2-8770-40db-b698-0db7c069fb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.535966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587a8e2-8770-40db-b698-0db7c069fb5a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.546906 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587a8e2-8770-40db-b698-0db7c069fb5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:03.553762 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-c587a8e2-8770-40db-b698-0db7c069fb5a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 02:51:03.555295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 147/296] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:03 2021] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:03.561421 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a2eb2-250f-4de7-aabe-69d44a1bb61c None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:03.570590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a2eb2-250f-4de7-aabe-69d44a1bb61c None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:03.574984 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176541a-539f-4998-9c60-5f9106e9c1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:03.575631 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176541a-539f-4998-9c60-5f9106e9c1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.575912 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176541a-539f-4998-9c60-5f9106e9c1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.576184 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176541a-539f-4998-9c60-5f9106e9c1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.576947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176541a-539f-4998-9c60-5f9106e9c1e7 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:03.577528 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176541a-539f-4998-9c60-5f9106e9c1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:03.578991 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176541a-539f-4998-9c60-5f9106e9c1e7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:03.579099 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f76d44-313b-4c74-978b-5752527f5320 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.579347 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f76d44-313b-4c74-978b-5752527f5320 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.579628 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f76d44-313b-4c74-978b-5752527f5320 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.581432 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 148/297] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:51:03.587002 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54b500-32ae-4d83-9ee4-f5c77eaaa6e5 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.587446 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54b500-32ae-4d83-9ee4-f5c77eaaa6e5 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.587863 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54b500-32ae-4d83-9ee4-f5c77eaaa6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.587965 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 150/298] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:51:03 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:03.594145 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176541a-539f-4998-9c60-5f9106e9c1e7 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:03.603423 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176541a-539f-4998-9c60-5f9106e9c1e7 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:03.607488 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-7d54b500-32ae-4d83-9ee4-f5c77eaaa6e5 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:03.607709 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95339d0a-dded-4583-932c-2e17e00fb9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:03.608547 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95339d0a-dded-4583-932c-2e17e00fb9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.609390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95339d0a-dded-4583-932c-2e17e00fb9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.609664 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95339d0a-dded-4583-932c-2e17e00fb9c0 admin admin] PATH_INFO: `/v3/users/0028e90bec894b81bfaadbc896c4ec7b` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.610039 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7d54b500-32ae-4d83-9ee4-f5c77eaaa6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:03.610897 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95339d0a-dded-4583-932c-2e17e00fb9c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=0028e90bec894b81bfaadbc896c4ec7b)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:03.613104 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95339d0a-dded-4583-932c-2e17e00fb9c0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:03.614733 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 151/299] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:51:03 2021] GET /identity/v3/users/0028e90bec894b81bfaadbc896c4ec7b => generated 297 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:03.620411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95339d0a-dded-4583-932c-2e17e00fb9c0 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:03.622008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 149/300] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:51:03.629889 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95339d0a-dded-4583-932c-2e17e00fb9c0 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:03.634177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a58cba-5285-440b-a2fc-df7ed6c44909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:03.635032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a58cba-5285-440b-a2fc-df7ed6c44909 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.635315 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a58cba-5285-440b-a2fc-df7ed6c44909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.635589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a58cba-5285-440b-a2fc-df7ed6c44909 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.643416 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a58cba-5285-440b-a2fc-df7ed6c44909 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:03.645141 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a58cba-5285-440b-a2fc-df7ed6c44909 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:03.648187 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54b500-32ae-4d83-9ee4-f5c77eaaa6e5 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:03.654844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 152/301] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 02:51:03.658250 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54b500-32ae-4d83-9ee4-f5c77eaaa6e5 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:03.662221 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a58cba-5285-440b-a2fc-df7ed6c44909 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:03.663140 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33e170-38dc-4f44-a6e6-f6aad5060ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:03.664126 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33e170-38dc-4f44-a6e6-f6aad5060ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.664599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33e170-38dc-4f44-a6e6-f6aad5060ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.665048 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33e170-38dc-4f44-a6e6-f6aad5060ec9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.672020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a58cba-5285-440b-a2fc-df7ed6c44909 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:03.676392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88ec5a-30c9-4966-a112-1eb6cc274eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:03.677223 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ec5a-30c9-4966-a112-1eb6cc274eda admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.677504 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ec5a-30c9-4966-a112-1eb6cc274eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.677776 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ec5a-30c9-4966-a112-1eb6cc274eda admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.678190 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33e170-38dc-4f44-a6e6-f6aad5060ec9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:03.679061 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88ec5a-30c9-4966-a112-1eb6cc274eda admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:03.681171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88ec5a-30c9-4966-a112-1eb6cc274eda admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:03.682922 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 153/302] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:03 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:03.686028 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-3a33e170-38dc-4f44-a6e6-f6aad5060ec9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:51:03.687658 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 150/303] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:03.692834 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88ec5a-30c9-4966-a112-1eb6cc274eda admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:03.693846 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33e170-38dc-4f44-a6e6-f6aad5060ec9 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:03.703617 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88ec5a-30c9-4966-a112-1eb6cc274eda admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:03.707573 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33e170-38dc-4f44-a6e6-f6aad5060ec9 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:03.710606 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97c809-7135-4a68-90d9-1b779b1954c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:03.711238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97c809-7135-4a68-90d9-1b779b1954c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.711513 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97c809-7135-4a68-90d9-1b779b1954c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.712564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97c809-7135-4a68-90d9-1b779b1954c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.713399 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97c809-7135-4a68-90d9-1b779b1954c5 admin admin] RBAC: Adding query filter params (role.id=1298b7f1875942e5baa6f96892b35aa9, scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0, user.id=0028e90bec894b81bfaadbc896c4ec7b) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:03.713706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97c809-7135-4a68-90d9-1b779b1954c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:03.714191 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519407f-13f2-44f0-91b7-a1ce921f9bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:03.715059 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519407f-13f2-44f0-91b7-a1ce921f9bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.715535 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519407f-13f2-44f0-91b7-a1ce921f9bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.715636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97c809-7135-4a68-90d9-1b779b1954c5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:03.716103 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519407f-13f2-44f0-91b7-a1ce921f9bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.717067 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519407f-13f2-44f0-91b7-a1ce921f9bc0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:03.717579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519407f-13f2-44f0-91b7-a1ce921f9bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:03.719915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519407f-13f2-44f0-91b7-a1ce921f9bc0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:03.722321 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 154/304] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:03 2021] GET /identity/v3/role_assignments?user.id=0028e90bec894b81bfaadbc896c4ec7b&scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0&role.id=1298b7f1875942e5baa6f96892b35aa9 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:03.730039 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 151/305] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:51:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:03.737006 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97c809-7135-4a68-90d9-1b779b1954c5 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:03.747880 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97c809-7135-4a68-90d9-1b779b1954c5 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:03.752874 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685fa56-ecf1-4c4f-bd0a-a8cea4fb59e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:03.754248 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685fa56-ecf1-4c4f-bd0a-a8cea4fb59e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.754760 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685fa56-ecf1-4c4f-bd0a-a8cea4fb59e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.755246 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685fa56-ecf1-4c4f-bd0a-a8cea4fb59e6 admin admin] PATH_INFO: `/v3/users/dec4ba53e1b44a099e24ce89f382ac82` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.756854 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685fa56-ecf1-4c4f-bd0a-a8cea4fb59e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=dec4ba53e1b44a099e24ce89f382ac82)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:03.759320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685fa56-ecf1-4c4f-bd0a-a8cea4fb59e6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:03.761706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 155/306] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:51:03 2021] GET /identity/v3/users/dec4ba53e1b44a099e24ce89f382ac82 => generated 293 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:03.768330 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519407f-13f2-44f0-91b7-a1ce921f9bc0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:03.778883 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519407f-13f2-44f0-91b7-a1ce921f9bc0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:03.784746 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83d174-6a18-45d1-890b-bd307dc2635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:03.786106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d174-6a18-45d1-890b-bd307dc2635c admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.786595 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d174-6a18-45d1-890b-bd307dc2635c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.787071 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d174-6a18-45d1-890b-bd307dc2635c admin admin] PATH_INFO: `/v3/system/users/dec4ba53e1b44a099e24ce89f382ac82/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.789009 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83d174-6a18-45d1-890b-bd307dc2635c admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dec4ba53e1b44a099e24ce89f382ac82, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:03.790391 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-5a83d174-6a18-45d1-890b-bd307dc2635c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:03.790391 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:51:03.790391 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:51:03.791669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83d174-6a18-45d1-890b-bd307dc2635c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:03.794634 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec8dc5-1fc6-4930-9391-32e50e756cff None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.794946 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec8dc5-1fc6-4930-9391-32e50e756cff None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.795199 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec8dc5-1fc6-4930-9391-32e50e756cff None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.797639 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 156/307] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:03.804425 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37899df3-ae84-4e0d-8306-7816520675ce None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.804767 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37899df3-ae84-4e0d-8306-7816520675ce None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.805114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37899df3-ae84-4e0d-8306-7816520675ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.807477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 152/308] 10.222.0.18 () {58 vars in 1355 bytes} [Wed Dec 15 02:51:03 2021] PUT /identity/v3/system/users/dec4ba53e1b44a099e24ce89f382ac82/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:51:03.814012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d769b-64d2-4624-bb5c-da7e8a74ac62 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.814796 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d769b-64d2-4624-bb5c-da7e8a74ac62 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.815087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d769b-64d2-4624-bb5c-da7e8a74ac62 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.817263 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 153/309] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:03 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:03.824448 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73058b52-d751-4ecf-9104-d8a2e7f3f848 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.824754 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73058b52-d751-4ecf-9104-d8a2e7f3f848 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.825005 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73058b52-d751-4ecf-9104-d8a2e7f3f848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.834046 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-37899df3-ae84-4e0d-8306-7816520675ce None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:03.834046 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-37899df3-ae84-4e0d-8306-7816520675ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:03.840583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 157/310] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:03.847392 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-73058b52-d751-4ecf-9104-d8a2e7f3f848 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:03.848685 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-73058b52-d751-4ecf-9104-d8a2e7f3f848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:03.857547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 154/311] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:51:03.867361 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37899df3-ae84-4e0d-8306-7816520675ce None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:03.878171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37899df3-ae84-4e0d-8306-7816520675ce None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:03.883482 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73058b52-d751-4ecf-9104-d8a2e7f3f848 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:03.883671 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc76203-7d46-4f8b-884f-f9a78eefab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:03.884407 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc76203-7d46-4f8b-884f-f9a78eefab2d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.884687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc76203-7d46-4f8b-884f-f9a78eefab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.885261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc76203-7d46-4f8b-884f-f9a78eefab2d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.893523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73058b52-d751-4ecf-9104-d8a2e7f3f848 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:03.898353 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df368b-461b-48aa-bfbd-0eb1523cece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:03.899189 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df368b-461b-48aa-bfbd-0eb1523cece0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.899470 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df368b-461b-48aa-bfbd-0eb1523cece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.899748 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df368b-461b-48aa-bfbd-0eb1523cece0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.899848 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc76203-7d46-4f8b-884f-f9a78eefab2d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:03.901045 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df368b-461b-48aa-bfbd-0eb1523cece0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:03.902836 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df368b-461b-48aa-bfbd-0eb1523cece0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:03.904566 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 155/312] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:03.908565 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-8cc76203-7d46-4f8b-884f-f9a78eefab2d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 02:51:03.910967 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df368b-461b-48aa-bfbd-0eb1523cece0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:03.914104 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 158/313] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:03 2021] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:03.919413 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc76203-7d46-4f8b-884f-f9a78eefab2d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:03.926268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df368b-461b-48aa-bfbd-0eb1523cece0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:03.930965 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f36338-9e32-4782-8d1e-1d1e3047368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:03.931798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f36338-9e32-4782-8d1e-1d1e3047368a admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.932178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f36338-9e32-4782-8d1e-1d1e3047368a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.932630 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f36338-9e32-4782-8d1e-1d1e3047368a admin admin] PATH_INFO: `/v3/groups` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.933492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f36338-9e32-4782-8d1e-1d1e3047368a admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:03.934707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-a8f36338-9e32-4782-8d1e-1d1e3047368a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:03.934707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:51:03.934707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:51:03.936129 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f36338-9e32-4782-8d1e-1d1e3047368a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:03.936297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc76203-7d46-4f8b-884f-f9a78eefab2d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:03.941869 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3393930-6235-4e25-bc98-6ac87d323108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:03.942609 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393930-6235-4e25-bc98-6ac87d323108 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.942950 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393930-6235-4e25-bc98-6ac87d323108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.943578 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393930-6235-4e25-bc98-6ac87d323108 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:03.944305 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3393930-6235-4e25-bc98-6ac87d323108 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:03.944697 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3393930-6235-4e25-bc98-6ac87d323108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:03.946849 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3393930-6235-4e25-bc98-6ac87d323108 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:03.954954 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 156/314] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Dec 15 02:51:03 2021] POST /identity/v3/groups => generated 229 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:51:03.965155 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 159/315] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:51:03 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:03.971172 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f36338-9e32-4782-8d1e-1d1e3047368a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:03.984511 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f36338-9e32-4782-8d1e-1d1e3047368a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:03.992332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88f284-4a0b-4ab0-9eca-3a57d4b648b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:03.993552 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88f284-4a0b-4ab0-9eca-3a57d4b648b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:03.994021 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88f284-4a0b-4ab0-9eca-3a57d4b648b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:03.994445 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88f284-4a0b-4ab0-9eca-3a57d4b648b0 admin admin] PATH_INFO: `/v3/users/e9fb0228bee84abe98adcc1355f8ad85` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:04.012727 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88f284-4a0b-4ab0-9eca-3a57d4b648b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=e9fb0228bee84abe98adcc1355f8ad85)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:04.017425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88f284-4a0b-4ab0-9eca-3a57d4b648b0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:04.017883 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 157/316] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:51:03 2021] GET /identity/v3/users/e9fb0228bee84abe98adcc1355f8ad85 => generated 293 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:04.024367 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3393930-6235-4e25-bc98-6ac87d323108 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:04.036540 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3393930-6235-4e25-bc98-6ac87d323108 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:04.041441 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9ff6b-c557-4d44-9714-9f7fbb8b1f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:04.043132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9ff6b-c557-4d44-9714-9f7fbb8b1f34 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:04.043132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9ff6b-c557-4d44-9714-9f7fbb8b1f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:04.043132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9ff6b-c557-4d44-9714-9f7fbb8b1f34 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:04.043555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9ff6b-c557-4d44-9714-9f7fbb8b1f34 admin admin] RBAC: Adding query filter params (role.id=1298b7f1875942e5baa6f96892b35aa9, user.id=e9fb0228bee84abe98adcc1355f8ad85, scope.system=all) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:04.043861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9ff6b-c557-4d44-9714-9f7fbb8b1f34 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:04.045750 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9ff6b-c557-4d44-9714-9f7fbb8b1f34 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:04.056101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 160/317] 10.222.0.18 () {56 vars in 1329 bytes} [Wed Dec 15 02:51:04 2021] GET /identity/v3/role_assignments?user.id=e9fb0228bee84abe98adcc1355f8ad85&scope.system=all&role.id=1298b7f1875942e5baa6f96892b35aa9 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:06.222898 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac47933-8f25-4ec9-ba82-83aa460440e5 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:06.223358 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac47933-8f25-4ec9-ba82-83aa460440e5 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:06.223577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac47933-8f25-4ec9-ba82-83aa460440e5 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:06.225383 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 158/318] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:06.231156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d702e2-d02e-456c-beb0-41ecd95a1830 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:06.231606 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d702e2-d02e-456c-beb0-41ecd95a1830 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:06.231703 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d702e2-d02e-456c-beb0-41ecd95a1830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:06.250308 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-f3d702e2-d02e-456c-beb0-41ecd95a1830 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:06.251481 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f3d702e2-d02e-456c-beb0-41ecd95a1830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:06.258979 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 161/319] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:06.285365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac47933-8f25-4ec9-ba82-83aa460440e5 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:06.297275 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac47933-8f25-4ec9-ba82-83aa460440e5 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:06.301425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d6815-a997-4936-ab10-e448ce803bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:06.302269 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d6815-a997-4936-ab10-e448ce803bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:06.302549 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d6815-a997-4936-ab10-e448ce803bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:06.302819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d6815-a997-4936-ab10-e448ce803bf5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:06.313163 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d6815-a997-4936-ab10-e448ce803bf5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:06.319999 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-917d6815-a997-4936-ab10-e448ce803bf5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:51:06.321414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 159/320] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:06.327872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d702e2-d02e-456c-beb0-41ecd95a1830 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:06.337393 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d702e2-d02e-456c-beb0-41ecd95a1830 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:06.341617 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bed1c-dda0-4b72-9914-a9ea79efc4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:06.342310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bed1c-dda0-4b72-9914-a9ea79efc4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:06.342590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bed1c-dda0-4b72-9914-a9ea79efc4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:06.342862 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bed1c-dda0-4b72-9914-a9ea79efc4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:06.344281 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bed1c-dda0-4b72-9914-a9ea79efc4a4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:06.344586 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bed1c-dda0-4b72-9914-a9ea79efc4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:06.346209 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bed1c-dda0-4b72-9914-a9ea79efc4a4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:06.354658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 162/321] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:51:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:06.360376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d6815-a997-4936-ab10-e448ce803bf5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:06.369920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d6815-a997-4936-ab10-e448ce803bf5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:06.374197 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95621145-4532-4be9-b209-cb23a8b61a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:06.375053 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95621145-4532-4be9-b209-cb23a8b61a85 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:06.375331 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95621145-4532-4be9-b209-cb23a8b61a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:06.375605 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95621145-4532-4be9-b209-cb23a8b61a85 admin admin] PATH_INFO: `/v3/users/dec4ba53e1b44a099e24ce89f382ac82` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:06.377127 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95621145-4532-4be9-b209-cb23a8b61a85 admin admin] RBAC: Authorizing `identity:get_user(user_id=dec4ba53e1b44a099e24ce89f382ac82)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:06.378582 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd078055-b961-40de-a87e-9d5a54b4b1b2 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:06.378879 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd078055-b961-40de-a87e-9d5a54b4b1b2 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:06.379158 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd078055-b961-40de-a87e-9d5a54b4b1b2 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:06.379321 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95621145-4532-4be9-b209-cb23a8b61a85 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:06.381139 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 160/322] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:51:06 2021] GET /identity/v3/users/dec4ba53e1b44a099e24ce89f382ac82 => generated 293 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:06.381254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 163/323] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:51:06.387145 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22f9c5-3bbb-4aa4-a40b-59e6af6dcdfe None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:06.387291 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bcc0b-85f2-437c-b228-5889040c37fa None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:06.387465 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bcc0b-85f2-437c-b228-5889040c37fa None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:06.387562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22f9c5-3bbb-4aa4-a40b-59e6af6dcdfe None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:06.387711 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bcc0b-85f2-437c-b228-5889040c37fa None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:06.387953 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22f9c5-3bbb-4aa4-a40b-59e6af6dcdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:06.389323 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 161/324] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:06.390558 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bcc0b-85f2-437c-b228-5889040c37fa None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:06.402788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bcc0b-85f2-437c-b228-5889040c37fa None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:06.407308 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-7e22f9c5-3bbb-4aa4-a40b-59e6af6dcdfe None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:06.407586 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dab7af-0fcf-4737-87e7-77097c99196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:06.408291 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dab7af-0fcf-4737-87e7-77097c99196d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:06.408487 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-7e22f9c5-3bbb-4aa4-a40b-59e6af6dcdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:06.408577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dab7af-0fcf-4737-87e7-77097c99196d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:06.408844 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dab7af-0fcf-4737-87e7-77097c99196d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:06.409669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dab7af-0fcf-4737-87e7-77097c99196d admin admin] RBAC: Adding query filter params (role.id=69edf382652b443c97811919233bb991, user.id=dec4ba53e1b44a099e24ce89f382ac82, scope.system=all) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:06.409999 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dab7af-0fcf-4737-87e7-77097c99196d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:06.411835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dab7af-0fcf-4737-87e7-77097c99196d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:06.416310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 164/325] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:06.417512 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90c220-6def-477d-ba97-026ec3e9be62 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:06.417822 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90c220-6def-477d-ba97-026ec3e9be62 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:06.418113 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90c220-6def-477d-ba97-026ec3e9be62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:06.429608 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 162/326] 10.222.0.18 () {56 vars in 1329 bytes} [Wed Dec 15 02:51:06 2021] GET /identity/v3/role_assignments?user.id=dec4ba53e1b44a099e24ce89f382ac82&scope.system=all&role.id=69edf382652b443c97811919233bb991 => generated 510 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:06.436425 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-2c90c220-6def-477d-ba97-026ec3e9be62 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:06.438316 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-2c90c220-6def-477d-ba97-026ec3e9be62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:06.440543 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dab7af-0fcf-4737-87e7-77097c99196d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:06.446324 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 165/327] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:06.451568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dab7af-0fcf-4737-87e7-77097c99196d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:06.457044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63996f83-858f-4074-90b9-a6dde917e4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:06.458175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63996f83-858f-4074-90b9-a6dde917e4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:06.458640 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63996f83-858f-4074-90b9-a6dde917e4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:06.459096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63996f83-858f-4074-90b9-a6dde917e4e5 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:06.471332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63996f83-858f-4074-90b9-a6dde917e4e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:06.472469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90c220-6def-477d-ba97-026ec3e9be62 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:06.480089 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-63996f83-858f-4074-90b9-a6dde917e4e5 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 02:51:06.481656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90c220-6def-477d-ba97-026ec3e9be62 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:06.482127 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 163/328] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:06 2021] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:06.488055 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63996f83-858f-4074-90b9-a6dde917e4e5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:06.491856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e60677-3d9b-47d0-9b71-44412895a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:06.492659 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e60677-3d9b-47d0-9b71-44412895a1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:06.492939 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e60677-3d9b-47d0-9b71-44412895a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:06.493212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e60677-3d9b-47d0-9b71-44412895a1f6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:06.494530 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e60677-3d9b-47d0-9b71-44412895a1f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:06.496314 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e60677-3d9b-47d0-9b71-44412895a1f6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:06.498050 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 166/329] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:06.500292 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63996f83-858f-4074-90b9-a6dde917e4e5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:06.504571 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e60677-3d9b-47d0-9b71-44412895a1f6 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:06.505464 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbab30-b708-4aa0-8227-a857f8cbaa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:06.506338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbab30-b708-4aa0-8227-a857f8cbaa68 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:06.506765 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbab30-b708-4aa0-8227-a857f8cbaa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:06.507183 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbab30-b708-4aa0-8227-a857f8cbaa68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:06.508108 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbab30-b708-4aa0-8227-a857f8cbaa68 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:06.508586 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbab30-b708-4aa0-8227-a857f8cbaa68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:06.510986 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbab30-b708-4aa0-8227-a857f8cbaa68 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:06.516106 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e60677-3d9b-47d0-9b71-44412895a1f6 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:06.521117 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0c4db-d967-498e-9734-cb7ffea358c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:06.521784 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0c4db-d967-498e-9734-cb7ffea358c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:06.522097 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0c4db-d967-498e-9734-cb7ffea358c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:06.522374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0c4db-d967-498e-9734-cb7ffea358c7 admin admin] PATH_INFO: `/v3/groups` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:06.523081 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0c4db-d967-498e-9734-cb7ffea358c7 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:06.523696 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 164/330] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:51:06 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:06.524118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-d6d0c4db-d967-498e-9734-cb7ffea358c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:06.524118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:51:06.524118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:51:06.525291 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0c4db-d967-498e-9734-cb7ffea358c7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:06.530032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbab30-b708-4aa0-8227-a857f8cbaa68 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:06.541243 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbab30-b708-4aa0-8227-a857f8cbaa68 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:06.545840 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e4930-bbda-42a2-8dcd-6c0117caab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:06.546819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e4930-bbda-42a2-8dcd-6c0117caab6f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:06.547106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e4930-bbda-42a2-8dcd-6c0117caab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:06.547387 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e4930-bbda-42a2-8dcd-6c0117caab6f admin admin] PATH_INFO: `/v3/users/e9fb0228bee84abe98adcc1355f8ad85` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:06.548739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e4930-bbda-42a2-8dcd-6c0117caab6f admin admin] RBAC: Authorizing `identity:get_user(user_id=e9fb0228bee84abe98adcc1355f8ad85)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:06.550187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 167/331] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Dec 15 02:51:06 2021] POST /identity/v3/groups => generated 226 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 02:51:06.551086 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e4930-bbda-42a2-8dcd-6c0117caab6f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:06.554025 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 165/332] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:51:06 2021] GET /identity/v3/users/e9fb0228bee84abe98adcc1355f8ad85 => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:06.559799 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0c4db-d967-498e-9734-cb7ffea358c7 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:06.571149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0c4db-d967-498e-9734-cb7ffea358c7 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:06.575865 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38629d5e-42c4-468d-9285-2c04a5e6be69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:06.576756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38629d5e-42c4-468d-9285-2c04a5e6be69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:06.577032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38629d5e-42c4-468d-9285-2c04a5e6be69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:06.577897 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38629d5e-42c4-468d-9285-2c04a5e6be69 admin admin] PATH_INFO: `/v3/system/users/e9fb0228bee84abe98adcc1355f8ad85/roles/1298b7f1875942e5baa6f96892b35aa9` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:06.579607 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38629d5e-42c4-468d-9285-2c04a5e6be69 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e9fb0228bee84abe98adcc1355f8ad85, role_id=1298b7f1875942e5baa6f96892b35aa9)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:06.580789 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-38629d5e-42c4-468d-9285-2c04a5e6be69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:06.580789 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:51:06.580789 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:51:06.581769 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38629d5e-42c4-468d-9285-2c04a5e6be69 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:06.591555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 168/333] 10.222.0.18 () {58 vars in 1355 bytes} [Wed Dec 15 02:51:06 2021] PUT /identity/v3/system/users/e9fb0228bee84abe98adcc1355f8ad85/roles/1298b7f1875942e5baa6f96892b35aa9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:51:09.128425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba30a3-10c4-4cf8-be91-b206300b7b8e None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:09.128959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba30a3-10c4-4cf8-be91-b206300b7b8e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:09.128959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba30a3-10c4-4cf8-be91-b206300b7b8e None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:09.131285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 166/334] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:09.137433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd1597-b91a-4443-a81f-27fa788b8378 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:09.137913 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd1597-b91a-4443-a81f-27fa788b8378 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:09.138015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd1597-b91a-4443-a81f-27fa788b8378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:09.158725 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-81bd1597-b91a-4443-a81f-27fa788b8378 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:09.159882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-81bd1597-b91a-4443-a81f-27fa788b8378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:09.174184 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 169/335] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:09.219782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba30a3-10c4-4cf8-be91-b206300b7b8e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:09.235852 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba30a3-10c4-4cf8-be91-b206300b7b8e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:09.240071 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893db510-0fd7-4104-9763-deda3a79d979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:09.240846 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893db510-0fd7-4104-9763-deda3a79d979 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:09.241121 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893db510-0fd7-4104-9763-deda3a79d979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:09.241390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893db510-0fd7-4104-9763-deda3a79d979 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:09.255282 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893db510-0fd7-4104-9763-deda3a79d979 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:09.262397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-893db510-0fd7-4104-9763-deda3a79d979 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 02:51:09.263571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 167/336] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:09 2021] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:09.270405 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd1597-b91a-4443-a81f-27fa788b8378 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:09.282787 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd1597-b91a-4443-a81f-27fa788b8378 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:09.288282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8e310-cf15-4267-9479-6918dc9e8213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:09.288941 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e310-cf15-4267-9479-6918dc9e8213 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:09.289224 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e310-cf15-4267-9479-6918dc9e8213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:09.289500 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e310-cf15-4267-9479-6918dc9e8213 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:09.290341 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8e310-cf15-4267-9479-6918dc9e8213 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:09.290649 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8e310-cf15-4267-9479-6918dc9e8213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:09.292270 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8e310-cf15-4267-9479-6918dc9e8213 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:09.308197 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 170/337] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:51:09 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:09.314382 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893db510-0fd7-4104-9763-deda3a79d979 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:09.328201 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893db510-0fd7-4104-9763-deda3a79d979 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:09.332543 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c9505-b06d-4d1b-ba44-616e0823c052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:09.333400 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c9505-b06d-4d1b-ba44-616e0823c052 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:09.333670 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c9505-b06d-4d1b-ba44-616e0823c052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:09.333943 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c9505-b06d-4d1b-ba44-616e0823c052 admin admin] PATH_INFO: `/v3/users/e9fb0228bee84abe98adcc1355f8ad85` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:09.339293 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c9505-b06d-4d1b-ba44-616e0823c052 admin admin] RBAC: Authorizing `identity:get_user(user_id=e9fb0228bee84abe98adcc1355f8ad85)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:09.341417 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c9505-b06d-4d1b-ba44-616e0823c052 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:09.344037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 168/338] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:51:09 2021] GET /identity/v3/users/e9fb0228bee84abe98adcc1355f8ad85 => generated 293 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:09.350642 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8e310-cf15-4267-9479-6918dc9e8213 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:09.368518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8e310-cf15-4267-9479-6918dc9e8213 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:09.376506 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494305d4-df15-4f02-99a7-d45b897238a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:09.377160 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494305d4-df15-4f02-99a7-d45b897238a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:09.377442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494305d4-df15-4f02-99a7-d45b897238a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:09.377722 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494305d4-df15-4f02-99a7-d45b897238a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:09.378638 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494305d4-df15-4f02-99a7-d45b897238a6 admin admin] RBAC: Adding query filter params (role.id=1298b7f1875942e5baa6f96892b35aa9, user.id=e9fb0228bee84abe98adcc1355f8ad85, scope.system=all) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:09.378894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494305d4-df15-4f02-99a7-d45b897238a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:09.380742 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494305d4-df15-4f02-99a7-d45b897238a6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:09.406088 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 171/339] 10.222.0.18 () {56 vars in 1329 bytes} [Wed Dec 15 02:51:09 2021] GET /identity/v3/role_assignments?user.id=e9fb0228bee84abe98adcc1355f8ad85&scope.system=all&role.id=1298b7f1875942e5baa6f96892b35aa9 => generated 510 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:09.853775 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2406bb8-6240-46a5-b456-1394c59a2a17 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:09.854165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2406bb8-6240-46a5-b456-1394c59a2a17 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:09.854334 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2406bb8-6240-46a5-b456-1394c59a2a17 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:09.856362 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 169/340] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:09.862958 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74e8a7-4c3e-48bf-96d4-7a4ce61b98e6 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:09.863245 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74e8a7-4c3e-48bf-96d4-7a4ce61b98e6 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:09.863525 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74e8a7-4c3e-48bf-96d4-7a4ce61b98e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:09.887026 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-af74e8a7-4c3e-48bf-96d4-7a4ce61b98e6 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:09.888241 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-af74e8a7-4c3e-48bf-96d4-7a4ce61b98e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:09.896009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 172/341] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:09.939472 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2406bb8-6240-46a5-b456-1394c59a2a17 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:09.956533 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2406bb8-6240-46a5-b456-1394c59a2a17 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:09.960975 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5090d1-d1a0-4135-be4f-cfa76e11fe1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:09.961801 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5090d1-d1a0-4135-be4f-cfa76e11fe1e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:09.962113 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5090d1-d1a0-4135-be4f-cfa76e11fe1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:09.962387 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5090d1-d1a0-4135-be4f-cfa76e11fe1e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:09.982910 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5090d1-d1a0-4135-be4f-cfa76e11fe1e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:09.990766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-8e5090d1-d1a0-4135-be4f-cfa76e11fe1e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 02:51:09.993239 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 170/342] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:51:09 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:09.998639 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74e8a7-4c3e-48bf-96d4-7a4ce61b98e6 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.013418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74e8a7-4c3e-48bf-96d4-7a4ce61b98e6 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.021342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c03cd-5db9-47ff-8898-8951749a78b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.022026 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c03cd-5db9-47ff-8898-8951749a78b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.022313 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c03cd-5db9-47ff-8898-8951749a78b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.022589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c03cd-5db9-47ff-8898-8951749a78b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.023366 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c03cd-5db9-47ff-8898-8951749a78b0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:10.023671 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c03cd-5db9-47ff-8898-8951749a78b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:10.025298 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c03cd-5db9-47ff-8898-8951749a78b0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:10.038942 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 173/343] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:09 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:10.044753 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5090d1-d1a0-4135-be4f-cfa76e11fe1e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.057400 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5090d1-d1a0-4135-be4f-cfa76e11fe1e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.062279 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e1ce4-2dca-4670-a3b3-2583195f8a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.062912 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e1ce4-2dca-4670-a3b3-2583195f8a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.063185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e1ce4-2dca-4670-a3b3-2583195f8a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.063449 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e1ce4-2dca-4670-a3b3-2583195f8a65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.079044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e1ce4-2dca-4670-a3b3-2583195f8a65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:10.080809 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e1ce4-2dca-4670-a3b3-2583195f8a65 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:10.092117 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 171/344] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:10.098310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c03cd-5db9-47ff-8898-8951749a78b0 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.112722 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c03cd-5db9-47ff-8898-8951749a78b0 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.121260 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c77017-7476-41da-9617-75b3d71dbf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.122132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c77017-7476-41da-9617-75b3d71dbf09 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.122414 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c77017-7476-41da-9617-75b3d71dbf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.122693 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c77017-7476-41da-9617-75b3d71dbf09 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.126764 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c77017-7476-41da-9617-75b3d71dbf09 admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:10.128822 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c77017-7476-41da-9617-75b3d71dbf09 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:10.130862 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 174/345] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:10.136891 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e1ce4-2dca-4670-a3b3-2583195f8a65 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.152290 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e1ce4-2dca-4670-a3b3-2583195f8a65 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.160787 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c0f43-1fd8-4064-82f9-899bbd333af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.161633 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c0f43-1fd8-4064-82f9-899bbd333af7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.161907 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c0f43-1fd8-4064-82f9-899bbd333af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.162214 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c0f43-1fd8-4064-82f9-899bbd333af7 admin admin] PATH_INFO: `/v3/groups/5029563d86254e33b97e7149a49dd767` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.168607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c0f43-1fd8-4064-82f9-899bbd333af7 admin admin] RBAC: Authorizing `identity:get_group(group_id=5029563d86254e33b97e7149a49dd767)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:10.169640 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-ed6c0f43-1fd8-4064-82f9-899bbd333af7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:10.169640 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:51:10.169640 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:51:10.171361 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c0f43-1fd8-4064-82f9-899bbd333af7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:10.173168 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 172/346] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/groups/5029563d86254e33b97e7149a49dd767 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:10.179426 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c77017-7476-41da-9617-75b3d71dbf09 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.195089 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c211477-134f-416f-b800-5307f5991e10 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.195406 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c211477-134f-416f-b800-5307f5991e10 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.195644 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c211477-134f-416f-b800-5307f5991e10 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.195965 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c77017-7476-41da-9617-75b3d71dbf09 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.197803 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 173/347] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:51:10.207172 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57774b7-c417-43ee-b40b-390bde726a73 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.207458 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57774b7-c417-43ee-b40b-390bde726a73 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.207732 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57774b7-c417-43ee-b40b-390bde726a73 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.208569 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cef59-a77c-4986-9797-0028ea367262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.209212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cef59-a77c-4986-9797-0028ea367262 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.209451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 174/348] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:10.209750 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cef59-a77c-4986-9797-0028ea367262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.210961 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cef59-a77c-4986-9797-0028ea367262 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.211066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af95763-215f-4e42-a040-2efaad416884 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.211066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af95763-215f-4e42-a040-2efaad416884 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.211207 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cef59-a77c-4986-9797-0028ea367262 admin admin] RBAC: Adding query filter params (group.id=5029563d86254e33b97e7149a49dd767, role.id=bcbedb9e465844d2a8baa6af3760e916, scope.project.id=4bec9401bcfa489d98020b66bccfa487) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:10.211278 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af95763-215f-4e42-a040-2efaad416884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.211342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cef59-a77c-4986-9797-0028ea367262 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:10.213029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cef59-a77c-4986-9797-0028ea367262 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:10.230009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 175/349] 10.222.0.18 () {56 vars in 1397 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/role_assignments?group.id=5029563d86254e33b97e7149a49dd767&scope.project.id=4bec9401bcfa489d98020b66bccfa487&role.id=bcbedb9e465844d2a8baa6af3760e916 => generated 260 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:10.230009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c9725-2760-4e79-9b5d-57c96a55b061 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.230009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c9725-2760-4e79-9b5d-57c96a55b061 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.230009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c9725-2760-4e79-9b5d-57c96a55b061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.239132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-4af95763-215f-4e42-a040-2efaad416884 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:10.240594 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4af95763-215f-4e42-a040-2efaad416884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:10.253483 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 175/350] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:10.258831 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-6a5c9725-2760-4e79-9b5d-57c96a55b061 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:10.260577 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6a5c9725-2760-4e79-9b5d-57c96a55b061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:10.268757 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 176/351] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:10.287215 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af95763-215f-4e42-a040-2efaad416884 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.297689 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af95763-215f-4e42-a040-2efaad416884 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.302589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a54c14-ac0d-4f59-b99a-464ea9a72017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.303661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a54c14-ac0d-4f59-b99a-464ea9a72017 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.304181 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a54c14-ac0d-4f59-b99a-464ea9a72017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.304622 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a54c14-ac0d-4f59-b99a-464ea9a72017 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.310404 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c9725-2760-4e79-9b5d-57c96a55b061 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.320523 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c9725-2760-4e79-9b5d-57c96a55b061 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.325324 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cce58-d9cc-4d70-bc82-6473e066596c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.326578 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cce58-d9cc-4d70-bc82-6473e066596c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.327092 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a54c14-ac0d-4f59-b99a-464ea9a72017 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:10.327202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cce58-d9cc-4d70-bc82-6473e066596c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.327623 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cce58-d9cc-4d70-bc82-6473e066596c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.334247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-f0a54c14-ac0d-4f59-b99a-464ea9a72017 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:51:10.335459 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 176/352] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:10.341234 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cce58-d9cc-4d70-bc82-6473e066596c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:10.343832 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a54c14-ac0d-4f59-b99a-464ea9a72017 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.353066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-5e2cce58-d9cc-4d70-bc82-6473e066596c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:51:10.354673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 177/353] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:10.363513 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cce58-d9cc-4d70-bc82-6473e066596c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.366868 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a54c14-ac0d-4f59-b99a-464ea9a72017 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.375838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24333f41-b5db-4ffd-b00b-1de11f11ca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.376509 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24333f41-b5db-4ffd-b00b-1de11f11ca68 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.376675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cce58-d9cc-4d70-bc82-6473e066596c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.376772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24333f41-b5db-4ffd-b00b-1de11f11ca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.377054 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24333f41-b5db-4ffd-b00b-1de11f11ca68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.377821 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24333f41-b5db-4ffd-b00b-1de11f11ca68 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:10.378159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24333f41-b5db-4ffd-b00b-1de11f11ca68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:10.379794 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24333f41-b5db-4ffd-b00b-1de11f11ca68 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:10.383625 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e97bda-69bd-4b28-ba0a-8905887d36d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.384615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e97bda-69bd-4b28-ba0a-8905887d36d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.385393 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e97bda-69bd-4b28-ba0a-8905887d36d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.385835 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e97bda-69bd-4b28-ba0a-8905887d36d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.386904 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e97bda-69bd-4b28-ba0a-8905887d36d8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:10.387877 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e97bda-69bd-4b28-ba0a-8905887d36d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:10.389951 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e97bda-69bd-4b28-ba0a-8905887d36d8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:10.397472 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 177/354] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:10.404429 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 178/355] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:10.404675 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24333f41-b5db-4ffd-b00b-1de11f11ca68 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.416481 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e97bda-69bd-4b28-ba0a-8905887d36d8 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.428396 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e97bda-69bd-4b28-ba0a-8905887d36d8 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.428613 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24333f41-b5db-4ffd-b00b-1de11f11ca68 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.435201 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c21d20-d78a-4c79-9a59-72f260b130ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.436114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c21d20-d78a-4c79-9a59-72f260b130ad admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.436648 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c21d20-d78a-4c79-9a59-72f260b130ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.437137 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c21d20-d78a-4c79-9a59-72f260b130ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.439891 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148071a1-5185-4511-b96f-0d5143aa2cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.440536 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148071a1-5185-4511-b96f-0d5143aa2cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.440818 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148071a1-5185-4511-b96f-0d5143aa2cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.441089 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148071a1-5185-4511-b96f-0d5143aa2cc6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.447633 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c21d20-d78a-4c79-9a59-72f260b130ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:10.449775 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c21d20-d78a-4c79-9a59-72f260b130ad admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:10.463165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148071a1-5185-4511-b96f-0d5143aa2cc6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:10.464937 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148071a1-5185-4511-b96f-0d5143aa2cc6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:10.465573 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 179/356] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:10.477382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c21d20-d78a-4c79-9a59-72f260b130ad admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.480692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 178/357] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 02:51:10.488419 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148071a1-5185-4511-b96f-0d5143aa2cc6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.488900 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c21d20-d78a-4c79-9a59-72f260b130ad admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.494006 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b268fa-1508-4d28-b5f2-cece46665adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.495177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b268fa-1508-4d28-b5f2-cece46665adc admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.495677 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b268fa-1508-4d28-b5f2-cece46665adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.496195 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b268fa-1508-4d28-b5f2-cece46665adc admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.497641 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b268fa-1508-4d28-b5f2-cece46665adc admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:10.500794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b268fa-1508-4d28-b5f2-cece46665adc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:10.503080 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 180/358] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:10.505298 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148071a1-5185-4511-b96f-0d5143aa2cc6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.510783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b268fa-1508-4d28-b5f2-cece46665adc admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.516014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fd73a-7c2d-4a4e-b607-894816784c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.516877 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fd73a-7c2d-4a4e-b607-894816784c7b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.517158 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fd73a-7c2d-4a4e-b607-894816784c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.517431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fd73a-7c2d-4a4e-b607-894816784c7b admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.522987 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fd73a-7c2d-4a4e-b607-894816784c7b admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:10.524573 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b268fa-1508-4d28-b5f2-cece46665adc admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.525053 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fd73a-7c2d-4a4e-b607-894816784c7b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:10.527032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 179/359] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:10.533125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20f0ba-31a1-46aa-b606-777b265f077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.534975 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20f0ba-31a1-46aa-b606-777b265f077a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.535192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fd73a-7c2d-4a4e-b607-894816784c7b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.535918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20f0ba-31a1-46aa-b606-777b265f077a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.536519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20f0ba-31a1-46aa-b606-777b265f077a admin admin] PATH_INFO: `/v3/groups/5029563d86254e33b97e7149a49dd767` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.538056 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20f0ba-31a1-46aa-b606-777b265f077a admin admin] RBAC: Authorizing `identity:get_group(group_id=5029563d86254e33b97e7149a49dd767)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:10.539538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-bf20f0ba-31a1-46aa-b606-777b265f077a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:10.539538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:51:10.539538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:51:10.541086 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20f0ba-31a1-46aa-b606-777b265f077a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:10.543688 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 181/360] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/groups/5029563d86254e33b97e7149a49dd767 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:10.551446 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20f0ba-31a1-46aa-b606-777b265f077a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.559758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fd73a-7c2d-4a4e-b607-894816784c7b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.567383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20f0ba-31a1-46aa-b606-777b265f077a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.571085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcfce4-336b-446d-a9be-0f4168b83453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.571929 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcfce4-336b-446d-a9be-0f4168b83453 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.572207 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcfce4-336b-446d-a9be-0f4168b83453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.572481 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcfce4-336b-446d-a9be-0f4168b83453 admin admin] PATH_INFO: `/v3/groups/5029563d86254e33b97e7149a49dd767` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.573949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcfce4-336b-446d-a9be-0f4168b83453 admin admin] RBAC: Authorizing `identity:get_group(group_id=5029563d86254e33b97e7149a49dd767)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:10.578598 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcfce4-336b-446d-a9be-0f4168b83453 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:10.580510 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 180/361] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/groups/5029563d86254e33b97e7149a49dd767 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:10.586947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcfce4-336b-446d-a9be-0f4168b83453 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.587473 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab481a1-4627-402d-b3d1-ab22d3bc6ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.588142 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab481a1-4627-402d-b3d1-ab22d3bc6ccb admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.588421 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab481a1-4627-402d-b3d1-ab22d3bc6ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.588696 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab481a1-4627-402d-b3d1-ab22d3bc6ccb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.589558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab481a1-4627-402d-b3d1-ab22d3bc6ccb admin admin] RBAC: Adding query filter params (group.id=5029563d86254e33b97e7149a49dd767, role.id=69edf382652b443c97811919233bb991, scope.project.id=4bec9401bcfa489d98020b66bccfa487) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:10.589868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab481a1-4627-402d-b3d1-ab22d3bc6ccb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:10.591811 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab481a1-4627-402d-b3d1-ab22d3bc6ccb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:10.600115 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 182/362] 10.222.0.18 () {56 vars in 1397 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/role_assignments?group.id=5029563d86254e33b97e7149a49dd767&scope.project.id=4bec9401bcfa489d98020b66bccfa487&role.id=69edf382652b443c97811919233bb991 => generated 260 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:10.604773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcfce4-336b-446d-a9be-0f4168b83453 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.618998 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f966f-46b8-4153-8333-eaed9c340e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.619599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f966f-46b8-4153-8333-eaed9c340e31 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.619883 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f966f-46b8-4153-8333-eaed9c340e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.620169 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f966f-46b8-4153-8333-eaed9c340e31 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.621053 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f966f-46b8-4153-8333-eaed9c340e31 admin admin] RBAC: Adding query filter params (group.id=5029563d86254e33b97e7149a49dd767, role.id=69edf382652b443c97811919233bb991, scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:10.621373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f966f-46b8-4153-8333-eaed9c340e31 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:10.624108 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f966f-46b8-4153-8333-eaed9c340e31 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:10.636106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 181/363] 10.222.0.18 () {56 vars in 1397 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/role_assignments?group.id=5029563d86254e33b97e7149a49dd767&scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0&role.id=69edf382652b443c97811919233bb991 => generated 260 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:10.897212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191baa9e-4d9b-4312-acb7-de1b1d3b6f51 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.897397 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191baa9e-4d9b-4312-acb7-de1b1d3b6f51 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.897681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191baa9e-4d9b-4312-acb7-de1b1d3b6f51 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.899755 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 183/364] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:10.906542 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49415885-b73b-4ee3-8a3d-cabeba2ac90f None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.907169 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49415885-b73b-4ee3-8a3d-cabeba2ac90f None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.907643 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49415885-b73b-4ee3-8a3d-cabeba2ac90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:10.930797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-49415885-b73b-4ee3-8a3d-cabeba2ac90f None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:10.932404 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-49415885-b73b-4ee3-8a3d-cabeba2ac90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:10.944074 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 182/365] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:10.967492 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191baa9e-4d9b-4312-acb7-de1b1d3b6f51 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:10.985183 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191baa9e-4d9b-4312-acb7-de1b1d3b6f51 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:10.994128 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ab2cc-ae10-4c6f-8611-e9408d924cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:10.994947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ab2cc-ae10-4c6f-8611-e9408d924cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:10.995228 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ab2cc-ae10-4c6f-8611-e9408d924cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:10.995557 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ab2cc-ae10-4c6f-8611-e9408d924cd4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:11.010627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ab2cc-ae10-4c6f-8611-e9408d924cd4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:11.018430 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-0c4ab2cc-ae10-4c6f-8611-e9408d924cd4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 02:51:11.019646 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 184/366] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:51:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:11.026398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49415885-b73b-4ee3-8a3d-cabeba2ac90f None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:11.035818 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49415885-b73b-4ee3-8a3d-cabeba2ac90f None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:11.041406 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e5fe4-0398-4720-94d8-bc4c5166fdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:11.042324 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e5fe4-0398-4720-94d8-bc4c5166fdd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:11.042798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e5fe4-0398-4720-94d8-bc4c5166fdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:11.043281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e5fe4-0398-4720-94d8-bc4c5166fdd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:11.046643 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e5fe4-0398-4720-94d8-bc4c5166fdd3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:11.050145 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e5fe4-0398-4720-94d8-bc4c5166fdd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:11.050145 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e5fe4-0398-4720-94d8-bc4c5166fdd3 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:11.057501 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 183/367] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:11.063855 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ab2cc-ae10-4c6f-8611-e9408d924cd4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:11.074310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ab2cc-ae10-4c6f-8611-e9408d924cd4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:11.080274 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92802549-9ba6-4dee-a1c9-98a4fab5e4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:11.080911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92802549-9ba6-4dee-a1c9-98a4fab5e4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:11.081193 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92802549-9ba6-4dee-a1c9-98a4fab5e4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:11.081467 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92802549-9ba6-4dee-a1c9-98a4fab5e4c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:11.091735 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92802549-9ba6-4dee-a1c9-98a4fab5e4c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:11.093558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92802549-9ba6-4dee-a1c9-98a4fab5e4c8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:11.108599 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 185/368] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:11.114526 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e5fe4-0398-4720-94d8-bc4c5166fdd3 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:11.124755 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e5fe4-0398-4720-94d8-bc4c5166fdd3 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:11.131113 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4169fa-4492-4e59-8801-6864e991b61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:11.131960 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4169fa-4492-4e59-8801-6864e991b61b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:11.132243 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4169fa-4492-4e59-8801-6864e991b61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:11.132519 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4169fa-4492-4e59-8801-6864e991b61b admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:11.133702 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4169fa-4492-4e59-8801-6864e991b61b admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:11.136047 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4169fa-4492-4e59-8801-6864e991b61b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:11.137686 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 184/369] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:11 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:11.144345 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92802549-9ba6-4dee-a1c9-98a4fab5e4c8 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:11.153414 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92802549-9ba6-4dee-a1c9-98a4fab5e4c8 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:11.162029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58253503-0105-45b8-9daa-ee5abaca06a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:11.162885 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58253503-0105-45b8-9daa-ee5abaca06a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:11.163169 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58253503-0105-45b8-9daa-ee5abaca06a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:11.163443 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58253503-0105-45b8-9daa-ee5abaca06a3 admin admin] PATH_INFO: `/v3/groups/5029563d86254e33b97e7149a49dd767` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:11.164672 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58253503-0105-45b8-9daa-ee5abaca06a3 admin admin] RBAC: Authorizing `identity:get_group(group_id=5029563d86254e33b97e7149a49dd767)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:11.166655 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58253503-0105-45b8-9daa-ee5abaca06a3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:11.168264 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 186/370] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Dec 15 02:51:11 2021] GET /identity/v3/groups/5029563d86254e33b97e7149a49dd767 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:11.174663 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4169fa-4492-4e59-8801-6864e991b61b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:11.186959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4169fa-4492-4e59-8801-6864e991b61b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:11.191389 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1310a-01af-48f6-8e75-2ccf21419adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:11.192034 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1310a-01af-48f6-8e75-2ccf21419adf admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:11.192313 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1310a-01af-48f6-8e75-2ccf21419adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:11.192586 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1310a-01af-48f6-8e75-2ccf21419adf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:11.193430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1310a-01af-48f6-8e75-2ccf21419adf admin admin] RBAC: Adding query filter params (group.id=5029563d86254e33b97e7149a49dd767, role.id=bcbedb9e465844d2a8baa6af3760e916, scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:11.193738 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1310a-01af-48f6-8e75-2ccf21419adf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:11.195601 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1310a-01af-48f6-8e75-2ccf21419adf admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:11.214042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 185/371] 10.222.0.18 () {56 vars in 1397 bytes} [Wed Dec 15 02:51:11 2021] GET /identity/v3/role_assignments?group.id=5029563d86254e33b97e7149a49dd767&scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0&role.id=bcbedb9e465844d2a8baa6af3760e916 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:11.460890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494f62e-924e-454a-a16b-ae814aa00c70 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:11.461581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494f62e-924e-454a-a16b-ae814aa00c70 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:11.461581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494f62e-924e-454a-a16b-ae814aa00c70 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:11.463306 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 187/372] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:11.469743 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202af84-d1fa-4575-afb5-deab23744b4d None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:11.470118 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202af84-d1fa-4575-afb5-deab23744b4d None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:11.470324 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202af84-d1fa-4575-afb5-deab23744b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:11.494796 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-f202af84-d1fa-4575-afb5-deab23744b4d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:11.495992 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f202af84-d1fa-4575-afb5-deab23744b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:11.506252 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 186/373] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:11.539190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494f62e-924e-454a-a16b-ae814aa00c70 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:11.551992 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494f62e-924e-454a-a16b-ae814aa00c70 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:11.562148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1784e3-e5ef-4cf8-ba88-7abec0c9c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:11.562868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1784e3-e5ef-4cf8-ba88-7abec0c9c5fe admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:11.563145 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1784e3-e5ef-4cf8-ba88-7abec0c9c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:11.563414 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1784e3-e5ef-4cf8-ba88-7abec0c9c5fe admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:11.574220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1784e3-e5ef-4cf8-ba88-7abec0c9c5fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:11.581085 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-5f1784e3-e5ef-4cf8-ba88-7abec0c9c5fe admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:51:11.582616 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 188/374] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:51:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:11.588548 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202af84-d1fa-4575-afb5-deab23744b4d None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:11.597549 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202af84-d1fa-4575-afb5-deab23744b4d None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:11.603971 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de485721-6923-42db-b299-d1b1d4968f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:11.604627 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de485721-6923-42db-b299-d1b1d4968f4e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:11.604910 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de485721-6923-42db-b299-d1b1d4968f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:11.605190 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de485721-6923-42db-b299-d1b1d4968f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:11.605952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de485721-6923-42db-b299-d1b1d4968f4e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:11.606285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de485721-6923-42db-b299-d1b1d4968f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:11.607878 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de485721-6923-42db-b299-d1b1d4968f4e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:11.617102 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 187/375] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:11.622837 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1784e3-e5ef-4cf8-ba88-7abec0c9c5fe admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:11.633118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1784e3-e5ef-4cf8-ba88-7abec0c9c5fe admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:11.641532 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee382d-56fa-432c-88af-9f2e2f531284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:11.642192 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee382d-56fa-432c-88af-9f2e2f531284 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:11.642474 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee382d-56fa-432c-88af-9f2e2f531284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:11.642749 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee382d-56fa-432c-88af-9f2e2f531284 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:11.652239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee382d-56fa-432c-88af-9f2e2f531284 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:11.654018 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee382d-56fa-432c-88af-9f2e2f531284 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:11.663389 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 189/376] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:11.669123 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de485721-6923-42db-b299-d1b1d4968f4e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:11.679442 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de485721-6923-42db-b299-d1b1d4968f4e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:11.683850 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda48dd2-fac4-4333-b08f-b260f8f29d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:11.684721 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda48dd2-fac4-4333-b08f-b260f8f29d2a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:11.684975 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda48dd2-fac4-4333-b08f-b260f8f29d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:11.685252 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda48dd2-fac4-4333-b08f-b260f8f29d2a admin admin] PATH_INFO: `/v3/projects/f289697819814b2daa5373dc010a1dbf` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:11.687044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda48dd2-fac4-4333-b08f-b260f8f29d2a admin admin] RBAC: Authorizing `identity:get_project(project_id=f289697819814b2daa5373dc010a1dbf)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:11.688835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda48dd2-fac4-4333-b08f-b260f8f29d2a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:11.690785 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 188/377] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:11 2021] GET /identity/v3/projects/f289697819814b2daa5373dc010a1dbf => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:11.696441 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee382d-56fa-432c-88af-9f2e2f531284 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:11.705501 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee382d-56fa-432c-88af-9f2e2f531284 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:11.713764 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5851e-c69e-489a-ba8f-b26af5c0c79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:11.714602 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5851e-c69e-489a-ba8f-b26af5c0c79b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:11.714881 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5851e-c69e-489a-ba8f-b26af5c0c79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:11.715157 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5851e-c69e-489a-ba8f-b26af5c0c79b admin admin] PATH_INFO: `/v3/groups/910ded1ad6ec4c928f163555e3cd3253` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:11.724114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5851e-c69e-489a-ba8f-b26af5c0c79b admin admin] RBAC: Authorizing `identity:get_group(group_id=910ded1ad6ec4c928f163555e3cd3253)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:11.726028 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5851e-c69e-489a-ba8f-b26af5c0c79b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:11.728054 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 190/378] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Dec 15 02:51:11 2021] GET /identity/v3/groups/910ded1ad6ec4c928f163555e3cd3253 => generated 229 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:11.734624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda48dd2-fac4-4333-b08f-b260f8f29d2a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:11.749168 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda48dd2-fac4-4333-b08f-b260f8f29d2a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:11.753615 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385483f-2e5d-48d1-886a-e568b20f91ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:11.754294 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385483f-2e5d-48d1-886a-e568b20f91ab admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:11.754580 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385483f-2e5d-48d1-886a-e568b20f91ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:11.754857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385483f-2e5d-48d1-886a-e568b20f91ab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:11.755701 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385483f-2e5d-48d1-886a-e568b20f91ab admin admin] RBAC: Adding query filter params (group.id=910ded1ad6ec4c928f163555e3cd3253, role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=f289697819814b2daa5373dc010a1dbf) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:11.756006 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385483f-2e5d-48d1-886a-e568b20f91ab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:11.757844 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385483f-2e5d-48d1-886a-e568b20f91ab admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:11.776046 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 189/379] 10.222.0.18 () {56 vars in 1397 bytes} [Wed Dec 15 02:51:11 2021] GET /identity/v3/role_assignments?group.id=910ded1ad6ec4c928f163555e3cd3253&scope.project.id=f289697819814b2daa5373dc010a1dbf&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:13.633004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b9da2-c87d-455c-a668-6b4591b8a80e None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.633537 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b9da2-c87d-455c-a668-6b4591b8a80e None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.633537 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b9da2-c87d-455c-a668-6b4591b8a80e None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.635900 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 191/380] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:13.642091 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa638369-5d3f-4b7f-a834-7760a517e487 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.642516 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa638369-5d3f-4b7f-a834-7760a517e487 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.642684 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa638369-5d3f-4b7f-a834-7760a517e487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.666972 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-fa638369-5d3f-4b7f-a834-7760a517e487 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:13.668178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-fa638369-5d3f-4b7f-a834-7760a517e487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:13.676284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 190/381] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:13.713198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b9da2-c87d-455c-a668-6b4591b8a80e None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:13.726330 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5784d-fe28-4d2e-8359-571a84fcaf08 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.726624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5784d-fe28-4d2e-8359-571a84fcaf08 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.726877 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5784d-fe28-4d2e-8359-571a84fcaf08 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.728814 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 191/382] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:13.731441 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b9da2-c87d-455c-a668-6b4591b8a80e None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:13.735599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b69f5f-cfd6-493d-b56b-81dbfc2bcbca None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.736107 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b69f5f-cfd6-493d-b56b-81dbfc2bcbca None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.736573 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b69f5f-cfd6-493d-b56b-81dbfc2bcbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.738626 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e926be0-731b-45ec-9db0-35b9c911530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:13.739408 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e926be0-731b-45ec-9db0-35b9c911530f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.739690 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e926be0-731b-45ec-9db0-35b9c911530f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.739959 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e926be0-731b-45ec-9db0-35b9c911530f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.756450 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e926be0-731b-45ec-9db0-35b9c911530f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:13.758113 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-33b69f5f-cfd6-493d-b56b-81dbfc2bcbca None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:13.759479 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-33b69f5f-cfd6-493d-b56b-81dbfc2bcbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:13.763572 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-3e926be0-731b-45ec-9db0-35b9c911530f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:51:13.770668 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 192/383] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:13.771842 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e926be0-731b-45ec-9db0-35b9c911530f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:13.781890 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 192/384] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:13.788498 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e926be0-731b-45ec-9db0-35b9c911530f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:13.795469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed378d-7d23-4953-ba0f-5048ad24c3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:13.796658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed378d-7d23-4953-ba0f-5048ad24c3db admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.796939 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed378d-7d23-4953-ba0f-5048ad24c3db admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.797229 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed378d-7d23-4953-ba0f-5048ad24c3db admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.797972 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed378d-7d23-4953-ba0f-5048ad24c3db admin admin] RBAC: Adding query filter params (name=member) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:13.798299 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed378d-7d23-4953-ba0f-5048ad24c3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:13.799897 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed378d-7d23-4953-ba0f-5048ad24c3db admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:13.809824 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b69f5f-cfd6-493d-b56b-81dbfc2bcbca None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:13.821245 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b69f5f-cfd6-493d-b56b-81dbfc2bcbca None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:13.824480 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 193/385] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:51:13 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:13.825819 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfe4ee-eedc-46a0-890e-cbb59aa2777a None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.827930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfe4ee-eedc-46a0-890e-cbb59aa2777a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.828226 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfe4ee-eedc-46a0-890e-cbb59aa2777a None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.830026 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 194/386] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:13.830721 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfe4ee-eedc-46a0-890e-cbb59aa2777a None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:13.831548 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fa8af-7849-48f9-8dea-1083f90df1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:13.832610 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fa8af-7849-48f9-8dea-1083f90df1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.833093 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fa8af-7849-48f9-8dea-1083f90df1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.833578 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fa8af-7849-48f9-8dea-1083f90df1f4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.850422 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfe4ee-eedc-46a0-890e-cbb59aa2777a None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:13.851280 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fa8af-7849-48f9-8dea-1083f90df1f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:13.857463 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc2150-2d52-42ef-b21d-acd02e5c4aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:13.858859 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc2150-2d52-42ef-b21d-acd02e5c4aab admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.859141 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc2150-2d52-42ef-b21d-acd02e5c4aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.859412 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc2150-2d52-42ef-b21d-acd02e5c4aab admin admin] PATH_INFO: `/v3/groups/5029563d86254e33b97e7149a49dd767` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.860261 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-b65fa8af-7849-48f9-8dea-1083f90df1f4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 02:51:13.860982 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc2150-2d52-42ef-b21d-acd02e5c4aab admin admin] RBAC: Authorizing `identity:get_group(group_id=5029563d86254e33b97e7149a49dd767)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:13.862201 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 193/387] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:51:13 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:13.862967 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc2150-2d52-42ef-b21d-acd02e5c4aab admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:13.863830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb935a3-b165-4c0b-9cb3-68ae32122ab6 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.864322 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb935a3-b165-4c0b-9cb3-68ae32122ab6 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.864794 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb935a3-b165-4c0b-9cb3-68ae32122ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.864897 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 195/388] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Dec 15 02:51:13 2021] GET /identity/v3/groups/5029563d86254e33b97e7149a49dd767 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:13.871050 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc2150-2d52-42ef-b21d-acd02e5c4aab admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:13.882762 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc2150-2d52-42ef-b21d-acd02e5c4aab admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:13.885000 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-afb935a3-b165-4c0b-9cb3-68ae32122ab6 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:13.886465 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-afb935a3-b165-4c0b-9cb3-68ae32122ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:13.893015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c3f65-da70-4110-9a36-36e8802e2d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:13.897906 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c3f65-da70-4110-9a36-36e8802e2d51 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.897906 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c3f65-da70-4110-9a36-36e8802e2d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.897906 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c3f65-da70-4110-9a36-36e8802e2d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.897906 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c3f65-da70-4110-9a36-36e8802e2d51 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:13.897906 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c3f65-da70-4110-9a36-36e8802e2d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:13.898350 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 194/389] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:13.898423 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c3f65-da70-4110-9a36-36e8802e2d51 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:13.898490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb935a3-b165-4c0b-9cb3-68ae32122ab6 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:13.906576 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 196/390] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:13 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:13.907318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb9e7e-2aa7-4af6-a568-ad16c066a3a6 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.907604 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb9e7e-2aa7-4af6-a568-ad16c066a3a6 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.907888 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb9e7e-2aa7-4af6-a568-ad16c066a3a6 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.909477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb935a3-b165-4c0b-9cb3-68ae32122ab6 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:13.909744 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 197/391] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:13.911935 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb9e7e-2aa7-4af6-a568-ad16c066a3a6 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:13.919017 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88875bba-aeb9-443b-babd-cec660539073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:13.920256 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88875bba-aeb9-443b-babd-cec660539073 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.920712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88875bba-aeb9-443b-babd-cec660539073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.921690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88875bba-aeb9-443b-babd-cec660539073 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.923116 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88875bba-aeb9-443b-babd-cec660539073 admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:13.926320 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88875bba-aeb9-443b-babd-cec660539073 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:13.928227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 195/392] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:13 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:13.929625 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f128239-da7d-4ae5-bf88-45ac223c16f3 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.930212 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f128239-da7d-4ae5-bf88-45ac223c16f3 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.930595 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb9e7e-2aa7-4af6-a568-ad16c066a3a6 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:13.930870 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f128239-da7d-4ae5-bf88-45ac223c16f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.935026 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683e63b-66b1-4915-bdc6-aa45bdbe3210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:13.935859 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683e63b-66b1-4915-bdc6-aa45bdbe3210 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.936138 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683e63b-66b1-4915-bdc6-aa45bdbe3210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.937083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683e63b-66b1-4915-bdc6-aa45bdbe3210 admin admin] PATH_INFO: `/v3/groups/5029563d86254e33b97e7149a49dd767` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.938309 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683e63b-66b1-4915-bdc6-aa45bdbe3210 admin admin] RBAC: Authorizing `identity:get_group(group_id=5029563d86254e33b97e7149a49dd767)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:13.940196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683e63b-66b1-4915-bdc6-aa45bdbe3210 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:13.941795 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 198/393] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Dec 15 02:51:13 2021] GET /identity/v3/groups/5029563d86254e33b97e7149a49dd767 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:13.942568 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683e63b-66b1-4915-bdc6-aa45bdbe3210 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:13.951927 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683e63b-66b1-4915-bdc6-aa45bdbe3210 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:13.953115 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-9f128239-da7d-4ae5-bf88-45ac223c16f3 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:13.954806 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-9f128239-da7d-4ae5-bf88-45ac223c16f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:13.956515 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52925062-a195-4817-87c9-8c0c50e53106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:13.957311 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52925062-a195-4817-87c9-8c0c50e53106 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.957599 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52925062-a195-4817-87c9-8c0c50e53106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.957879 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52925062-a195-4817-87c9-8c0c50e53106 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.964930 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 196/394] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:13.965778 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f128239-da7d-4ae5-bf88-45ac223c16f3 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:13.980281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f128239-da7d-4ae5-bf88-45ac223c16f3 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:13.981441 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52925062-a195-4817-87c9-8c0c50e53106 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:13.986210 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d606ad0-e3e9-48eb-9d09-7b35faf43437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:13.987308 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d606ad0-e3e9-48eb-9d09-7b35faf43437 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:13.987812 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d606ad0-e3e9-48eb-9d09-7b35faf43437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:13.988284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d606ad0-e3e9-48eb-9d09-7b35faf43437 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487/groups/5029563d86254e33b97e7149a49dd767/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:13.989061 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-52925062-a195-4817-87c9-8c0c50e53106 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:51:13.994010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 199/395] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:13.994010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52925062-a195-4817-87c9-8c0c50e53106 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:13.995159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d606ad0-e3e9-48eb-9d09-7b35faf43437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bec9401bcfa489d98020b66bccfa487, group_id=5029563d86254e33b97e7149a49dd767, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:13.998210 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d606ad0-e3e9-48eb-9d09-7b35faf43437 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:14.008174 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52925062-a195-4817-87c9-8c0c50e53106 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:14.016501 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 197/396] 10.222.0.18 () {58 vars in 1463 bytes} [Wed Dec 15 02:51:13 2021] PUT /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487/groups/5029563d86254e33b97e7149a49dd767/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:51:14.016501 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d606ad0-e3e9-48eb-9d09-7b35faf43437 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:14.087546 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516c9ab-7514-42ee-9e51-2c28c7b4a91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:14.088660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516c9ab-7514-42ee-9e51-2c28c7b4a91a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:14.089106 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516c9ab-7514-42ee-9e51-2c28c7b4a91a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:14.089516 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516c9ab-7514-42ee-9e51-2c28c7b4a91a admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:14.091409 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516c9ab-7514-42ee-9e51-2c28c7b4a91a admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:14.095212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516c9ab-7514-42ee-9e51-2c28c7b4a91a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:14.096523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d606ad0-e3e9-48eb-9d09-7b35faf43437 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:14.098006 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 200/397] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:13 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:14.099169 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516c9ab-7514-42ee-9e51-2c28c7b4a91a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:14.102411 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339b0fe-1746-4477-bf68-efd779c6c7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:14.103242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339b0fe-1746-4477-bf68-efd779c6c7ab admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:14.103664 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339b0fe-1746-4477-bf68-efd779c6c7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:14.104125 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339b0fe-1746-4477-bf68-efd779c6c7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:14.105046 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339b0fe-1746-4477-bf68-efd779c6c7ab admin admin] RBAC: Adding query filter params (name=member) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:14.105457 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339b0fe-1746-4477-bf68-efd779c6c7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:14.107396 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339b0fe-1746-4477-bf68-efd779c6c7ab admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:14.112718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516c9ab-7514-42ee-9e51-2c28c7b4a91a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:14.118386 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b15c3f-d6a1-4bf3-b353-35eb31aba0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:14.118589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 198/398] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:51:14 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:14.119522 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b15c3f-d6a1-4bf3-b353-35eb31aba0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:14.119639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339b0fe-1746-4477-bf68-efd779c6c7ab admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:14.120038 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b15c3f-d6a1-4bf3-b353-35eb31aba0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:14.120551 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b15c3f-d6a1-4bf3-b353-35eb31aba0f9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:14.133942 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b15c3f-d6a1-4bf3-b353-35eb31aba0f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:14.136097 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339b0fe-1746-4477-bf68-efd779c6c7ab admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:14.143130 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-62b15c3f-d6a1-4bf3-b353-35eb31aba0f9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 02:51:14.144015 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302886b6-5e4b-4887-a647-5ecb745fead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:14.144791 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 201/399] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:51:14 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:14.145116 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302886b6-5e4b-4887-a647-5ecb745fead4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:14.145496 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302886b6-5e4b-4887-a647-5ecb745fead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:14.145877 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302886b6-5e4b-4887-a647-5ecb745fead4 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487/groups/5029563d86254e33b97e7149a49dd767/roles/bcbedb9e465844d2a8baa6af3760e916` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:14.146194 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b15c3f-d6a1-4bf3-b353-35eb31aba0f9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:14.148539 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302886b6-5e4b-4887-a647-5ecb745fead4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bec9401bcfa489d98020b66bccfa487, group_id=5029563d86254e33b97e7149a49dd767, role_id=bcbedb9e465844d2a8baa6af3760e916)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:14.151594 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302886b6-5e4b-4887-a647-5ecb745fead4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:14.158153 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b15c3f-d6a1-4bf3-b353-35eb31aba0f9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:14.166805 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e263e-2680-4cfd-8786-4c1a2973dcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:14.168011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e263e-2680-4cfd-8786-4c1a2973dcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:14.168483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e263e-2680-4cfd-8786-4c1a2973dcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:14.168901 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e263e-2680-4cfd-8786-4c1a2973dcb8 admin admin] PATH_INFO: `/v3/groups/5029563d86254e33b97e7149a49dd767` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:14.170223 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 199/400] 10.222.0.18 () {58 vars in 1463 bytes} [Wed Dec 15 02:51:14 2021] PUT /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487/groups/5029563d86254e33b97e7149a49dd767/roles/bcbedb9e465844d2a8baa6af3760e916 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:51:14.171391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e263e-2680-4cfd-8786-4c1a2973dcb8 admin admin] RBAC: Authorizing `identity:get_group(group_id=5029563d86254e33b97e7149a49dd767)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:14.171722 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302886b6-5e4b-4887-a647-5ecb745fead4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:14.174177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e263e-2680-4cfd-8786-4c1a2973dcb8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:14.176222 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 202/401] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Dec 15 02:51:14 2021] GET /identity/v3/groups/5029563d86254e33b97e7149a49dd767 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:14.186539 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e263e-2680-4cfd-8786-4c1a2973dcb8 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:14.209776 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e263e-2680-4cfd-8786-4c1a2973dcb8 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:14.296891 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302886b6-5e4b-4887-a647-5ecb745fead4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:14.302727 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b39b56-c12c-41f6-b801-85b9aef38924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:14.303470 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b39b56-c12c-41f6-b801-85b9aef38924 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:14.303757 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b39b56-c12c-41f6-b801-85b9aef38924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:14.304035 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b39b56-c12c-41f6-b801-85b9aef38924 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:14.306637 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b39b56-c12c-41f6-b801-85b9aef38924 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:14.306957 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b39b56-c12c-41f6-b801-85b9aef38924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:14.308604 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b39b56-c12c-41f6-b801-85b9aef38924 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:14.312547 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcedc9-3c28-4b60-9a45-bdd4cc2cc14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:14.312547 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcedc9-3c28-4b60-9a45-bdd4cc2cc14e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:14.312800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcedc9-3c28-4b60-9a45-bdd4cc2cc14e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:14.313609 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcedc9-3c28-4b60-9a45-bdd4cc2cc14e admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:14.315092 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcedc9-3c28-4b60-9a45-bdd4cc2cc14e admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:14.317167 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcedc9-3c28-4b60-9a45-bdd4cc2cc14e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:14.319318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 203/402] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:14 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:14.328796 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcedc9-3c28-4b60-9a45-bdd4cc2cc14e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:14.329262 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 200/403] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:14 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:14.337855 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b39b56-c12c-41f6-b801-85b9aef38924 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:14.346618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcedc9-3c28-4b60-9a45-bdd4cc2cc14e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:14.351977 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3d72f-00ae-469e-a0b4-4135d82afb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:14.353253 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3d72f-00ae-469e-a0b4-4135d82afb7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:14.353740 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3d72f-00ae-469e-a0b4-4135d82afb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:14.354300 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3d72f-00ae-469e-a0b4-4135d82afb7c admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0/groups/5029563d86254e33b97e7149a49dd767/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:14.354702 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b39b56-c12c-41f6-b801-85b9aef38924 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:14.356998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3d72f-00ae-469e-a0b4-4135d82afb7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec39c8c2a0a4950925dcf994f4875e0, group_id=5029563d86254e33b97e7149a49dd767, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:14.360759 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3d72f-00ae-469e-a0b4-4135d82afb7c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:14.361641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded960f7-ef16-4fa6-ada7-e7f71dcfa09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:14.362631 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded960f7-ef16-4fa6-ada7-e7f71dcfa09b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:14.363005 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded960f7-ef16-4fa6-ada7-e7f71dcfa09b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:14.363340 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded960f7-ef16-4fa6-ada7-e7f71dcfa09b admin admin] PATH_INFO: `/v3/groups/5029563d86254e33b97e7149a49dd767` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:14.364693 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded960f7-ef16-4fa6-ada7-e7f71dcfa09b admin admin] RBAC: Authorizing `identity:get_group(group_id=5029563d86254e33b97e7149a49dd767)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:14.366947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded960f7-ef16-4fa6-ada7-e7f71dcfa09b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:14.368958 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 201/404] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Dec 15 02:51:14 2021] GET /identity/v3/groups/5029563d86254e33b97e7149a49dd767 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:14.377095 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded960f7-ef16-4fa6-ada7-e7f71dcfa09b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:14.386007 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 204/405] 10.222.0.18 () {58 vars in 1463 bytes} [Wed Dec 15 02:51:14 2021] PUT /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0/groups/5029563d86254e33b97e7149a49dd767/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 02:51:14.390345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded960f7-ef16-4fa6-ada7-e7f71dcfa09b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:14.460804 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63d271-1a3c-48a8-ac50-686abd68b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:14.462108 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63d271-1a3c-48a8-ac50-686abd68b576 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:14.462626 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63d271-1a3c-48a8-ac50-686abd68b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:14.463118 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63d271-1a3c-48a8-ac50-686abd68b576 admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:14.464714 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63d271-1a3c-48a8-ac50-686abd68b576 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:14.467120 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63d271-1a3c-48a8-ac50-686abd68b576 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:14.469845 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 202/406] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:14 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:14.476345 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3d72f-00ae-469e-a0b4-4135d82afb7c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:14.494239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3d72f-00ae-469e-a0b4-4135d82afb7c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:14.502680 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804e258-153d-4132-b30b-9efe00cfc7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:14.503636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804e258-153d-4132-b30b-9efe00cfc7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:14.503964 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804e258-153d-4132-b30b-9efe00cfc7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:14.504241 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804e258-153d-4132-b30b-9efe00cfc7c9 admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0/groups/5029563d86254e33b97e7149a49dd767/roles/bcbedb9e465844d2a8baa6af3760e916` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:14.508324 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804e258-153d-4132-b30b-9efe00cfc7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec39c8c2a0a4950925dcf994f4875e0, group_id=5029563d86254e33b97e7149a49dd767, role_id=bcbedb9e465844d2a8baa6af3760e916)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:14.511509 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804e258-153d-4132-b30b-9efe00cfc7c9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:14.532862 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 205/407] 10.222.0.18 () {58 vars in 1463 bytes} [Wed Dec 15 02:51:14 2021] PUT /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0/groups/5029563d86254e33b97e7149a49dd767/roles/bcbedb9e465844d2a8baa6af3760e916 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:51:15.390807 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d91b82-9e5e-4036-994e-29d4a9c1457e None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:15.391823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d91b82-9e5e-4036-994e-29d4a9c1457e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:15.392333 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d91b82-9e5e-4036-994e-29d4a9c1457e None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:15.394351 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 203/408] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:15.400168 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565a433-0c3a-495c-af51-49334ffe9758 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:15.400594 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565a433-0c3a-495c-af51-49334ffe9758 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:15.400762 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565a433-0c3a-495c-af51-49334ffe9758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:15.423262 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c565a433-0c3a-495c-af51-49334ffe9758 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:15.424453 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c565a433-0c3a-495c-af51-49334ffe9758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:15.496882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 206/409] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:15.522123 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d91b82-9e5e-4036-994e-29d4a9c1457e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:15.534961 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d91b82-9e5e-4036-994e-29d4a9c1457e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:15.539536 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf1435-a5cb-426f-86e1-d0dc13bc9efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:15.540326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf1435-a5cb-426f-86e1-d0dc13bc9efd admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:15.540610 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf1435-a5cb-426f-86e1-d0dc13bc9efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:15.540887 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf1435-a5cb-426f-86e1-d0dc13bc9efd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:15.553179 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf1435-a5cb-426f-86e1-d0dc13bc9efd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:15.560475 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-8abf1435-a5cb-426f-86e1-d0dc13bc9efd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:51:15.561945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 204/410] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:51:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:15.568328 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565a433-0c3a-495c-af51-49334ffe9758 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:15.583090 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565a433-0c3a-495c-af51-49334ffe9758 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:15.590119 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1407d1b-fbb5-4a0a-a175-467086c2d3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:15.590774 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1407d1b-fbb5-4a0a-a175-467086c2d3df admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:15.591057 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1407d1b-fbb5-4a0a-a175-467086c2d3df admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:15.591331 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1407d1b-fbb5-4a0a-a175-467086c2d3df admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:15.592098 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1407d1b-fbb5-4a0a-a175-467086c2d3df admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:15.592405 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1407d1b-fbb5-4a0a-a175-467086c2d3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:15.594718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1407d1b-fbb5-4a0a-a175-467086c2d3df admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:15.605835 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 207/411] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:15.612637 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf1435-a5cb-426f-86e1-d0dc13bc9efd admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:15.625132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf1435-a5cb-426f-86e1-d0dc13bc9efd admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:15.635023 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0891240-2eb1-4016-951d-217c785b1ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:15.636155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0891240-2eb1-4016-951d-217c785b1ddd admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:15.636630 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0891240-2eb1-4016-951d-217c785b1ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:15.637226 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0891240-2eb1-4016-951d-217c785b1ddd admin admin] PATH_INFO: `/v3/groups/910ded1ad6ec4c928f163555e3cd3253` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:15.638708 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0891240-2eb1-4016-951d-217c785b1ddd admin admin] RBAC: Authorizing `identity:get_group(group_id=910ded1ad6ec4c928f163555e3cd3253)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:15.641445 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0891240-2eb1-4016-951d-217c785b1ddd admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:15.643633 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 205/412] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Dec 15 02:51:15 2021] GET /identity/v3/groups/910ded1ad6ec4c928f163555e3cd3253 => generated 229 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:15.650036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1407d1b-fbb5-4a0a-a175-467086c2d3df admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:15.668483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1407d1b-fbb5-4a0a-a175-467086c2d3df admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:15.678624 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45ce16-94a9-4b37-9b6a-e2986ee942f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:15.679793 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45ce16-94a9-4b37-9b6a-e2986ee942f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:15.680180 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45ce16-94a9-4b37-9b6a-e2986ee942f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:15.680583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45ce16-94a9-4b37-9b6a-e2986ee942f8 admin admin] PATH_INFO: `/v3/projects/f289697819814b2daa5373dc010a1dbf` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:15.683849 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45ce16-94a9-4b37-9b6a-e2986ee942f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=f289697819814b2daa5373dc010a1dbf)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:15.685894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45ce16-94a9-4b37-9b6a-e2986ee942f8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:15.688485 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 208/413] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:15 2021] GET /identity/v3/projects/f289697819814b2daa5373dc010a1dbf => generated 344 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:15.695151 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0891240-2eb1-4016-951d-217c785b1ddd admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:15.706473 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0891240-2eb1-4016-951d-217c785b1ddd admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:15.716655 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e65c7-a1a7-4f5e-8d33-e09d28b41b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:15.717900 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e65c7-a1a7-4f5e-8d33-e09d28b41b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:15.718494 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e65c7-a1a7-4f5e-8d33-e09d28b41b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:15.718966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e65c7-a1a7-4f5e-8d33-e09d28b41b47 admin admin] PATH_INFO: `/v3/projects/f289697819814b2daa5373dc010a1dbf/groups/910ded1ad6ec4c928f163555e3cd3253/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:15.721257 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e65c7-a1a7-4f5e-8d33-e09d28b41b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f289697819814b2daa5373dc010a1dbf, group_id=910ded1ad6ec4c928f163555e3cd3253, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:15.724317 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e65c7-a1a7-4f5e-8d33-e09d28b41b47 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:15.745662 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 206/414] 10.222.0.18 () {58 vars in 1463 bytes} [Wed Dec 15 02:51:15 2021] PUT /identity/v3/projects/f289697819814b2daa5373dc010a1dbf/groups/910ded1ad6ec4c928f163555e3cd3253/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 02:51:17.029525 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30903eb-906f-4b5d-9aef-d80015baaeea None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.030127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30903eb-906f-4b5d-9aef-d80015baaeea None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.030220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30903eb-906f-4b5d-9aef-d80015baaeea None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.031962 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 209/415] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:17.037956 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6976a8-1f94-4b24-895d-31f030dd2fe0 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.038794 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6976a8-1f94-4b24-895d-31f030dd2fe0 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.039353 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6976a8-1f94-4b24-895d-31f030dd2fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.065515 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-de6976a8-1f94-4b24-895d-31f030dd2fe0 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:17.067099 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-de6976a8-1f94-4b24-895d-31f030dd2fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:17.142898 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 207/416] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:17.178761 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30903eb-906f-4b5d-9aef-d80015baaeea None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.212598 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30903eb-906f-4b5d-9aef-d80015baaeea None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.220433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814b5ae-d176-4289-98de-ff5ec765b340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.221229 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814b5ae-d176-4289-98de-ff5ec765b340 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.221502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814b5ae-d176-4289-98de-ff5ec765b340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.221768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814b5ae-d176-4289-98de-ff5ec765b340 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.236629 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814b5ae-d176-4289-98de-ff5ec765b340 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:17.243866 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-0814b5ae-d176-4289-98de-ff5ec765b340 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 02:51:17.246589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 210/417] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:17.251329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6976a8-1f94-4b24-895d-31f030dd2fe0 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.268695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6976a8-1f94-4b24-895d-31f030dd2fe0 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.273533 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703f417-f902-43c5-a4be-81b53073dcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.274508 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703f417-f902-43c5-a4be-81b53073dcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.275008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703f417-f902-43c5-a4be-81b53073dcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.275474 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703f417-f902-43c5-a4be-81b53073dcb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.276426 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703f417-f902-43c5-a4be-81b53073dcb7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:17.276943 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703f417-f902-43c5-a4be-81b53073dcb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:17.282384 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703f417-f902-43c5-a4be-81b53073dcb7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:17.291979 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 208/418] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:17.298682 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814b5ae-d176-4289-98de-ff5ec765b340 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.316085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfae62-2bc5-467a-8bd3-cc33deb3e706 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.316396 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfae62-2bc5-467a-8bd3-cc33deb3e706 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.316639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfae62-2bc5-467a-8bd3-cc33deb3e706 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.318136 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814b5ae-d176-4289-98de-ff5ec765b340 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.318736 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 209/419] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:17.324773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195acbf-c4ba-4d25-ac10-e14bbb8aea43 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.325064 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195acbf-c4ba-4d25-ac10-e14bbb8aea43 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.325380 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195acbf-c4ba-4d25-ac10-e14bbb8aea43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.329505 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2c493-9295-454c-88a6-f7f474276c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.330181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2c493-9295-454c-88a6-f7f474276c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.330471 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2c493-9295-454c-88a6-f7f474276c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.330793 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2c493-9295-454c-88a6-f7f474276c22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.346148 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-8195acbf-c4ba-4d25-ac10-e14bbb8aea43 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:17.347369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-8195acbf-c4ba-4d25-ac10-e14bbb8aea43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:17.356600 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2c493-9295-454c-88a6-f7f474276c22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:17.359414 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2c493-9295-454c-88a6-f7f474276c22 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:17.361144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 210/420] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:51:17.380212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 211/421] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:17.383151 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195acbf-c4ba-4d25-ac10-e14bbb8aea43 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.398602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195acbf-c4ba-4d25-ac10-e14bbb8aea43 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.408329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be817548-d20f-4e89-89b1-f7bd013bdf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.409292 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be817548-d20f-4e89-89b1-f7bd013bdf11 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.409616 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be817548-d20f-4e89-89b1-f7bd013bdf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.409937 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be817548-d20f-4e89-89b1-f7bd013bdf11 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.412111 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be817548-d20f-4e89-89b1-f7bd013bdf11 admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:17.412730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2c493-9295-454c-88a6-f7f474276c22 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.414302 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be817548-d20f-4e89-89b1-f7bd013bdf11 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:17.416292 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 211/422] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:17.422105 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be817548-d20f-4e89-89b1-f7bd013bdf11 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.423453 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2c493-9295-454c-88a6-f7f474276c22 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.437704 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be817548-d20f-4e89-89b1-f7bd013bdf11 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.440211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57622963-7103-4206-904a-76008bba818c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.441060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57622963-7103-4206-904a-76008bba818c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.441430 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57622963-7103-4206-904a-76008bba818c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.441714 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57622963-7103-4206-904a-76008bba818c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.449498 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8a7e4-c8c3-4f02-ae5a-d575267073d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.450412 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8a7e4-c8c3-4f02-ae5a-d575267073d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.451637 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8a7e4-c8c3-4f02-ae5a-d575267073d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.452771 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8a7e4-c8c3-4f02-ae5a-d575267073d4 admin admin] PATH_INFO: `/v3/groups/5029563d86254e33b97e7149a49dd767` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.454675 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8a7e4-c8c3-4f02-ae5a-d575267073d4 admin admin] RBAC: Authorizing `identity:get_group(group_id=5029563d86254e33b97e7149a49dd767)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:17.457995 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8a7e4-c8c3-4f02-ae5a-d575267073d4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:17.460413 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 212/423] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/groups/5029563d86254e33b97e7149a49dd767 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:17.463350 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57622963-7103-4206-904a-76008bba818c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:17.466797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8a7e4-c8c3-4f02-ae5a-d575267073d4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.479761 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-57622963-7103-4206-904a-76008bba818c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:51:17.483179 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 212/424] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:17.483398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8a7e4-c8c3-4f02-ae5a-d575267073d4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.490382 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a6073-9c9a-4bd1-afd3-d95906ed769a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.491023 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a6073-9c9a-4bd1-afd3-d95906ed769a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.491303 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a6073-9c9a-4bd1-afd3-d95906ed769a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.491579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a6073-9c9a-4bd1-afd3-d95906ed769a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.492471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a6073-9c9a-4bd1-afd3-d95906ed769a admin admin] RBAC: Adding query filter params (group.id=5029563d86254e33b97e7149a49dd767, role.id=bcbedb9e465844d2a8baa6af3760e916, scope.project.id=4bec9401bcfa489d98020b66bccfa487) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:17.492785 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a6073-9c9a-4bd1-afd3-d95906ed769a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:17.494721 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a6073-9c9a-4bd1-afd3-d95906ed769a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:17.498041 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57622963-7103-4206-904a-76008bba818c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.511929 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57622963-7103-4206-904a-76008bba818c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.516264 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 213/425] 10.222.0.18 () {56 vars in 1397 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/role_assignments?group.id=5029563d86254e33b97e7149a49dd767&scope.project.id=4bec9401bcfa489d98020b66bccfa487&role.id=bcbedb9e465844d2a8baa6af3760e916 => generated 611 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:17.519612 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7ef4e-7e06-4680-9e38-b0c4aa9fcc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.520280 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7ef4e-7e06-4680-9e38-b0c4aa9fcc21 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.520615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7ef4e-7e06-4680-9e38-b0c4aa9fcc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.520892 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7ef4e-7e06-4680-9e38-b0c4aa9fcc21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.521721 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7ef4e-7e06-4680-9e38-b0c4aa9fcc21 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:17.522055 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7ef4e-7e06-4680-9e38-b0c4aa9fcc21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:17.523798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7ef4e-7e06-4680-9e38-b0c4aa9fcc21 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:17.536133 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 213/426] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:17.545116 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a6073-9c9a-4bd1-afd3-d95906ed769a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.555856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a6073-9c9a-4bd1-afd3-d95906ed769a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.567902 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74fa73-7af2-41ce-801f-e6033479388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.568576 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74fa73-7af2-41ce-801f-e6033479388b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.568860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74fa73-7af2-41ce-801f-e6033479388b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.569137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74fa73-7af2-41ce-801f-e6033479388b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.581891 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74fa73-7af2-41ce-801f-e6033479388b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:17.583701 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74fa73-7af2-41ce-801f-e6033479388b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:17.600318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 214/427] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:17.606658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7ef4e-7e06-4680-9e38-b0c4aa9fcc21 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.623705 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7ef4e-7e06-4680-9e38-b0c4aa9fcc21 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.625357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4d2a4-f06a-49a2-91ff-253680e5910f None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.625646 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4d2a4-f06a-49a2-91ff-253680e5910f None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.626053 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4d2a4-f06a-49a2-91ff-253680e5910f None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.628088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 215/428] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:51:17.633074 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bdcb0b-0cf3-4b22-a939-c4e20a669555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.633957 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdcb0b-0cf3-4b22-a939-c4e20a669555 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.634261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdcb0b-0cf3-4b22-a939-c4e20a669555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.634787 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdcb0b-0cf3-4b22-a939-c4e20a669555 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.638844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bdcb0b-0cf3-4b22-a939-c4e20a669555 admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:17.640972 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bdcb0b-0cf3-4b22-a939-c4e20a669555 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:17.642998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 214/429] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:17.645455 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cd4e7-8f1d-46a1-a06a-63f2c61e471c None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.645741 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cd4e7-8f1d-46a1-a06a-63f2c61e471c None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.646041 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cd4e7-8f1d-46a1-a06a-63f2c61e471c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.651774 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bdcb0b-0cf3-4b22-a939-c4e20a669555 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.669972 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bdcb0b-0cf3-4b22-a939-c4e20a669555 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.671929 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-2b3cd4e7-8f1d-46a1-a06a-63f2c61e471c None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:17.675444 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-2b3cd4e7-8f1d-46a1-a06a-63f2c61e471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:17.678630 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e06f31-c8b3-4992-92c9-12f5fe75c8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.679547 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e06f31-c8b3-4992-92c9-12f5fe75c8bb admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.679831 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e06f31-c8b3-4992-92c9-12f5fe75c8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.680108 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e06f31-c8b3-4992-92c9-12f5fe75c8bb admin admin] PATH_INFO: `/v3/groups/5029563d86254e33b97e7149a49dd767` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.682710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e06f31-c8b3-4992-92c9-12f5fe75c8bb admin admin] RBAC: Authorizing `identity:get_group(group_id=5029563d86254e33b97e7149a49dd767)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:17.683631 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 216/430] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:51:17.684827 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e06f31-c8b3-4992-92c9-12f5fe75c8bb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:17.687615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 215/431] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/groups/5029563d86254e33b97e7149a49dd767 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:17.693745 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cd4e7-8f1d-46a1-a06a-63f2c61e471c None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.707830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cd4e7-8f1d-46a1-a06a-63f2c61e471c None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.722911 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b0b28-c934-477e-a49e-729cccf46f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.723601 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b0b28-c934-477e-a49e-729cccf46f67 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.723885 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b0b28-c934-477e-a49e-729cccf46f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.724162 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b0b28-c934-477e-a49e-729cccf46f67 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.725061 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b0b28-c934-477e-a49e-729cccf46f67 admin admin] RBAC: Adding query filter params (group.id=5029563d86254e33b97e7149a49dd767, role.id=69edf382652b443c97811919233bb991, scope.project.id=4bec9401bcfa489d98020b66bccfa487) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:17.725375 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b0b28-c934-477e-a49e-729cccf46f67 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:17.727408 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b0b28-c934-477e-a49e-729cccf46f67 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:17.735234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 217/432] 10.222.0.18 () {56 vars in 1397 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/role_assignments?group.id=5029563d86254e33b97e7149a49dd767&scope.project.id=4bec9401bcfa489d98020b66bccfa487&role.id=69edf382652b443c97811919233bb991 => generated 611 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:17.737518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e06f31-c8b3-4992-92c9-12f5fe75c8bb admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.751914 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e06f31-c8b3-4992-92c9-12f5fe75c8bb admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.766868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59938ff-507c-4561-8905-f53ec657a505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.767701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59938ff-507c-4561-8905-f53ec657a505 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.767982 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59938ff-507c-4561-8905-f53ec657a505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.768083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392ec0f-beae-44dc-91d6-e5ee2512a86f None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.768255 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59938ff-507c-4561-8905-f53ec657a505 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.768349 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392ec0f-beae-44dc-91d6-e5ee2512a86f None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.768614 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392ec0f-beae-44dc-91d6-e5ee2512a86f None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.770906 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 218/433] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:51:17.777368 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54697d-0bab-4674-bdfb-2d7d1328c7fc None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.777682 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54697d-0bab-4674-bdfb-2d7d1328c7fc None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.777936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54697d-0bab-4674-bdfb-2d7d1328c7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.784674 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59938ff-507c-4561-8905-f53ec657a505 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:17.793709 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-a59938ff-507c-4561-8905-f53ec657a505 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 02:51:17.799041 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 216/434] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:17.807328 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-4a54697d-0bab-4674-bdfb-2d7d1328c7fc None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:17.808677 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4a54697d-0bab-4674-bdfb-2d7d1328c7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:17.819911 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 219/435] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:17.822669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59938ff-507c-4561-8905-f53ec657a505 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.835373 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59938ff-507c-4561-8905-f53ec657a505 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.846183 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697613ca-ecbf-4c0f-8cf0-32cfcc3e90b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.847218 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54697d-0bab-4674-bdfb-2d7d1328c7fc None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.853774 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697613ca-ecbf-4c0f-8cf0-32cfcc3e90b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.854106 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697613ca-ecbf-4c0f-8cf0-32cfcc3e90b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.854344 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697613ca-ecbf-4c0f-8cf0-32cfcc3e90b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.855166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697613ca-ecbf-4c0f-8cf0-32cfcc3e90b6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:17.856964 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697613ca-ecbf-4c0f-8cf0-32cfcc3e90b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:17.861096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54697d-0bab-4674-bdfb-2d7d1328c7fc None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.862803 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697613ca-ecbf-4c0f-8cf0-32cfcc3e90b6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:17.870101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d1b85-d219-4a0a-abed-aeea6a4e9de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.870978 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d1b85-d219-4a0a-abed-aeea6a4e9de1 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.871266 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d1b85-d219-4a0a-abed-aeea6a4e9de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.871574 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d1b85-d219-4a0a-abed-aeea6a4e9de1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.883754 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 217/436] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:17.892185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d1b85-d219-4a0a-abed-aeea6a4e9de1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:17.895065 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697613ca-ecbf-4c0f-8cf0-32cfcc3e90b6 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.899285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-da0d1b85-d219-4a0a-abed-aeea6a4e9de1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 02:51:17.900878 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 220/437] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:17.909455 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d1b85-d219-4a0a-abed-aeea6a4e9de1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.911581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697613ca-ecbf-4c0f-8cf0-32cfcc3e90b6 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.920453 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fed8a-84a2-4ce5-8e26-c9f8d69cfe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.921671 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fed8a-84a2-4ce5-8e26-c9f8d69cfe3d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.921947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fed8a-84a2-4ce5-8e26-c9f8d69cfe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.922320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fed8a-84a2-4ce5-8e26-c9f8d69cfe3d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.922785 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d1b85-d219-4a0a-abed-aeea6a4e9de1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.934005 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330fed8a-84a2-4ce5-8e26-c9f8d69cfe3d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:17.934199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c126580-9bad-4f4d-b14c-773c55ca29df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.934768 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c126580-9bad-4f4d-b14c-773c55ca29df admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.935046 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c126580-9bad-4f4d-b14c-773c55ca29df admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.935322 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c126580-9bad-4f4d-b14c-773c55ca29df admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.936092 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c126580-9bad-4f4d-b14c-773c55ca29df admin admin] RBAC: Adding query filter params (name=member) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:17.936445 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c126580-9bad-4f4d-b14c-773c55ca29df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:17.937614 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330fed8a-84a2-4ce5-8e26-c9f8d69cfe3d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:17.938039 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c126580-9bad-4f4d-b14c-773c55ca29df admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:17.950419 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 218/438] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:17.952727 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 221/439] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:17.957410 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fed8a-84a2-4ce5-8e26-c9f8d69cfe3d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.958142 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c126580-9bad-4f4d-b14c-773c55ca29df admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.968400 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c126580-9bad-4f4d-b14c-773c55ca29df admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.969915 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fed8a-84a2-4ce5-8e26-c9f8d69cfe3d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:17.978036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ff5b4-4417-4785-84a4-b19ac103edc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.979269 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ff5b4-4417-4785-84a4-b19ac103edc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.979666 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5b9c7-454f-4806-b3d2-b252303124e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:17.980042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ff5b4-4417-4785-84a4-b19ac103edc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.980310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b9c7-454f-4806-b3d2-b252303124e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:17.980636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b9c7-454f-4806-b3d2-b252303124e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:17.980905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b9c7-454f-4806-b3d2-b252303124e3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.981137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ff5b4-4417-4785-84a4-b19ac103edc6 admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:17.982612 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ff5b4-4417-4785-84a4-b19ac103edc6 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:17.985444 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ff5b4-4417-4785-84a4-b19ac103edc6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:17.989935 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 222/440] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:17.995458 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5b9c7-454f-4806-b3d2-b252303124e3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:17.997364 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ff5b4-4417-4785-84a4-b19ac103edc6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:17.999335 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5b9c7-454f-4806-b3d2-b252303124e3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:18.011376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ff5b4-4417-4785-84a4-b19ac103edc6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:18.014675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 219/441] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:18.021060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5b9c7-454f-4806-b3d2-b252303124e3 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:18.022831 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07164839-670c-432f-b1e4-166df9b55b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:18.022831 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07164839-670c-432f-b1e4-166df9b55b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:18.022831 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07164839-670c-432f-b1e4-166df9b55b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:18.023097 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07164839-670c-432f-b1e4-166df9b55b99 admin admin] PATH_INFO: `/v3/groups/5029563d86254e33b97e7149a49dd767` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:18.024295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07164839-670c-432f-b1e4-166df9b55b99 admin admin] RBAC: Authorizing `identity:get_group(group_id=5029563d86254e33b97e7149a49dd767)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:18.026241 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07164839-670c-432f-b1e4-166df9b55b99 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:18.028130 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 223/442] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Dec 15 02:51:17 2021] GET /identity/v3/groups/5029563d86254e33b97e7149a49dd767 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:18.031363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5b9c7-454f-4806-b3d2-b252303124e3 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:18.036751 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07164839-670c-432f-b1e4-166df9b55b99 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:18.038139 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbef03a-1164-4091-a584-c04efd89a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:18.039005 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef03a-1164-4091-a584-c04efd89a8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:18.039285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef03a-1164-4091-a584-c04efd89a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:18.039562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef03a-1164-4091-a584-c04efd89a8a7 admin admin] PATH_INFO: `/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:18.041775 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbef03a-1164-4091-a584-c04efd89a8a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ec39c8c2a0a4950925dcf994f4875e0)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:18.045483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbef03a-1164-4091-a584-c04efd89a8a7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:18.048002 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 220/443] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:18 2021] GET /identity/v3/projects/8ec39c8c2a0a4950925dcf994f4875e0 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:18.048107 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07164839-670c-432f-b1e4-166df9b55b99 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:18.055131 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbef03a-1164-4091-a584-c04efd89a8a7 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:18.056677 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0bb0c-3f59-456c-9082-0ca1e5159cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:18.057339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0bb0c-3f59-456c-9082-0ca1e5159cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:18.057620 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0bb0c-3f59-456c-9082-0ca1e5159cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:18.057893 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0bb0c-3f59-456c-9082-0ca1e5159cd6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:18.058853 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0bb0c-3f59-456c-9082-0ca1e5159cd6 admin admin] RBAC: Adding query filter params (group.id=5029563d86254e33b97e7149a49dd767, role.id=bcbedb9e465844d2a8baa6af3760e916, scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:18.059158 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0bb0c-3f59-456c-9082-0ca1e5159cd6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:18.060993 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0bb0c-3f59-456c-9082-0ca1e5159cd6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:18.068397 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbef03a-1164-4091-a584-c04efd89a8a7 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:18.070134 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 224/444] 10.222.0.18 () {56 vars in 1397 bytes} [Wed Dec 15 02:51:18 2021] GET /identity/v3/role_assignments?group.id=5029563d86254e33b97e7149a49dd767&scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0&role.id=bcbedb9e465844d2a8baa6af3760e916 => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:18.074072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260eac3f-3f51-4242-9b59-2733c194a7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:18.074926 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eac3f-3f51-4242-9b59-2733c194a7ad admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:18.075200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eac3f-3f51-4242-9b59-2733c194a7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:18.075471 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eac3f-3f51-4242-9b59-2733c194a7ad admin admin] PATH_INFO: `/v3/groups/5029563d86254e33b97e7149a49dd767` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:18.076694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260eac3f-3f51-4242-9b59-2733c194a7ad admin admin] RBAC: Authorizing `identity:get_group(group_id=5029563d86254e33b97e7149a49dd767)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:18.079200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260eac3f-3f51-4242-9b59-2733c194a7ad admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:18.080880 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 221/445] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Dec 15 02:51:18 2021] GET /identity/v3/groups/5029563d86254e33b97e7149a49dd767 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:18.087686 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0bb0c-3f59-456c-9082-0ca1e5159cd6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:18.102201 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0bb0c-3f59-456c-9082-0ca1e5159cd6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:18.110289 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e842b-3b89-4357-8cdb-1187866fcd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:18.111216 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e842b-3b89-4357-8cdb-1187866fcd02 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:18.111693 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e842b-3b89-4357-8cdb-1187866fcd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:18.112135 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e842b-3b89-4357-8cdb-1187866fcd02 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:18.113150 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e842b-3b89-4357-8cdb-1187866fcd02 admin admin] RBAC: Adding query filter params (group.id=5029563d86254e33b97e7149a49dd767, role.id=69edf382652b443c97811919233bb991, scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:18.113462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e842b-3b89-4357-8cdb-1187866fcd02 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:18.115364 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e842b-3b89-4357-8cdb-1187866fcd02 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:18.126082 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 225/446] 10.222.0.18 () {56 vars in 1397 bytes} [Wed Dec 15 02:51:18 2021] GET /identity/v3/role_assignments?group.id=5029563d86254e33b97e7149a49dd767&scope.project.id=8ec39c8c2a0a4950925dcf994f4875e0&role.id=69edf382652b443c97811919233bb991 => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:19.072011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e29f7d-00fd-47d4-b65d-2fa9a08f7582 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:19.072559 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e29f7d-00fd-47d4-b65d-2fa9a08f7582 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:19.072559 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e29f7d-00fd-47d4-b65d-2fa9a08f7582 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:19.074337 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 222/447] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:19.080407 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6541b-4684-4209-9637-5012cf1910f1 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:19.080834 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6541b-4684-4209-9637-5012cf1910f1 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:19.080959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6541b-4684-4209-9637-5012cf1910f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:19.098634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-eee6541b-4684-4209-9637-5012cf1910f1 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:19.099788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-eee6541b-4684-4209-9637-5012cf1910f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:19.107095 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 226/448] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:19.130741 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e29f7d-00fd-47d4-b65d-2fa9a08f7582 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:19.142983 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e29f7d-00fd-47d4-b65d-2fa9a08f7582 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:19.147304 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74774f41-f22f-4423-8312-f1488bd70a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:19.148044 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74774f41-f22f-4423-8312-f1488bd70a05 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:19.148317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74774f41-f22f-4423-8312-f1488bd70a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:19.148585 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74774f41-f22f-4423-8312-f1488bd70a05 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:19.158847 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74774f41-f22f-4423-8312-f1488bd70a05 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:19.165480 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-74774f41-f22f-4423-8312-f1488bd70a05 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:51:19.166590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 223/449] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:51:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:19.172209 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6541b-4684-4209-9637-5012cf1910f1 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:19.180619 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6541b-4684-4209-9637-5012cf1910f1 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:19.184857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5381da3-b71c-4abb-9c2e-07c0261109a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:19.185483 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5381da3-b71c-4abb-9c2e-07c0261109a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:19.185762 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5381da3-b71c-4abb-9c2e-07c0261109a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:19.186069 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5381da3-b71c-4abb-9c2e-07c0261109a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:19.187311 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5381da3-b71c-4abb-9c2e-07c0261109a8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:19.187613 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5381da3-b71c-4abb-9c2e-07c0261109a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:19.189181 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5381da3-b71c-4abb-9c2e-07c0261109a8 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:19.197033 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 227/450] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:19.204932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74774f41-f22f-4423-8312-f1488bd70a05 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:19.214810 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74774f41-f22f-4423-8312-f1488bd70a05 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:19.218957 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab5fff-67a5-4f7e-853e-d01342907caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:19.219556 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5fff-67a5-4f7e-853e-d01342907caf admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:19.219834 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5fff-67a5-4f7e-853e-d01342907caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:19.220107 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5fff-67a5-4f7e-853e-d01342907caf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:19.227470 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab5fff-67a5-4f7e-853e-d01342907caf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:19.229187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab5fff-67a5-4f7e-853e-d01342907caf admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:19.237478 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 224/451] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:19 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:19.243035 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5381da3-b71c-4abb-9c2e-07c0261109a8 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:19.252719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5381da3-b71c-4abb-9c2e-07c0261109a8 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:19.256959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305ff5-468f-4b76-8c7f-c5cf03bede5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:19.257776 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305ff5-468f-4b76-8c7f-c5cf03bede5a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:19.258089 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305ff5-468f-4b76-8c7f-c5cf03bede5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:19.258365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305ff5-468f-4b76-8c7f-c5cf03bede5a admin admin] PATH_INFO: `/v3/projects/f289697819814b2daa5373dc010a1dbf` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:19.259802 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f305ff5-468f-4b76-8c7f-c5cf03bede5a admin admin] RBAC: Authorizing `identity:get_project(project_id=f289697819814b2daa5373dc010a1dbf)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:19.261549 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f305ff5-468f-4b76-8c7f-c5cf03bede5a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:19.263181 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 228/452] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:51:19 2021] GET /identity/v3/projects/f289697819814b2daa5373dc010a1dbf => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:19.269066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab5fff-67a5-4f7e-853e-d01342907caf admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:19.277164 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab5fff-67a5-4f7e-853e-d01342907caf admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:19.281308 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cd954-6f0e-4bb8-b6f1-992b31b9c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:19.282117 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cd954-6f0e-4bb8-b6f1-992b31b9c0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:19.282392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cd954-6f0e-4bb8-b6f1-992b31b9c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:19.282657 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cd954-6f0e-4bb8-b6f1-992b31b9c0e8 admin admin] PATH_INFO: `/v3/groups/910ded1ad6ec4c928f163555e3cd3253` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:19.283780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cd954-6f0e-4bb8-b6f1-992b31b9c0e8 admin admin] RBAC: Authorizing `identity:get_group(group_id=910ded1ad6ec4c928f163555e3cd3253)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:19.285577 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cd954-6f0e-4bb8-b6f1-992b31b9c0e8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:19.287093 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 225/453] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Dec 15 02:51:19 2021] GET /identity/v3/groups/910ded1ad6ec4c928f163555e3cd3253 => generated 229 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:19.292495 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305ff5-468f-4b76-8c7f-c5cf03bede5a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:19.301267 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305ff5-468f-4b76-8c7f-c5cf03bede5a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:19.305419 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54010ab2-0ecd-4d8e-ab32-bd182eb6afd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:19.306028 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54010ab2-0ecd-4d8e-ab32-bd182eb6afd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:19.306314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54010ab2-0ecd-4d8e-ab32-bd182eb6afd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:19.306643 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54010ab2-0ecd-4d8e-ab32-bd182eb6afd1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:19.307446 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54010ab2-0ecd-4d8e-ab32-bd182eb6afd1 admin admin] RBAC: Adding query filter params (group.id=910ded1ad6ec4c928f163555e3cd3253, role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=f289697819814b2daa5373dc010a1dbf) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:19.307750 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54010ab2-0ecd-4d8e-ab32-bd182eb6afd1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:19.309483 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54010ab2-0ecd-4d8e-ab32-bd182eb6afd1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:19.315488 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 229/454] 10.222.0.18 () {56 vars in 1397 bytes} [Wed Dec 15 02:51:19 2021] GET /identity/v3/role_assignments?group.id=910ded1ad6ec4c928f163555e3cd3253&scope.project.id=f289697819814b2daa5373dc010a1dbf&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 611 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:22.204514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43740a35-6600-418c-9be7-878e95f0ebe6 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.205021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43740a35-6600-418c-9be7-878e95f0ebe6 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.205094 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43740a35-6600-418c-9be7-878e95f0ebe6 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.212194 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 226/455] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:22.216521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975c060-d371-4145-9718-c80cc292c8a2 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.217832 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975c060-d371-4145-9718-c80cc292c8a2 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.218333 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975c060-d371-4145-9718-c80cc292c8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.236458 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef68c0-acfb-429f-b31e-18b16ffc78aa None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.237062 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef68c0-acfb-429f-b31e-18b16ffc78aa None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.237555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef68c0-acfb-429f-b31e-18b16ffc78aa None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.238656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a975c060-d371-4145-9718-c80cc292c8a2 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:22.239836 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a975c060-d371-4145-9718-c80cc292c8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:22.240221 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 227/456] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:22.247284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df9bb8-78cd-4760-a655-2db10d5fc323 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.247813 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df9bb8-78cd-4760-a655-2db10d5fc323 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.248297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df9bb8-78cd-4760-a655-2db10d5fc323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.252214 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 230/457] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:22.266862 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-63df9bb8-78cd-4760-a655-2db10d5fc323 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:22.268277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-63df9bb8-78cd-4760-a655-2db10d5fc323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:22.276613 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 228/458] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:51:22.287185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975c060-d371-4145-9718-c80cc292c8a2 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:22.299426 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975c060-d371-4145-9718-c80cc292c8a2 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:22.307198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df9bb8-78cd-4760-a655-2db10d5fc323 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:22.310177 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f4749-3dc3-49f6-8266-90d394cb3f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:22.311002 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f4749-3dc3-49f6-8266-90d394cb3f00 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.311332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f4749-3dc3-49f6-8266-90d394cb3f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.311607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f4749-3dc3-49f6-8266-90d394cb3f00 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.319781 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df9bb8-78cd-4760-a655-2db10d5fc323 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:22.324799 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5efefd-b1a1-4d93-b698-dabff9dac9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:22.325971 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5efefd-b1a1-4d93-b698-dabff9dac9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.326475 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5efefd-b1a1-4d93-b698-dabff9dac9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.326984 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5efefd-b1a1-4d93-b698-dabff9dac9c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.327218 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f4749-3dc3-49f6-8266-90d394cb3f00 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:22.329094 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f4749-3dc3-49f6-8266-90d394cb3f00 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:22.339567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5efefd-b1a1-4d93-b698-dabff9dac9c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:22.341730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5efefd-b1a1-4d93-b698-dabff9dac9c3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:22.358918 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-063f4749-3dc3-49f6-8266-90d394cb3f00 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:22.365194 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 231/459] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:22.366960 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-9b5efefd-b1a1-4d93-b698-dabff9dac9c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:22.368633 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 229/460] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:22.371136 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f4749-3dc3-49f6-8266-90d394cb3f00 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:22.375680 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5efefd-b1a1-4d93-b698-dabff9dac9c3 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:22.386674 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5efefd-b1a1-4d93-b698-dabff9dac9c3 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:22.386959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f4749-3dc3-49f6-8266-90d394cb3f00 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:22.396639 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddb386-af04-482c-891d-51b890ff74a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:22.397443 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e478f-c879-4c98-b9c5-9abf880be81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:22.398668 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e478f-c879-4c98-b9c5-9abf880be81d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.399192 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddb386-af04-482c-891d-51b890ff74a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.399681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddb386-af04-482c-891d-51b890ff74a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.400179 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e478f-c879-4c98-b9c5-9abf880be81d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.400634 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddb386-af04-482c-891d-51b890ff74a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.401093 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e478f-c879-4c98-b9c5-9abf880be81d admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.402043 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddb386-af04-482c-891d-51b890ff74a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:22.402979 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e478f-c879-4c98-b9c5-9abf880be81d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:22.403473 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e478f-c879-4c98-b9c5-9abf880be81d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:22.403955 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddb386-af04-482c-891d-51b890ff74a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:22.406863 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-f8ddb386-af04-482c-891d-51b890ff74a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:22.406863 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:51:22.406863 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:51:22.408091 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddb386-af04-482c-891d-51b890ff74a5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:22.408970 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e478f-c879-4c98-b9c5-9abf880be81d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:22.438787 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 232/461] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:22.446008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e478f-c879-4c98-b9c5-9abf880be81d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:22.448858 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 230/462] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:22.458122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e478f-c879-4c98-b9c5-9abf880be81d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:22.464152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55783aa1-2dd2-4067-9a6e-51eda2e38e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:22.465054 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55783aa1-2dd2-4067-9a6e-51eda2e38e33 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.465527 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55783aa1-2dd2-4067-9a6e-51eda2e38e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.467060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddb386-af04-482c-891d-51b890ff74a5 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:22.472789 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55783aa1-2dd2-4067-9a6e-51eda2e38e33 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.475101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55783aa1-2dd2-4067-9a6e-51eda2e38e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:22.478752 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55783aa1-2dd2-4067-9a6e-51eda2e38e33 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:22.481453 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddb386-af04-482c-891d-51b890ff74a5 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:22.494091 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bdad2-8677-4794-8bc5-448a1240956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:22.495106 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bdad2-8677-4794-8bc5-448a1240956b admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.495578 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bdad2-8677-4794-8bc5-448a1240956b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.496041 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bdad2-8677-4794-8bc5-448a1240956b admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.496959 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bdad2-8677-4794-8bc5-448a1240956b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:22.499172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bdad2-8677-4794-8bc5-448a1240956b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:22.521026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 233/463] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:51:22 2021] POST /identity/v3/users => generated 248 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 02:51:22.522945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019162be-801d-42b4-b7c6-fe791009cab7 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.523454 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019162be-801d-42b4-b7c6-fe791009cab7 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.523921 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019162be-801d-42b4-b7c6-fe791009cab7 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.526028 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 234/464] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:22.527406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 231/465] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:51:22 2021] POST /identity/v3/users => generated 246 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 02:51:22.537319 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584169bb-87ad-4b0d-b9b0-6d2c857ad5d6 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.537973 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584169bb-87ad-4b0d-b9b0-6d2c857ad5d6 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.538499 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584169bb-87ad-4b0d-b9b0-6d2c857ad5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.574819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-584169bb-87ad-4b0d-b9b0-6d2c857ad5d6 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:22.576406 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-584169bb-87ad-4b0d-b9b0-6d2c857ad5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:22.590520 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 235/466] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:22.636083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bdad2-8677-4794-8bc5-448a1240956b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:22.647340 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bdad2-8677-4794-8bc5-448a1240956b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:22.658633 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa882b-ad2b-4f67-922f-f684e5d11a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:22.659439 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa882b-ad2b-4f67-922f-f684e5d11a9b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.659714 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa882b-ad2b-4f67-922f-f684e5d11a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.659984 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa882b-ad2b-4f67-922f-f684e5d11a9b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.675379 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa882b-ad2b-4f67-922f-f684e5d11a9b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:22.677251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa882b-ad2b-4f67-922f-f684e5d11a9b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:22.699154 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-9afa882b-ad2b-4f67-922f-f684e5d11a9b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:22.700428 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 232/467] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:22.707367 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584169bb-87ad-4b0d-b9b0-6d2c857ad5d6 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:22.717028 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584169bb-87ad-4b0d-b9b0-6d2c857ad5d6 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:22.721647 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73160b-23f3-4ff0-a85c-508041956c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:22.722358 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73160b-23f3-4ff0-a85c-508041956c90 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.722635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73160b-23f3-4ff0-a85c-508041956c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.722905 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73160b-23f3-4ff0-a85c-508041956c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.723670 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73160b-23f3-4ff0-a85c-508041956c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:22.723975 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73160b-23f3-4ff0-a85c-508041956c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:22.725638 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73160b-23f3-4ff0-a85c-508041956c90 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:22.729118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877e9d-85ca-4822-9283-2608b6d99821 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.729396 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877e9d-85ca-4822-9283-2608b6d99821 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.729668 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877e9d-85ca-4822-9283-2608b6d99821 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.731496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 233/468] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:51:22.738483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830b588-0520-40de-aa0a-24e3bdd405ff None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.738772 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830b588-0520-40de-aa0a-24e3bdd405ff None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.739013 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830b588-0520-40de-aa0a-24e3bdd405ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.750530 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 236/469] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:22.754255 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73160b-23f3-4ff0-a85c-508041956c90 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:22.772040 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-3830b588-0520-40de-aa0a-24e3bdd405ff None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:22.773261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-3830b588-0520-40de-aa0a-24e3bdd405ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:22.776263 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73160b-23f3-4ff0-a85c-508041956c90 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:22.781891 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 234/470] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Dec 15 02:51:22.783521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e22f0d-943d-4c7e-95d1-cb147d42f27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:22.784197 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e22f0d-943d-4c7e-95d1-cb147d42f27a admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.784473 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e22f0d-943d-4c7e-95d1-cb147d42f27a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.784745 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e22f0d-943d-4c7e-95d1-cb147d42f27a admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.785471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e22f0d-943d-4c7e-95d1-cb147d42f27a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:22.787427 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e22f0d-943d-4c7e-95d1-cb147d42f27a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:22.808876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830b588-0520-40de-aa0a-24e3bdd405ff None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:22.810401 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 237/471] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:51:22 2021] POST /identity/v3/users => generated 248 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:51:22.819162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830b588-0520-40de-aa0a-24e3bdd405ff None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:22.827719 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3d457-9112-42ea-8d72-94fefb562f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:22.828592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d457-9112-42ea-8d72-94fefb562f40 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.828878 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d457-9112-42ea-8d72-94fefb562f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.829154 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d457-9112-42ea-8d72-94fefb562f40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.841355 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3d457-9112-42ea-8d72-94fefb562f40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:22.843692 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3d457-9112-42ea-8d72-94fefb562f40 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:22.863503 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-50e3d457-9112-42ea-8d72-94fefb562f40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:22.865522 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 235/472] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:22.872444 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e22f0d-943d-4c7e-95d1-cb147d42f27a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:22.884929 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e22f0d-943d-4c7e-95d1-cb147d42f27a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:22.890391 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a5570-a33d-412b-b203-337b0b155731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:22.891066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a5570-a33d-412b-b203-337b0b155731 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.891345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a5570-a33d-412b-b203-337b0b155731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.891619 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a5570-a33d-412b-b203-337b0b155731 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.892420 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a5570-a33d-412b-b203-337b0b155731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:22.892870 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a5570-a33d-412b-b203-337b0b155731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:22.894553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a5570-a33d-412b-b203-337b0b155731 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:22.910376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 238/473] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:22.916411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3d457-9112-42ea-8d72-94fefb562f40 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:22.928197 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3d457-9112-42ea-8d72-94fefb562f40 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:22.933339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efbc0b-7511-43ad-82b0-dff1c1b292c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:22.934327 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efbc0b-7511-43ad-82b0-dff1c1b292c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:22.934842 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efbc0b-7511-43ad-82b0-dff1c1b292c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:22.935315 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efbc0b-7511-43ad-82b0-dff1c1b292c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:22.936854 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efbc0b-7511-43ad-82b0-dff1c1b292c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:22.939134 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efbc0b-7511-43ad-82b0-dff1c1b292c5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:22.963715 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 236/474] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:51:22 2021] POST /identity/v3/users => generated 249 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:51:23.894753 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355a279-9112-4f8a-8747-0ac970f0801f None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:23.895276 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355a279-9112-4f8a-8747-0ac970f0801f None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:23.895276 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355a279-9112-4f8a-8747-0ac970f0801f None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:23.897321 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 239/475] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:23.903451 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e975618-56b1-45a7-990a-9bbdfd74b090 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:23.903990 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e975618-56b1-45a7-990a-9bbdfd74b090 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:23.903990 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e975618-56b1-45a7-990a-9bbdfd74b090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:23.926973 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-8e975618-56b1-45a7-990a-9bbdfd74b090 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:23.928159 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8e975618-56b1-45a7-990a-9bbdfd74b090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:23.936581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 237/476] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:23.965441 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355a279-9112-4f8a-8747-0ac970f0801f None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:23.983653 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355a279-9112-4f8a-8747-0ac970f0801f None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:23.991339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c97e14-75f1-4852-a4e7-87f637b81323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:23.991993 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c97e14-75f1-4852-a4e7-87f637b81323 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:23.992270 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c97e14-75f1-4852-a4e7-87f637b81323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:23.992543 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c97e14-75f1-4852-a4e7-87f637b81323 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:23.993303 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c97e14-75f1-4852-a4e7-87f637b81323 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:23.994977 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c97e14-75f1-4852-a4e7-87f637b81323 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:24.015247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.sql.core [None req-b9c97e14-75f1-4852-a4e7-87f637b81323 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Dec 15 02:51:24.015247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Dec 15 02:51:24.015247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [parameters: {'id': '5770c03bc6a44586b5e419235194fdcd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Dec 15 02:51:24.015247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79173) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 02:51:24.029662 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-b9c97e14-75f1-4852-a4e7-87f637b81323 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Dec 15 02:51:24.035532 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 240/477] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 02:51:23 2021] POST /identity/v3/roles => generated 144 bytes in 70 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:24.041909 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e975618-56b1-45a7-990a-9bbdfd74b090 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:24.051125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e975618-56b1-45a7-990a-9bbdfd74b090 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:24.057966 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8f616-4950-47d1-b1e3-67020ff6a82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:24.058794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8f616-4950-47d1-b1e3-67020ff6a82d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:24.059081 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8f616-4950-47d1-b1e3-67020ff6a82d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:24.059356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8f616-4950-47d1-b1e3-67020ff6a82d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:24.075223 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8f616-4950-47d1-b1e3-67020ff6a82d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:24.083134 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-3fb8f616-4950-47d1-b1e3-67020ff6a82d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 02:51:24.084333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 238/478] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:51:24 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:24.090702 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c97e14-75f1-4852-a4e7-87f637b81323 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:24.101625 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c97e14-75f1-4852-a4e7-87f637b81323 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:24.113039 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2786d-78d0-4b66-b6e3-43ea921a3f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:24.113766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2786d-78d0-4b66-b6e3-43ea921a3f88 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:24.114085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2786d-78d0-4b66-b6e3-43ea921a3f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:24.114369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2786d-78d0-4b66-b6e3-43ea921a3f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:24.115132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2786d-78d0-4b66-b6e3-43ea921a3f88 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:24.115439 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2786d-78d0-4b66-b6e3-43ea921a3f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:24.117094 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2786d-78d0-4b66-b6e3-43ea921a3f88 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:24.132204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 241/479] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:24 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:25.394194 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bce07-1662-4c81-b9ab-d595d54db595 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.394760 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bce07-1662-4c81-b9ab-d595d54db595 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.394760 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bce07-1662-4c81-b9ab-d595d54db595 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.396890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 239/480] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:25.403469 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8dd61-f147-4a5b-842b-592f2cd2e11b None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.404461 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8dd61-f147-4a5b-842b-592f2cd2e11b None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.405020 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8dd61-f147-4a5b-842b-592f2cd2e11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.434951 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-2da8dd61-f147-4a5b-842b-592f2cd2e11b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:25.437040 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-2da8dd61-f147-4a5b-842b-592f2cd2e11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:25.445435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 242/481] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:51:25.456223 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e3c78-d90d-456a-bd79-a7c250bd068f None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.456765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e3c78-d90d-456a-bd79-a7c250bd068f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.457259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e3c78-d90d-456a-bd79-a7c250bd068f None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.459249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 240/482] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:25.464831 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f534500-a245-46af-8035-f0ceecdcd658 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.465408 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f534500-a245-46af-8035-f0ceecdcd658 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.465889 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f534500-a245-46af-8035-f0ceecdcd658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.491061 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-5f534500-a245-46af-8035-f0ceecdcd658 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:25.492262 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5f534500-a245-46af-8035-f0ceecdcd658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:25.495374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e3c78-d90d-456a-bd79-a7c250bd068f None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:25.505071 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 243/483] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:25.509760 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e3c78-d90d-456a-bd79-a7c250bd068f None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:25.514989 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67653ae2-1d9f-4e3b-8aef-a891f0e86f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:25.516023 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67653ae2-1d9f-4e3b-8aef-a891f0e86f1b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.516505 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67653ae2-1d9f-4e3b-8aef-a891f0e86f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.516988 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67653ae2-1d9f-4e3b-8aef-a891f0e86f1b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.528276 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67653ae2-1d9f-4e3b-8aef-a891f0e86f1b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:25.531044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f534500-a245-46af-8035-f0ceecdcd658 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:25.537005 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-67653ae2-1d9f-4e3b-8aef-a891f0e86f1b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:25.538696 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 241/484] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:25.545665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f534500-a245-46af-8035-f0ceecdcd658 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:25.546811 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67653ae2-1d9f-4e3b-8aef-a891f0e86f1b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:25.549589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443340d1-78ab-4096-a368-65d2d76a8e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:25.550484 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443340d1-78ab-4096-a368-65d2d76a8e67 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.550767 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443340d1-78ab-4096-a368-65d2d76a8e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.551095 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443340d1-78ab-4096-a368-65d2d76a8e67 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.562705 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443340d1-78ab-4096-a368-65d2d76a8e67 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:25.563066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67653ae2-1d9f-4e3b-8aef-a891f0e86f1b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:25.569741 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-443340d1-78ab-4096-a368-65d2d76a8e67 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:25.571131 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 244/485] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:25.577303 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff55671-ee08-4c3a-b27f-61c03255ddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:25.577556 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443340d1-78ab-4096-a368-65d2d76a8e67 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:25.578531 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff55671-ee08-4c3a-b27f-61c03255ddcf admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.579006 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff55671-ee08-4c3a-b27f-61c03255ddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.579469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff55671-ee08-4c3a-b27f-61c03255ddcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.580417 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff55671-ee08-4c3a-b27f-61c03255ddcf admin admin] RBAC: Adding query filter params (name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:25.580928 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff55671-ee08-4c3a-b27f-61c03255ddcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:25.582758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff55671-ee08-4c3a-b27f-61c03255ddcf admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:25.587183 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443340d1-78ab-4096-a368-65d2d76a8e67 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:25.592544 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdd77e-de57-4d94-9757-e54b6ad9d5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:25.593245 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd77e-de57-4d94-9757-e54b6ad9d5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.593534 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd77e-de57-4d94-9757-e54b6ad9d5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.593813 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd77e-de57-4d94-9757-e54b6ad9d5b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.594833 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdd77e-de57-4d94-9757-e54b6ad9d5b5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:25.595148 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdd77e-de57-4d94-9757-e54b6ad9d5b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:25.596963 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdd77e-de57-4d94-9757-e54b6ad9d5b5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:25.599110 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 242/486] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:25.608360 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff55671-ee08-4c3a-b27f-61c03255ddcf admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:25.611974 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 245/487] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:25.617956 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdd77e-de57-4d94-9757-e54b6ad9d5b5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:25.628409 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff55671-ee08-4c3a-b27f-61c03255ddcf admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:25.628962 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdd77e-de57-4d94-9757-e54b6ad9d5b5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:25.636893 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71d6de-eff7-4b82-b8cc-6960ea4926ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:25.637588 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942b948-6ef1-4253-a327-09ae68f59986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:25.638399 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942b948-6ef1-4253-a327-09ae68f59986 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.639294 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71d6de-eff7-4b82-b8cc-6960ea4926ed admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.639572 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71d6de-eff7-4b82-b8cc-6960ea4926ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.639935 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942b948-6ef1-4253-a327-09ae68f59986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.640208 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942b948-6ef1-4253-a327-09ae68f59986 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.640870 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71d6de-eff7-4b82-b8cc-6960ea4926ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.660023 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71d6de-eff7-4b82-b8cc-6960ea4926ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:25.660296 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942b948-6ef1-4253-a327-09ae68f59986 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:25.661863 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942b948-6ef1-4253-a327-09ae68f59986 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:25.662002 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71d6de-eff7-4b82-b8cc-6960ea4926ed admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:25.680395 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-6d71d6de-eff7-4b82-b8cc-6960ea4926ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:25.681880 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 243/488] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:25.688839 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71d6de-eff7-4b82-b8cc-6960ea4926ed admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:25.698864 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71d6de-eff7-4b82-b8cc-6960ea4926ed admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:25.701447 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-6942b948-6ef1-4253-a327-09ae68f59986 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:25.703539 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389797ef-a6f0-4fa6-9087-58c83decf667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:25.704233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389797ef-a6f0-4fa6-9087-58c83decf667 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.704514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389797ef-a6f0-4fa6-9087-58c83decf667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.704829 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389797ef-a6f0-4fa6-9087-58c83decf667 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.705567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389797ef-a6f0-4fa6-9087-58c83decf667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:25.705870 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389797ef-a6f0-4fa6-9087-58c83decf667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:25.707656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389797ef-a6f0-4fa6-9087-58c83decf667 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:25.711060 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 246/489] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:25.718433 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942b948-6ef1-4253-a327-09ae68f59986 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:25.725800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 244/490] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:25.732398 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389797ef-a6f0-4fa6-9087-58c83decf667 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:25.743011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389797ef-a6f0-4fa6-9087-58c83decf667 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:25.747711 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9911224-d0f4-41c5-9890-837b99a7fc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:25.748122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942b948-6ef1-4253-a327-09ae68f59986 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:25.749145 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9911224-d0f4-41c5-9890-837b99a7fc57 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.749442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9911224-d0f4-41c5-9890-837b99a7fc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.749765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9911224-d0f4-41c5-9890-837b99a7fc57 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.757756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9911224-d0f4-41c5-9890-837b99a7fc57 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:25.760198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9911224-d0f4-41c5-9890-837b99a7fc57 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:25.763188 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28ffc9-ef2e-42d7-a4ad-0615f8050f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:25.763853 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28ffc9-ef2e-42d7-a4ad-0615f8050f5a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.764167 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28ffc9-ef2e-42d7-a4ad-0615f8050f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.764438 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28ffc9-ef2e-42d7-a4ad-0615f8050f5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.765176 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28ffc9-ef2e-42d7-a4ad-0615f8050f5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:25.765480 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28ffc9-ef2e-42d7-a4ad-0615f8050f5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:25.767096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28ffc9-ef2e-42d7-a4ad-0615f8050f5a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:25.775705 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-b9911224-d0f4-41c5-9890-837b99a7fc57 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 02:51:25.777229 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 245/491] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Dec 15 02:51:25 2021] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:25.783606 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9911224-d0f4-41c5-9890-837b99a7fc57 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:25.788122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 247/492] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:25.797034 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9911224-d0f4-41c5-9890-837b99a7fc57 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:25.800506 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28ffc9-ef2e-42d7-a4ad-0615f8050f5a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:25.803519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c9f63-1681-4f27-9e4c-f4cc83a0886a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:25.804347 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c9f63-1681-4f27-9e4c-f4cc83a0886a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.804777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c9f63-1681-4f27-9e4c-f4cc83a0886a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.805196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c9f63-1681-4f27-9e4c-f4cc83a0886a admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.806218 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c9f63-1681-4f27-9e4c-f4cc83a0886a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:25.806686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c9f63-1681-4f27-9e4c-f4cc83a0886a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:25.807848 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-593c9f63-1681-4f27-9e4c-f4cc83a0886a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:25.807848 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:51:25.807848 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:51:25.809259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c9f63-1681-4f27-9e4c-f4cc83a0886a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:25.818327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28ffc9-ef2e-42d7-a4ad-0615f8050f5a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:25.824206 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20265cd5-f5ac-4eb7-9e88-35b91e94f53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:25.825007 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20265cd5-f5ac-4eb7-9e88-35b91e94f53a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.825332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20265cd5-f5ac-4eb7-9e88-35b91e94f53a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.825704 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20265cd5-f5ac-4eb7-9e88-35b91e94f53a admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.838517 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20265cd5-f5ac-4eb7-9e88-35b91e94f53a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:25.840694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20265cd5-f5ac-4eb7-9e88-35b91e94f53a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:25.850948 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 246/493] 10.222.0.18 () {56 vars in 1154 bytes} [Wed Dec 15 02:51:25 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:25.861052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6ac6c-c97f-47c3-b48b-81c52ab1be3a None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.861251 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-20265cd5-f5ac-4eb7-9e88-35b91e94f53a admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 02:51:25.861251 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 248/494] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:25 2021] GET /identity/v3/users/glance => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:25.861433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6ac6c-c97f-47c3-b48b-81c52ab1be3a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.861433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6ac6c-c97f-47c3-b48b-81c52ab1be3a None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.861433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 247/495] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:25 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:25.867132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20265cd5-f5ac-4eb7-9e88-35b91e94f53a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:25.867317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6ac6c-c97f-47c3-b48b-81c52ab1be3a None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:25.879316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20265cd5-f5ac-4eb7-9e88-35b91e94f53a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:25.882200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6ac6c-c97f-47c3-b48b-81c52ab1be3a None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:25.884814 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94893fea-ca9c-4df7-b9f3-5a3d518488bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:25.885749 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94893fea-ca9c-4df7-b9f3-5a3d518488bd admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.886280 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94893fea-ca9c-4df7-b9f3-5a3d518488bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.886783 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94893fea-ca9c-4df7-b9f3-5a3d518488bd admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.887631 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b7cf4-5e97-42c7-bbf0-b7be1a14227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:25.888117 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94893fea-ca9c-4df7-b9f3-5a3d518488bd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:25.888292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b7cf4-5e97-42c7-bbf0-b7be1a14227c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.888544 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b7cf4-5e97-42c7-bbf0-b7be1a14227c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.888869 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b7cf4-5e97-42c7-bbf0-b7be1a14227c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.889234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94893fea-ca9c-4df7-b9f3-5a3d518488bd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:25.890498 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-94893fea-ca9c-4df7-b9f3-5a3d518488bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:25.890498 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:51:25.890498 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:51:25.891966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94893fea-ca9c-4df7-b9f3-5a3d518488bd admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:25.897649 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b7cf4-5e97-42c7-bbf0-b7be1a14227c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:25.899556 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b7cf4-5e97-42c7-bbf0-b7be1a14227c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:25.909841 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 248/496] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:25.914743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8670e19-5e5e-49ef-b79b-3ac340608bff None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.914743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8670e19-5e5e-49ef-b79b-3ac340608bff None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.914743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8670e19-5e5e-49ef-b79b-3ac340608bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.931560 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-a8670e19-5e5e-49ef-b79b-3ac340608bff None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:25.932877 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-a8670e19-5e5e-49ef-b79b-3ac340608bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:25.946678 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 249/497] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:25.946678 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8670e19-5e5e-49ef-b79b-3ac340608bff None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:25.947325 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 249/498] 10.222.0.18 () {56 vars in 1158 bytes} [Wed Dec 15 02:51:25 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:25.948412 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94893fea-ca9c-4df7-b9f3-5a3d518488bd admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:25.963406 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94893fea-ca9c-4df7-b9f3-5a3d518488bd admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:25.966212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8670e19-5e5e-49ef-b79b-3ac340608bff None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:25.975661 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d76fb-46bd-4d95-a178-34a05aa4688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:25.976457 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d76fb-46bd-4d95-a178-34a05aa4688f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.976741 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d76fb-46bd-4d95-a178-34a05aa4688f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.977018 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d76fb-46bd-4d95-a178-34a05aa4688f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.979392 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14508ae-4f23-4935-8842-1dabd503bf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:25.980037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14508ae-4f23-4935-8842-1dabd503bf16 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:25.980318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14508ae-4f23-4935-8842-1dabd503bf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:25.980593 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14508ae-4f23-4935-8842-1dabd503bf16 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:25.992242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14508ae-4f23-4935-8842-1dabd503bf16 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:25.995595 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14508ae-4f23-4935-8842-1dabd503bf16 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:25.996590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d76fb-46bd-4d95-a178-34a05aa4688f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:25.998420 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d76fb-46bd-4d95-a178-34a05aa4688f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.007085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 250/499] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:26.008231 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14508ae-4f23-4935-8842-1dabd503bf16 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.017810 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14508ae-4f23-4935-8842-1dabd503bf16 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.020071 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-b22d76fb-46bd-4d95-a178-34a05aa4688f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:26.021508 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 250/500] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:26.023117 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a65f5-ab86-4256-82f9-9532f19295e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.024217 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a65f5-ab86-4256-82f9-9532f19295e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.024716 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a65f5-ab86-4256-82f9-9532f19295e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.025202 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a65f5-ab86-4256-82f9-9532f19295e5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.027001 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d76fb-46bd-4d95-a178-34a05aa4688f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.036970 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d76fb-46bd-4d95-a178-34a05aa4688f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.039470 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a65f5-ab86-4256-82f9-9532f19295e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:26.041509 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc37b3-912b-4cd5-8f03-0b093644501b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.042305 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc37b3-912b-4cd5-8f03-0b093644501b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.042585 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc37b3-912b-4cd5-8f03-0b093644501b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.042868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc37b3-912b-4cd5-8f03-0b093644501b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.049284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-4f9a65f5-ab86-4256-82f9-9532f19295e5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:26.050536 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 251/501] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:26.056144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a65f5-ab86-4256-82f9-9532f19295e5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.060736 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc37b3-912b-4cd5-8f03-0b093644501b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.062772 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc37b3-912b-4cd5-8f03-0b093644501b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.069202 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a65f5-ab86-4256-82f9-9532f19295e5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.075414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db13c9-8120-45ce-8057-06c036c5a69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.076369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db13c9-8120-45ce-8057-06c036c5a69e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.076882 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db13c9-8120-45ce-8057-06c036c5a69e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.077401 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db13c9-8120-45ce-8057-06c036c5a69e admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.078390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db13c9-8120-45ce-8057-06c036c5a69e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:26.078922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db13c9-8120-45ce-8057-06c036c5a69e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.079921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-15fc37b3-912b-4cd5-8f03-0b093644501b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:26.080964 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db13c9-8120-45ce-8057-06c036c5a69e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.081088 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 251/502] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:26.081827 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc37b3-912b-4cd5-8f03-0b093644501b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.095490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 252/503] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:26.096600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db13c9-8120-45ce-8057-06c036c5a69e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.096844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc37b3-912b-4cd5-8f03-0b093644501b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.106649 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9fa31-6454-4792-8e71-b13f06f757a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.107312 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9fa31-6454-4792-8e71-b13f06f757a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.107591 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9fa31-6454-4792-8e71-b13f06f757a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.107930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9fa31-6454-4792-8e71-b13f06f757a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.109185 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9fa31-6454-4792-8e71-b13f06f757a5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:26.109494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9fa31-6454-4792-8e71-b13f06f757a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.109736 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db13c9-8120-45ce-8057-06c036c5a69e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.111137 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9fa31-6454-4792-8e71-b13f06f757a5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.115478 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601d794-e7f4-41c0-8789-525c4b85b13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.116857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601d794-e7f4-41c0-8789-525c4b85b13c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.117347 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601d794-e7f4-41c0-8789-525c4b85b13c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.118162 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601d794-e7f4-41c0-8789-525c4b85b13c admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.119137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601d794-e7f4-41c0-8789-525c4b85b13c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:26.119637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 252/504] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:26.119954 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601d794-e7f4-41c0-8789-525c4b85b13c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.120425 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9fa31-6454-4792-8e71-b13f06f757a5 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.122154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601d794-e7f4-41c0-8789-525c4b85b13c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.129954 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9fa31-6454-4792-8e71-b13f06f757a5 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.135418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671865d8-0343-46fc-9de0-eecd25fd61f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.136205 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671865d8-0343-46fc-9de0-eecd25fd61f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.136519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671865d8-0343-46fc-9de0-eecd25fd61f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.136727 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671865d8-0343-46fc-9de0-eecd25fd61f0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.139361 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 253/505] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:26.140823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601d794-e7f4-41c0-8789-525c4b85b13c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.148757 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671865d8-0343-46fc-9de0-eecd25fd61f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.150783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671865d8-0343-46fc-9de0-eecd25fd61f0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.151978 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601d794-e7f4-41c0-8789-525c4b85b13c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.158352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9102d64-346d-457c-aa46-22c929554de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.159436 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9102d64-346d-457c-aa46-22c929554de4 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.159914 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9102d64-346d-457c-aa46-22c929554de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.160422 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9102d64-346d-457c-aa46-22c929554de4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.165290 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-671865d8-0343-46fc-9de0-eecd25fd61f0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:26.166499 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 253/506] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:26.167251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671865d8-0343-46fc-9de0-eecd25fd61f0 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.173469 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9102d64-346d-457c-aa46-22c929554de4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.175853 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9102d64-346d-457c-aa46-22c929554de4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.182552 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671865d8-0343-46fc-9de0-eecd25fd61f0 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.187333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ded566-1675-4c69-aac5-04cc063c4fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.188105 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ded566-1675-4c69-aac5-04cc063c4fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.188387 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ded566-1675-4c69-aac5-04cc063c4fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.188660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ded566-1675-4c69-aac5-04cc063c4fe7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.195699 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ded566-1675-4c69-aac5-04cc063c4fe7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.197659 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ded566-1675-4c69-aac5-04cc063c4fe7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.208336 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-e9102d64-346d-457c-aa46-22c929554de4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:26.209213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 254/507] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:26.210007 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9102d64-346d-457c-aa46-22c929554de4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.218544 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-68ded566-1675-4c69-aac5-04cc063c4fe7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:26.219669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 254/508] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:26.220421 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ded566-1675-4c69-aac5-04cc063c4fe7 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.227991 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9102d64-346d-457c-aa46-22c929554de4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.234607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0db984-ae0d-42bd-9477-88c75657a19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.235542 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0db984-ae0d-42bd-9477-88c75657a19e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.236022 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ded566-1675-4c69-aac5-04cc063c4fe7 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.236337 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0db984-ae0d-42bd-9477-88c75657a19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.236933 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0db984-ae0d-42bd-9477-88c75657a19e admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.240209 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0db984-ae0d-42bd-9477-88c75657a19e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:26.240827 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0db984-ae0d-42bd-9477-88c75657a19e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.242401 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608371c-0f91-4d6e-b015-3015a41c8460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.242639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-9b0db984-ae0d-42bd-9477-88c75657a19e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:26.242639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:51:26.242639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:51:26.243033 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608371c-0f91-4d6e-b015-3015a41c8460 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.243318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608371c-0f91-4d6e-b015-3015a41c8460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.243594 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608371c-0f91-4d6e-b015-3015a41c8460 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.244322 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608371c-0f91-4d6e-b015-3015a41c8460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:26.244625 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608371c-0f91-4d6e-b015-3015a41c8460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.245237 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0db984-ae0d-42bd-9477-88c75657a19e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.246241 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608371c-0f91-4d6e-b015-3015a41c8460 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.257974 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 255/509] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:26.258641 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608371c-0f91-4d6e-b015-3015a41c8460 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.268689 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608371c-0f91-4d6e-b015-3015a41c8460 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.269221 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 255/510] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:26.270364 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0db984-ae0d-42bd-9477-88c75657a19e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.278374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0f5f-8847-4db9-8201-a676fc15695f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.279023 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0f5f-8847-4db9-8201-a676fc15695f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.279322 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0f5f-8847-4db9-8201-a676fc15695f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.279583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0f5f-8847-4db9-8201-a676fc15695f admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.281072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d0f5f-8847-4db9-8201-a676fc15695f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:26.281299 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d0f5f-8847-4db9-8201-a676fc15695f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.282355 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-010d0f5f-8847-4db9-8201-a676fc15695f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:26.282355 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:51:26.282355 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:51:26.283400 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0db984-ae0d-42bd-9477-88c75657a19e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.283511 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d0f5f-8847-4db9-8201-a676fc15695f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.287914 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7d9d2-d44f-41ff-9fb1-b13fe447e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.288687 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7d9d2-d44f-41ff-9fb1-b13fe447e190 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.288967 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7d9d2-d44f-41ff-9fb1-b13fe447e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.289242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7d9d2-d44f-41ff-9fb1-b13fe447e190 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.297035 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7d9d2-d44f-41ff-9fb1-b13fe447e190 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.299077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7d9d2-d44f-41ff-9fb1-b13fe447e190 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.301961 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 256/511] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:26.307709 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0f5f-8847-4db9-8201-a676fc15695f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.314375 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-def7d9d2-d44f-41ff-9fb1-b13fe447e190 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 02:51:26.315628 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 256/512] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:26.316677 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68159607-f236-4fa8-bb77-0dca328ec844 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.317025 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68159607-f236-4fa8-bb77-0dca328ec844 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.317295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68159607-f236-4fa8-bb77-0dca328ec844 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.322111 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 257/513] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:26.322111 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68159607-f236-4fa8-bb77-0dca328ec844 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.322297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0f5f-8847-4db9-8201-a676fc15695f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.326219 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d65ed-0b0e-4221-8b4d-f888340be508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.327464 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d65ed-0b0e-4221-8b4d-f888340be508 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.327810 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d65ed-0b0e-4221-8b4d-f888340be508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.328084 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d65ed-0b0e-4221-8b4d-f888340be508 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.329011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d65ed-0b0e-4221-8b4d-f888340be508 admin admin] RBAC: Adding query filter params (role.id=4f557aac969f4c2f95aee8e21d67c802, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=fcd50adcd390465ea6fc8582e1524909) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:26.329346 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d65ed-0b0e-4221-8b4d-f888340be508 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.331392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d65ed-0b0e-4221-8b4d-f888340be508 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.334101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68159607-f236-4fa8-bb77-0dca328ec844 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.338016 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 257/514] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/role_assignments?user.id=fcd50adcd390465ea6fc8582e1524909&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=4f557aac969f4c2f95aee8e21d67c802 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:26.338752 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d65ed-0b0e-4221-8b4d-f888340be508 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.344087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b737e-d8a9-469a-b2bc-154b38ad20e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.345039 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b737e-d8a9-469a-b2bc-154b38ad20e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.345523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b737e-d8a9-469a-b2bc-154b38ad20e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.345996 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b737e-d8a9-469a-b2bc-154b38ad20e3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.347003 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b737e-d8a9-469a-b2bc-154b38ad20e3 admin admin] RBAC: Adding query filter params (role.id=4f557aac969f4c2f95aee8e21d67c802, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=e48dcc22c7df4aed8fa6cf32e3c2ec51) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:26.347318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b737e-d8a9-469a-b2bc-154b38ad20e3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.349209 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b737e-d8a9-469a-b2bc-154b38ad20e3 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.349905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d65ed-0b0e-4221-8b4d-f888340be508 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.355028 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec960c8-a8f0-4230-8727-ea8e56ef5c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.356032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 258/515] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/role_assignments?user.id=e48dcc22c7df4aed8fa6cf32e3c2ec51&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=4f557aac969f4c2f95aee8e21d67c802 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:26.357337 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bc390-4d03-464c-beae-85d87c2835d6 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.357621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bc390-4d03-464c-beae-85d87c2835d6 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.357939 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bc390-4d03-464c-beae-85d87c2835d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.358287 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec960c8-a8f0-4230-8727-ea8e56ef5c5e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.358730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec960c8-a8f0-4230-8727-ea8e56ef5c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.359215 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec960c8-a8f0-4230-8727-ea8e56ef5c5e admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.360274 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec960c8-a8f0-4230-8727-ea8e56ef5c5e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:26.360833 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec960c8-a8f0-4230-8727-ea8e56ef5c5e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.363082 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec960c8-a8f0-4230-8727-ea8e56ef5c5e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.378962 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-6b8bc390-4d03-464c-beae-85d87c2835d6 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:26.380969 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6b8bc390-4d03-464c-beae-85d87c2835d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:26.383736 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 258/516] 10.222.0.18 () {56 vars in 1158 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:26.390352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 259/517] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:26.391253 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec960c8-a8f0-4230-8727-ea8e56ef5c5e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.403735 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec960c8-a8f0-4230-8727-ea8e56ef5c5e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.410195 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384067a-86c4-4a85-99c1-88af1df17eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.411189 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384067a-86c4-4a85-99c1-88af1df17eab admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.411641 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384067a-86c4-4a85-99c1-88af1df17eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.412109 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384067a-86c4-4a85-99c1-88af1df17eab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.421708 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384067a-86c4-4a85-99c1-88af1df17eab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.424013 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384067a-86c4-4a85-99c1-88af1df17eab admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.428763 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bc390-4d03-464c-beae-85d87c2835d6 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.435597 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 259/518] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:26.442285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384067a-86c4-4a85-99c1-88af1df17eab admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.445799 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bc390-4d03-464c-beae-85d87c2835d6 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.452945 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384067a-86c4-4a85-99c1-88af1df17eab admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.460431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92927268-7dd5-416d-9bd7-87637b389a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.463241 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92927268-7dd5-416d-9bd7-87637b389a7c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.464288 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92927268-7dd5-416d-9bd7-87637b389a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.465059 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92927268-7dd5-416d-9bd7-87637b389a7c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.468495 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ed0fc-0db7-476d-9ad1-37ba0d606798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.470501 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ed0fc-0db7-476d-9ad1-37ba0d606798 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.471449 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ed0fc-0db7-476d-9ad1-37ba0d606798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.472749 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ed0fc-0db7-476d-9ad1-37ba0d606798 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.494579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92927268-7dd5-416d-9bd7-87637b389a7c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:26.496323 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ed0fc-0db7-476d-9ad1-37ba0d606798 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.501173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ed0fc-0db7-476d-9ad1-37ba0d606798 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.506676 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-92927268-7dd5-416d-9bd7-87637b389a7c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:26.518056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 260/519] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:26.524169 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92927268-7dd5-416d-9bd7-87637b389a7c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.526627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-9c5ed0fc-0db7-476d-9ad1-37ba0d606798 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:26.528558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 260/520] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:26.535560 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ed0fc-0db7-476d-9ad1-37ba0d606798 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.546320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ed0fc-0db7-476d-9ad1-37ba0d606798 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.548654 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92927268-7dd5-416d-9bd7-87637b389a7c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.551794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700eff4-975f-4a7e-8509-3bdd8db87253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.552824 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700eff4-975f-4a7e-8509-3bdd8db87253 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.553302 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700eff4-975f-4a7e-8509-3bdd8db87253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.553745 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700eff4-975f-4a7e-8509-3bdd8db87253 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.554782 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700eff4-975f-4a7e-8509-3bdd8db87253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:26.555314 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700eff4-975f-4a7e-8509-3bdd8db87253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.557254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700eff4-975f-4a7e-8509-3bdd8db87253 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.570856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420be90-2fad-4759-9f2d-02f671150f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.571542 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420be90-2fad-4759-9f2d-02f671150f6a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.571834 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420be90-2fad-4759-9f2d-02f671150f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.572114 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420be90-2fad-4759-9f2d-02f671150f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.572526 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 261/521] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:26.578117 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420be90-2fad-4759-9f2d-02f671150f6a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:26.578117 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420be90-2fad-4759-9f2d-02f671150f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.578117 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420be90-2fad-4759-9f2d-02f671150f6a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.579593 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700eff4-975f-4a7e-8509-3bdd8db87253 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.590272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700eff4-975f-4a7e-8509-3bdd8db87253 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.593141 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 261/522] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:26.596221 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee1e68-7e4c-48c2-83ea-fa1bc9385862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.597330 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee1e68-7e4c-48c2-83ea-fa1bc9385862 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.597782 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee1e68-7e4c-48c2-83ea-fa1bc9385862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.598609 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee1e68-7e4c-48c2-83ea-fa1bc9385862 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.599451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420be90-2fad-4759-9f2d-02f671150f6a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.606917 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee1e68-7e4c-48c2-83ea-fa1bc9385862 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.609304 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee1e68-7e4c-48c2-83ea-fa1bc9385862 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.620844 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420be90-2fad-4759-9f2d-02f671150f6a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.624591 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-9cee1e68-7e4c-48c2-83ea-fa1bc9385862 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:26.627149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 262/523] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:26.632436 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd1c2c-df4c-444f-b96d-d3fecf619f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.632436 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd1c2c-df4c-444f-b96d-d3fecf619f79 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.632436 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd1c2c-df4c-444f-b96d-d3fecf619f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.632724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd1c2c-df4c-444f-b96d-d3fecf619f79 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.633768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee1e68-7e4c-48c2-83ea-fa1bc9385862 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.645922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd1c2c-df4c-444f-b96d-d3fecf619f79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.647880 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd1c2c-df4c-444f-b96d-d3fecf619f79 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.647994 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee1e68-7e4c-48c2-83ea-fa1bc9385862 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.653506 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172f183-9563-4d5c-955d-8fc7d97a4f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.654265 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172f183-9563-4d5c-955d-8fc7d97a4f67 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.654543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172f183-9563-4d5c-955d-8fc7d97a4f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.655385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172f183-9563-4d5c-955d-8fc7d97a4f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.656188 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172f183-9563-4d5c-955d-8fc7d97a4f67 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:26.656487 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172f183-9563-4d5c-955d-8fc7d97a4f67 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.658894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172f183-9563-4d5c-955d-8fc7d97a4f67 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.671348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 263/524] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:26.674481 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-58dd1c2c-df4c-444f-b96d-d3fecf619f79 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:26.675694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 262/525] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:26.681948 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172f183-9563-4d5c-955d-8fc7d97a4f67 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.682652 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd1c2c-df4c-444f-b96d-d3fecf619f79 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.692656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172f183-9563-4d5c-955d-8fc7d97a4f67 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.693538 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd1c2c-df4c-444f-b96d-d3fecf619f79 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.697096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e3fab-cef7-407f-b572-33f4ff00a664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.697840 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e3fab-cef7-407f-b572-33f4ff00a664 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.698178 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e3fab-cef7-407f-b572-33f4ff00a664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.698454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e3fab-cef7-407f-b572-33f4ff00a664 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.699072 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3655e-1778-4e2f-8475-b9b7ea2df543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.699190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e3fab-cef7-407f-b572-33f4ff00a664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:26.699475 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e3fab-cef7-407f-b572-33f4ff00a664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.700307 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3655e-1778-4e2f-8475-b9b7ea2df543 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.700772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3655e-1778-4e2f-8475-b9b7ea2df543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.701079 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e3fab-cef7-407f-b572-33f4ff00a664 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.701457 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3655e-1778-4e2f-8475-b9b7ea2df543 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.703244 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3655e-1778-4e2f-8475-b9b7ea2df543 admin admin] RBAC: Adding query filter params (role.id=4f557aac969f4c2f95aee8e21d67c802, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=d543ba91ee284c1384f15fb70910caf6) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:26.703798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3655e-1778-4e2f-8475-b9b7ea2df543 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.705920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3655e-1778-4e2f-8475-b9b7ea2df543 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.712050 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 263/526] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/role_assignments?user.id=d543ba91ee284c1384f15fb70910caf6&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=4f557aac969f4c2f95aee8e21d67c802 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:26.718063 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 264/527] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:26.726110 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3655e-1778-4e2f-8475-b9b7ea2df543 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.735056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3655e-1778-4e2f-8475-b9b7ea2df543 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.750167 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991c289-ec02-4d86-98b3-a061d585cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.751224 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991c289-ec02-4d86-98b3-a061d585cd79 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.751605 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991c289-ec02-4d86-98b3-a061d585cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.751976 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991c289-ec02-4d86-98b3-a061d585cd79 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.767042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991c289-ec02-4d86-98b3-a061d585cd79 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.769211 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991c289-ec02-4d86-98b3-a061d585cd79 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.789100 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-0991c289-ec02-4d86-98b3-a061d585cd79 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 02:51:26.790812 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 264/528] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/users/neutron => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:26.796960 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e3fab-cef7-407f-b572-33f4ff00a664 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.810198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e3fab-cef7-407f-b572-33f4ff00a664 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.819935 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376c814-dbb3-49c8-932e-f15f73d6037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.820806 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376c814-dbb3-49c8-932e-f15f73d6037d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.821214 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376c814-dbb3-49c8-932e-f15f73d6037d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.821579 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376c814-dbb3-49c8-932e-f15f73d6037d admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.822686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376c814-dbb3-49c8-932e-f15f73d6037d admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:26.823096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376c814-dbb3-49c8-932e-f15f73d6037d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.825228 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376c814-dbb3-49c8-932e-f15f73d6037d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.851292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 265/529] 10.222.0.18 () {56 vars in 1160 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:26.857590 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991c289-ec02-4d86-98b3-a061d585cd79 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.868567 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991c289-ec02-4d86-98b3-a061d585cd79 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.878639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942669a6-53fd-4962-a08d-39a75cef3d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.879536 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942669a6-53fd-4962-a08d-39a75cef3d9d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.879913 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942669a6-53fd-4962-a08d-39a75cef3d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.880291 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942669a6-53fd-4962-a08d-39a75cef3d9d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.891054 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942669a6-53fd-4962-a08d-39a75cef3d9d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.893178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942669a6-53fd-4962-a08d-39a75cef3d9d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.908735 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 265/530] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:26.914790 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376c814-dbb3-49c8-932e-f15f73d6037d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:26.931554 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376c814-dbb3-49c8-932e-f15f73d6037d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:26.939953 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afc1da-8c37-48d0-aa3c-6fcbd086e3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:26.940944 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afc1da-8c37-48d0-aa3c-6fcbd086e3bf admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:26.941359 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afc1da-8c37-48d0-aa3c-6fcbd086e3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:26.941726 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afc1da-8c37-48d0-aa3c-6fcbd086e3bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:26.956676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afc1da-8c37-48d0-aa3c-6fcbd086e3bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:26.958789 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afc1da-8c37-48d0-aa3c-6fcbd086e3bf admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:26.982895 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-23afc1da-8c37-48d0-aa3c-6fcbd086e3bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:26.984547 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 266/531] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:26.990379 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942669a6-53fd-4962-a08d-39a75cef3d9d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:27.001629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942669a6-53fd-4962-a08d-39a75cef3d9d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:27.009314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ae22c-52d8-44f5-8fdb-d4776cd741bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:27.010514 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ae22c-52d8-44f5-8fdb-d4776cd741bb admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:27.010989 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ae22c-52d8-44f5-8fdb-d4776cd741bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:27.011452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ae22c-52d8-44f5-8fdb-d4776cd741bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:27.012397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ae22c-52d8-44f5-8fdb-d4776cd741bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:27.012931 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ae22c-52d8-44f5-8fdb-d4776cd741bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:27.015373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ae22c-52d8-44f5-8fdb-d4776cd741bb admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:27.028043 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 266/532] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:27.034293 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afc1da-8c37-48d0-aa3c-6fcbd086e3bf admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:27.044667 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afc1da-8c37-48d0-aa3c-6fcbd086e3bf admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:27.055523 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a2619-3101-4f67-ab6f-e061f8e61168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:27.056308 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a2619-3101-4f67-ab6f-e061f8e61168 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:27.056587 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a2619-3101-4f67-ab6f-e061f8e61168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:27.056863 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a2619-3101-4f67-ab6f-e061f8e61168 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:27.064611 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a2619-3101-4f67-ab6f-e061f8e61168 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:27.066591 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a2619-3101-4f67-ab6f-e061f8e61168 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:27.086454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-200a2619-3101-4f67-ab6f-e061f8e61168 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:27.087805 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 267/533] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:27.094121 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ae22c-52d8-44f5-8fdb-d4776cd741bb admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:27.110015 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ae22c-52d8-44f5-8fdb-d4776cd741bb admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:27.116700 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fac781-9a1f-4033-9404-f395f647e211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:27.117563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fac781-9a1f-4033-9404-f395f647e211 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:27.118134 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fac781-9a1f-4033-9404-f395f647e211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:27.118697 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fac781-9a1f-4033-9404-f395f647e211 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:27.119702 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fac781-9a1f-4033-9404-f395f647e211 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:27.120248 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fac781-9a1f-4033-9404-f395f647e211 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:27.122377 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fac781-9a1f-4033-9404-f395f647e211 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:27.150004 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 267/534] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:27.150172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a2619-3101-4f67-ab6f-e061f8e61168 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:27.173171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a2619-3101-4f67-ab6f-e061f8e61168 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:27.181233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd6d56-b99a-4b79-b4c9-9f5261fb3765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:27.181887 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd6d56-b99a-4b79-b4c9-9f5261fb3765 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:27.182194 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd6d56-b99a-4b79-b4c9-9f5261fb3765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:27.182471 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd6d56-b99a-4b79-b4c9-9f5261fb3765 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:27.183318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd6d56-b99a-4b79-b4c9-9f5261fb3765 admin admin] RBAC: Adding query filter params (role.id=4f557aac969f4c2f95aee8e21d67c802, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=eb120cde66b246909cf8e0b7b8d96ae8) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:27.183625 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd6d56-b99a-4b79-b4c9-9f5261fb3765 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:27.185456 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd6d56-b99a-4b79-b4c9-9f5261fb3765 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:27.200289 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 268/535] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:27 2021] GET /identity/v3/role_assignments?user.id=eb120cde66b246909cf8e0b7b8d96ae8&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=4f557aac969f4c2f95aee8e21d67c802 => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:27.328153 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e045a-dd8d-4e89-88c0-eb6c22876ee5 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:27.328808 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e045a-dd8d-4e89-88c0-eb6c22876ee5 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:27.329276 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e045a-dd8d-4e89-88c0-eb6c22876ee5 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:27.331747 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 268/536] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:27.337922 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86138f6-b6dc-499e-a994-2d292e21edc8 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:27.338239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86138f6-b6dc-499e-a994-2d292e21edc8 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:27.338531 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86138f6-b6dc-499e-a994-2d292e21edc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:27.360153 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c86138f6-b6dc-499e-a994-2d292e21edc8 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:27.361373 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c86138f6-b6dc-499e-a994-2d292e21edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:27.372171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 269/537] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:27.398276 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e045a-dd8d-4e89-88c0-eb6c22876ee5 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:27.411415 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e045a-dd8d-4e89-88c0-eb6c22876ee5 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:27.415822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e7f18-0444-4074-bd7b-d497741110d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:27.416655 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e7f18-0444-4074-bd7b-d497741110d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:27.416940 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e7f18-0444-4074-bd7b-d497741110d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:27.417219 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e7f18-0444-4074-bd7b-d497741110d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:27.428549 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e7f18-0444-4074-bd7b-d497741110d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:27.430444 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e7f18-0444-4074-bd7b-d497741110d0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:27.448828 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-f54e7f18-0444-4074-bd7b-d497741110d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:27.454086 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 269/538] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:27.457434 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86138f6-b6dc-499e-a994-2d292e21edc8 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:27.466885 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86138f6-b6dc-499e-a994-2d292e21edc8 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:27.477047 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff07ed2-31e0-42fa-b9cf-d2d0c893689b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:27.478032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff07ed2-31e0-42fa-b9cf-d2d0c893689b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:27.478456 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff07ed2-31e0-42fa-b9cf-d2d0c893689b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:27.478986 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff07ed2-31e0-42fa-b9cf-d2d0c893689b admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:27.479893 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff07ed2-31e0-42fa-b9cf-d2d0c893689b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:27.480350 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff07ed2-31e0-42fa-b9cf-d2d0c893689b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:27.482294 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff07ed2-31e0-42fa-b9cf-d2d0c893689b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:27.502413 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 270/539] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:27.508716 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e7f18-0444-4074-bd7b-d497741110d0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:27.522451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e7f18-0444-4074-bd7b-d497741110d0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:27.527528 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66098c-8284-4323-b216-88da6e7ead69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:27.528436 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66098c-8284-4323-b216-88da6e7ead69 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:27.528866 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66098c-8284-4323-b216-88da6e7ead69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:27.529365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66098c-8284-4323-b216-88da6e7ead69 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:27.530358 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66098c-8284-4323-b216-88da6e7ead69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:27.537888 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66098c-8284-4323-b216-88da6e7ead69 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:27.569763 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 270/540] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:51:27 2021] POST /identity/v3/users => generated 247 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:51:29.163633 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122a273-d0cd-4da6-ac0a-f3a2e42562e9 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.164148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122a273-d0cd-4da6-ac0a-f3a2e42562e9 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.164148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122a273-d0cd-4da6-ac0a-f3a2e42562e9 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.166201 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 271/541] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:29.172077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bca4c-3edc-491f-a331-abccab0c1e2d None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.172880 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bca4c-3edc-491f-a331-abccab0c1e2d None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.173378 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bca4c-3edc-491f-a331-abccab0c1e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.194395 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-271bca4c-3edc-491f-a331-abccab0c1e2d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:29.195942 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-271bca4c-3edc-491f-a331-abccab0c1e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:29.210526 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 271/542] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:29.241949 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122a273-d0cd-4da6-ac0a-f3a2e42562e9 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.259873 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122a273-d0cd-4da6-ac0a-f3a2e42562e9 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.268799 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e2727-af60-48b1-8ecd-db21f95c6759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.269574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e2727-af60-48b1-8ecd-db21f95c6759 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.269852 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e2727-af60-48b1-8ecd-db21f95c6759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.270162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e2727-af60-48b1-8ecd-db21f95c6759 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.286855 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e2727-af60-48b1-8ecd-db21f95c6759 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:29.293777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-4c2e2727-af60-48b1-8ecd-db21f95c6759 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:29.295322 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 272/543] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:29.301086 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bca4c-3edc-491f-a331-abccab0c1e2d None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.315576 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bca4c-3edc-491f-a331-abccab0c1e2d None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.324992 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552a6b5-0f6e-4202-be0b-99998fbca7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.325922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552a6b5-0f6e-4202-be0b-99998fbca7bc admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.326430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552a6b5-0f6e-4202-be0b-99998fbca7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.327473 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552a6b5-0f6e-4202-be0b-99998fbca7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.328539 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552a6b5-0f6e-4202-be0b-99998fbca7bc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:29.329112 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552a6b5-0f6e-4202-be0b-99998fbca7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:29.331013 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552a6b5-0f6e-4202-be0b-99998fbca7bc admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:29.345851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 272/544] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:29.351813 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e2727-af60-48b1-8ecd-db21f95c6759 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.367463 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e2727-af60-48b1-8ecd-db21f95c6759 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.372969 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b40f8a-d4c7-4535-a7ba-4f1ff61312bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.374559 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b40f8a-d4c7-4535-a7ba-4f1ff61312bc admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.375046 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b40f8a-d4c7-4535-a7ba-4f1ff61312bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.375560 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b40f8a-d4c7-4535-a7ba-4f1ff61312bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.389612 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b40f8a-d4c7-4535-a7ba-4f1ff61312bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:29.391829 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b40f8a-d4c7-4535-a7ba-4f1ff61312bc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:29.413578 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-b1b40f8a-d4c7-4535-a7ba-4f1ff61312bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:29.419801 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 273/545] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:29.421617 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552a6b5-0f6e-4202-be0b-99998fbca7bc admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.431949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552a6b5-0f6e-4202-be0b-99998fbca7bc admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.440773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd73b6-7b98-4b8b-bab3-377483b91c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.441680 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd73b6-7b98-4b8b-bab3-377483b91c81 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.442204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd73b6-7b98-4b8b-bab3-377483b91c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.442699 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd73b6-7b98-4b8b-bab3-377483b91c81 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.443630 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd73b6-7b98-4b8b-bab3-377483b91c81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:29.444132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd73b6-7b98-4b8b-bab3-377483b91c81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:29.445927 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd73b6-7b98-4b8b-bab3-377483b91c81 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:29.461543 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 273/546] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:29.467500 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b40f8a-d4c7-4535-a7ba-4f1ff61312bc admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.478567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b40f8a-d4c7-4535-a7ba-4f1ff61312bc admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.480910 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b2648-6af5-4a48-9ad2-b234ca9d335d None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.481174 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b2648-6af5-4a48-9ad2-b234ca9d335d None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.481453 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b2648-6af5-4a48-9ad2-b234ca9d335d None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.483785 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 274/547] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:29.487039 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2c9a4-a0cd-467b-bd3e-c5a582afbb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.488169 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2c9a4-a0cd-467b-bd3e-c5a582afbb08 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.488745 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2c9a4-a0cd-467b-bd3e-c5a582afbb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.489190 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41c834-b86f-49c1-a210-7d5dfdb2915e None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.489438 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2c9a4-a0cd-467b-bd3e-c5a582afbb08 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.489538 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41c834-b86f-49c1-a210-7d5dfdb2915e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.489743 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41c834-b86f-49c1-a210-7d5dfdb2915e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.507186 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2c9a4-a0cd-467b-bd3e-c5a582afbb08 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:29.507772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-6e41c834-b86f-49c1-a210-7d5dfdb2915e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:29.508945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6e41c834-b86f-49c1-a210-7d5dfdb2915e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:29.510457 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2c9a4-a0cd-467b-bd3e-c5a582afbb08 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:29.527879 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 275/548] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:51:29.533172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-6ff2c9a4-a0cd-467b-bd3e-c5a582afbb08 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 02:51:29.534713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 274/549] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/users/glance => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:29.540512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41c834-b86f-49c1-a210-7d5dfdb2915e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.551508 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2c9a4-a0cd-467b-bd3e-c5a582afbb08 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.552892 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41c834-b86f-49c1-a210-7d5dfdb2915e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.564025 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2c9a4-a0cd-467b-bd3e-c5a582afbb08 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.566466 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4ac62-6800-424c-b399-e07d2fa1e1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.567155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4ac62-6800-424c-b399-e07d2fa1e1bb admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.567434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4ac62-6800-424c-b399-e07d2fa1e1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.567710 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4ac62-6800-424c-b399-e07d2fa1e1bb admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.568603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4ac62-6800-424c-b399-e07d2fa1e1bb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:29.568918 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4ac62-6800-424c-b399-e07d2fa1e1bb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:29.571647 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4ac62-6800-424c-b399-e07d2fa1e1bb admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:29.581864 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c960b94-80ea-442e-bedb-ea8f90a4af68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.582709 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c960b94-80ea-442e-bedb-ea8f90a4af68 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.582998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c960b94-80ea-442e-bedb-ea8f90a4af68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.583256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c960b94-80ea-442e-bedb-ea8f90a4af68 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.601850 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c960b94-80ea-442e-bedb-ea8f90a4af68 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:29.605690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 276/550] 10.222.0.18 () {56 vars in 1158 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:29.609293 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-3c960b94-80ea-442e-bedb-ea8f90a4af68 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:29.610786 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 275/551] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:29.611651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4ac62-6800-424c-b399-e07d2fa1e1bb admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.616564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c960b94-80ea-442e-bedb-ea8f90a4af68 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.625794 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4ac62-6800-424c-b399-e07d2fa1e1bb admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.626458 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c960b94-80ea-442e-bedb-ea8f90a4af68 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.630749 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e56238-4062-469c-bc79-a1943367f656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.631530 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e56238-4062-469c-bc79-a1943367f656 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.631809 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e56238-4062-469c-bc79-a1943367f656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.632082 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e56238-4062-469c-bc79-a1943367f656 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.636116 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558235c4-c294-479f-9966-8556ef9d7f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.637198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558235c4-c294-479f-9966-8556ef9d7f35 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.638165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558235c4-c294-479f-9966-8556ef9d7f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.638841 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558235c4-c294-479f-9966-8556ef9d7f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.639640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558235c4-c294-479f-9966-8556ef9d7f35 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:29.640836 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558235c4-c294-479f-9966-8556ef9d7f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:29.643342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558235c4-c294-479f-9966-8556ef9d7f35 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:29.657010 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e56238-4062-469c-bc79-a1943367f656 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:29.658878 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e56238-4062-469c-bc79-a1943367f656 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:29.661195 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 276/552] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:29.674489 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558235c4-c294-479f-9966-8556ef9d7f35 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.688663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558235c4-c294-479f-9966-8556ef9d7f35 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.694812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a98b7-af50-4a4d-8d97-19bc3a30d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.695589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a98b7-af50-4a4d-8d97-19bc3a30d319 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.695867 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a98b7-af50-4a4d-8d97-19bc3a30d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.696133 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a98b7-af50-4a4d-8d97-19bc3a30d319 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.696793 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-74e56238-4062-469c-bc79-a1943367f656 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:29.698331 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 277/553] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:29.699699 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e6fe-426a-43c5-99d6-ddd32e7be34a None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.699992 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e6fe-426a-43c5-99d6-ddd32e7be34a None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.700265 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e6fe-426a-43c5-99d6-ddd32e7be34a None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.702279 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 278/554] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:29.704344 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842e6fe-426a-43c5-99d6-ddd32e7be34a None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.709664 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a98b7-af50-4a4d-8d97-19bc3a30d319 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:29.711519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a98b7-af50-4a4d-8d97-19bc3a30d319 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:29.721136 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842e6fe-426a-43c5-99d6-ddd32e7be34a None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.726346 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d6483-f83b-4345-8dae-4948081410c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.727022 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d6483-f83b-4345-8dae-4948081410c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.727353 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d6483-f83b-4345-8dae-4948081410c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.727630 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d6483-f83b-4345-8dae-4948081410c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.728407 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d6483-f83b-4345-8dae-4948081410c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:29.728710 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d6483-f83b-4345-8dae-4948081410c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:29.729582 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-991a98b7-af50-4a4d-8d97-19bc3a30d319 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:29.730434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d6483-f83b-4345-8dae-4948081410c6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:29.731089 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 277/555] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:29.732446 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6a9ce-1dda-4dde-9450-6bc0b6c02989 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.733327 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6a9ce-1dda-4dde-9450-6bc0b6c02989 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.733614 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6a9ce-1dda-4dde-9450-6bc0b6c02989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.750122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 279/556] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:29.751122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d6483-f83b-4345-8dae-4948081410c6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.755921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-49e6a9ce-1dda-4dde-9450-6bc0b6c02989 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:29.757275 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-49e6a9ce-1dda-4dde-9450-6bc0b6c02989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:29.761500 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d6483-f83b-4345-8dae-4948081410c6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.766296 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44512ee4-1ecc-451d-a399-75bbf4dfe301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.766607 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 278/557] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:29.766946 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44512ee4-1ecc-451d-a399-75bbf4dfe301 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.767226 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44512ee4-1ecc-451d-a399-75bbf4dfe301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.767504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44512ee4-1ecc-451d-a399-75bbf4dfe301 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.768238 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44512ee4-1ecc-451d-a399-75bbf4dfe301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:29.768543 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44512ee4-1ecc-451d-a399-75bbf4dfe301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:29.770194 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44512ee4-1ecc-451d-a399-75bbf4dfe301 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:29.772304 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6a9ce-1dda-4dde-9450-6bc0b6c02989 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.788986 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6a9ce-1dda-4dde-9450-6bc0b6c02989 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.791991 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 280/558] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:29.799224 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44512ee4-1ecc-451d-a399-75bbf4dfe301 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.802618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b6338-cd0d-415c-a449-c8a0a9e00ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.803496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b6338-cd0d-415c-a449-c8a0a9e00ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.803772 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b6338-cd0d-415c-a449-c8a0a9e00ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.804040 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b6338-cd0d-415c-a449-c8a0a9e00ed5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.811875 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44512ee4-1ecc-451d-a399-75bbf4dfe301 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.812940 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b6338-cd0d-415c-a449-c8a0a9e00ed5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:29.815023 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b6338-cd0d-415c-a449-c8a0a9e00ed5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:29.817341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ccb9a6-756f-482f-8e92-dd9d979c8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.818686 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccb9a6-756f-482f-8e92-dd9d979c8e51 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.819168 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccb9a6-756f-482f-8e92-dd9d979c8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.819639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccb9a6-756f-482f-8e92-dd9d979c8e51 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.830436 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ccb9a6-756f-482f-8e92-dd9d979c8e51 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:29.830670 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-df1b6338-cd0d-415c-a449-c8a0a9e00ed5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:29.832245 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 279/559] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:29.833150 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b6338-cd0d-415c-a449-c8a0a9e00ed5 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.838530 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-f5ccb9a6-756f-482f-8e92-dd9d979c8e51 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:29.840952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 281/560] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:29.841907 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ccb9a6-756f-482f-8e92-dd9d979c8e51 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.853488 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b6338-cd0d-415c-a449-c8a0a9e00ed5 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.855698 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ccb9a6-756f-482f-8e92-dd9d979c8e51 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.858863 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b838f-ed23-45c1-9bfe-07ce9c6bfe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.859709 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b838f-ed23-45c1-9bfe-07ce9c6bfe0b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.859948 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b838f-ed23-45c1-9bfe-07ce9c6bfe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.860215 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b838f-ed23-45c1-9bfe-07ce9c6bfe0b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.862411 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8571da-9ad0-472b-a444-03f00108b367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.863817 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8571da-9ad0-472b-a444-03f00108b367 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.864306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8571da-9ad0-472b-a444-03f00108b367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.864773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8571da-9ad0-472b-a444-03f00108b367 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.865795 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8571da-9ad0-472b-a444-03f00108b367 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:29.866345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8571da-9ad0-472b-a444-03f00108b367 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:29.868168 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b838f-ed23-45c1-9bfe-07ce9c6bfe0b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:29.868895 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8571da-9ad0-472b-a444-03f00108b367 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:29.870292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b838f-ed23-45c1-9bfe-07ce9c6bfe0b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:29.882641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 282/561] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:29.883669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8571da-9ad0-472b-a444-03f00108b367 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.886510 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-d17b838f-ed23-45c1-9bfe-07ce9c6bfe0b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 02:51:29.887720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 280/562] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:29.890805 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b838f-ed23-45c1-9bfe-07ce9c6bfe0b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.899118 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8571da-9ad0-472b-a444-03f00108b367 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.901689 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b838f-ed23-45c1-9bfe-07ce9c6bfe0b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.903879 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f2268-72c1-4b6d-9a29-8e38b2885f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.905211 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f2268-72c1-4b6d-9a29-8e38b2885f05 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.905619 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f2268-72c1-4b6d-9a29-8e38b2885f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.906016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f2268-72c1-4b6d-9a29-8e38b2885f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.906928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f2268-72c1-4b6d-9a29-8e38b2885f05 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:29.907330 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f2268-72c1-4b6d-9a29-8e38b2885f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:29.907990 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f66c1-9d81-46e8-b1f7-8974569f6652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.909018 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f66c1-9d81-46e8-b1f7-8974569f6652 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.909348 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f2268-72c1-4b6d-9a29-8e38b2885f05 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:29.909612 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f66c1-9d81-46e8-b1f7-8974569f6652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.910051 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f66c1-9d81-46e8-b1f7-8974569f6652 admin admin] PATH_INFO: `/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/e48dcc22c7df4aed8fa6cf32e3c2ec51/roles/4f557aac969f4c2f95aee8e21d67c802` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.918477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 283/563] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:29.924795 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f2268-72c1-4b6d-9a29-8e38b2885f05 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.926845 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f66c1-9d81-46e8-b1f7-8974569f6652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user_id=e48dcc22c7df4aed8fa6cf32e3c2ec51, role_id=4f557aac969f4c2f95aee8e21d67c802)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:29.929632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f66c1-9d81-46e8-b1f7-8974569f6652 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:29.935363 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f2268-72c1-4b6d-9a29-8e38b2885f05 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:29.940828 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5add71d-180d-46e1-8b7d-3e88ac2c6b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:29.941633 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5add71d-180d-46e1-8b7d-3e88ac2c6b5f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:29.942015 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5add71d-180d-46e1-8b7d-3e88ac2c6b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:29.942527 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5add71d-180d-46e1-8b7d-3e88ac2c6b5f admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:29.943515 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5add71d-180d-46e1-8b7d-3e88ac2c6b5f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:29.943886 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5add71d-180d-46e1-8b7d-3e88ac2c6b5f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:29.946097 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5add71d-180d-46e1-8b7d-3e88ac2c6b5f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:29.946291 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 281/564] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:51:29 2021] PUT /identity/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/e48dcc22c7df4aed8fa6cf32e3c2ec51/roles/4f557aac969f4c2f95aee8e21d67c802 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:51:29.947245 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f66c1-9d81-46e8-b1f7-8974569f6652 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.967849 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 284/565] 10.222.0.18 () {56 vars in 1154 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:29.973397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5add71d-180d-46e1-8b7d-3e88ac2c6b5f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:29.984572 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5add71d-180d-46e1-8b7d-3e88ac2c6b5f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.014238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f66c1-9d81-46e8-b1f7-8974569f6652 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.018962 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2c8d8-6811-4345-9de5-a353144a5675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.019987 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2c8d8-6811-4345-9de5-a353144a5675 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.020458 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2c8d8-6811-4345-9de5-a353144a5675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.020969 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2c8d8-6811-4345-9de5-a353144a5675 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.032778 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2c8d8-6811-4345-9de5-a353144a5675 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.035168 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2c8d8-6811-4345-9de5-a353144a5675 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.046458 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeab94e-bce2-4293-8caa-7aa13fc794b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.047351 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeab94e-bce2-4293-8caa-7aa13fc794b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.047641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeab94e-bce2-4293-8caa-7aa13fc794b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.047914 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeab94e-bce2-4293-8caa-7aa13fc794b3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.055426 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-9ab2c8d8-6811-4345-9de5-a353144a5675 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:30.057288 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 282/566] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:30.063601 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeab94e-bce2-4293-8caa-7aa13fc794b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.065654 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeab94e-bce2-4293-8caa-7aa13fc794b3 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.068418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab78d5-35e7-4327-9baf-357c0ed79727 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.068942 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab78d5-35e7-4327-9baf-357c0ed79727 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.069413 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab78d5-35e7-4327-9baf-357c0ed79727 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.071611 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 283/567] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:30.072480 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab78d5-35e7-4327-9baf-357c0ed79727 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.085529 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab78d5-35e7-4327-9baf-357c0ed79727 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.087099 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-5eeab94e-bce2-4293-8caa-7aa13fc794b3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:30.088682 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 285/568] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:30.091295 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca4fb9-1a83-401f-961f-64a71e00d606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.092719 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4fb9-1a83-401f-961f-64a71e00d606 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.093127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4fb9-1a83-401f-961f-64a71e00d606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.093523 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4fb9-1a83-401f-961f-64a71e00d606 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.094425 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca4fb9-1a83-401f-961f-64a71e00d606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:30.094752 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1e8a-72fc-4fc5-ba76-a4ccd0cc3781 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.095046 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca4fb9-1a83-401f-961f-64a71e00d606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.095243 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1e8a-72fc-4fc5-ba76-a4ccd0cc3781 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.095611 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1e8a-72fc-4fc5-ba76-a4ccd0cc3781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.097220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca4fb9-1a83-401f-961f-64a71e00d606 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.111212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 284/569] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:30.112208 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca4fb9-1a83-401f-961f-64a71e00d606 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.117349 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-5fcd1e8a-72fc-4fc5-ba76-a4ccd0cc3781 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:30.118912 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5fcd1e8a-72fc-4fc5-ba76-a4ccd0cc3781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:30.127274 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 286/570] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:30.128018 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca4fb9-1a83-401f-961f-64a71e00d606 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.128729 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd1e8a-72fc-4fc5-ba76-a4ccd0cc3781 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.133140 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cd3d6-f710-446d-b26e-7d70ea612308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.133974 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd3d6-f710-446d-b26e-7d70ea612308 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.134688 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd3d6-f710-446d-b26e-7d70ea612308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.135072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd3d6-f710-446d-b26e-7d70ea612308 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.135969 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cd3d6-f710-446d-b26e-7d70ea612308 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:30.136446 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cd3d6-f710-446d-b26e-7d70ea612308 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.138252 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cd3d6-f710-446d-b26e-7d70ea612308 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.141204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd1e8a-72fc-4fc5-ba76-a4ccd0cc3781 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.145776 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be5298-2e65-48cd-9dcb-f100669498f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.146834 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be5298-2e65-48cd-9dcb-f100669498f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.147261 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be5298-2e65-48cd-9dcb-f100669498f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.147678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be5298-2e65-48cd-9dcb-f100669498f7 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.153343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 285/571] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:30.156614 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be5298-2e65-48cd-9dcb-f100669498f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.158933 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be5298-2e65-48cd-9dcb-f100669498f7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.160224 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cd3d6-f710-446d-b26e-7d70ea612308 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.171143 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cd3d6-f710-446d-b26e-7d70ea612308 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.175928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-01be5298-2e65-48cd-9dcb-f100669498f7 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 02:51:30.176413 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f69b3f-9f13-42f7-8255-8626f37b93f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.177142 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f69b3f-9f13-42f7-8255-8626f37b93f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.177508 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f69b3f-9f13-42f7-8255-8626f37b93f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.177873 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f69b3f-9f13-42f7-8255-8626f37b93f1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.178648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 287/572] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:30.179561 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be5298-2e65-48cd-9dcb-f100669498f7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.189799 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be5298-2e65-48cd-9dcb-f100669498f7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.191406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f69b3f-9f13-42f7-8255-8626f37b93f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.193684 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f69b3f-9f13-42f7-8255-8626f37b93f1 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.195196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95292b03-3504-42bf-91a5-ae679921e877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.196199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95292b03-3504-42bf-91a5-ae679921e877 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.196655 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95292b03-3504-42bf-91a5-ae679921e877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.197072 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95292b03-3504-42bf-91a5-ae679921e877 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.210208 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-11f69b3f-9f13-42f7-8255-8626f37b93f1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:30.211729 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 286/573] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:30.212484 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f69b3f-9f13-42f7-8255-8626f37b93f1 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.221686 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95292b03-3504-42bf-91a5-ae679921e877 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:30.229056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-95292b03-3504-42bf-91a5-ae679921e877 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:30.229464 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f69b3f-9f13-42f7-8255-8626f37b93f1 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.231327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 288/574] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:30.232533 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95292b03-3504-42bf-91a5-ae679921e877 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.239063 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd201855-1e8a-4dbe-b384-38fb24d1781c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.240063 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd201855-1e8a-4dbe-b384-38fb24d1781c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.240063 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd201855-1e8a-4dbe-b384-38fb24d1781c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.240310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd201855-1e8a-4dbe-b384-38fb24d1781c admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.241177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd201855-1e8a-4dbe-b384-38fb24d1781c admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:30.241485 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd201855-1e8a-4dbe-b384-38fb24d1781c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.243594 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd201855-1e8a-4dbe-b384-38fb24d1781c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.245098 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95292b03-3504-42bf-91a5-ae679921e877 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.250110 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902353e8-c8de-4c57-bbd5-3b26d26d4035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.251063 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902353e8-c8de-4c57-bbd5-3b26d26d4035 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.251688 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902353e8-c8de-4c57-bbd5-3b26d26d4035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.252105 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902353e8-c8de-4c57-bbd5-3b26d26d4035 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.253099 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902353e8-c8de-4c57-bbd5-3b26d26d4035 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:30.253563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902353e8-c8de-4c57-bbd5-3b26d26d4035 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.256290 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902353e8-c8de-4c57-bbd5-3b26d26d4035 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.265466 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 287/575] 10.222.0.18 () {56 vars in 1158 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:30.266615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd201855-1e8a-4dbe-b384-38fb24d1781c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.270506 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 289/576] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:30.272577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902353e8-c8de-4c57-bbd5-3b26d26d4035 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.279385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd201855-1e8a-4dbe-b384-38fb24d1781c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.285849 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902353e8-c8de-4c57-bbd5-3b26d26d4035 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.286183 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e849968-83f9-45a9-9bd2-1887a551a395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.286943 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e849968-83f9-45a9-9bd2-1887a551a395 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.287343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e849968-83f9-45a9-9bd2-1887a551a395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.287697 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e849968-83f9-45a9-9bd2-1887a551a395 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.288555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e849968-83f9-45a9-9bd2-1887a551a395 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:30.288971 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e849968-83f9-45a9-9bd2-1887a551a395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.290713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e849968-83f9-45a9-9bd2-1887a551a395 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.291795 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca6019-1650-4f38-8775-2fd7369d2018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.292578 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca6019-1650-4f38-8775-2fd7369d2018 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.292863 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca6019-1650-4f38-8775-2fd7369d2018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.293140 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca6019-1650-4f38-8775-2fd7369d2018 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.299301 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 288/577] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:30.300270 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e849968-83f9-45a9-9bd2-1887a551a395 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.306339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca6019-1650-4f38-8775-2fd7369d2018 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.308369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca6019-1650-4f38-8775-2fd7369d2018 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.320476 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e849968-83f9-45a9-9bd2-1887a551a395 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.324994 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e78a6-ae62-408b-adfe-85a9ca16f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.326165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e78a6-ae62-408b-adfe-85a9ca16f1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.326937 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e78a6-ae62-408b-adfe-85a9ca16f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.327402 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e78a6-ae62-408b-adfe-85a9ca16f1fc admin admin] PATH_INFO: `/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/fcd50adcd390465ea6fc8582e1524909/roles/4f557aac969f4c2f95aee8e21d67c802` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.330746 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-e5ca6019-1650-4f38-8775-2fd7369d2018 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:30.332363 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 290/578] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:30.333384 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca6019-1650-4f38-8775-2fd7369d2018 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.344539 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca6019-1650-4f38-8775-2fd7369d2018 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.345188 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e78a6-ae62-408b-adfe-85a9ca16f1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user_id=fcd50adcd390465ea6fc8582e1524909, role_id=4f557aac969f4c2f95aee8e21d67c802)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.348213 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e78a6-ae62-408b-adfe-85a9ca16f1fc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.349946 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669abc34-8dbb-46a1-a2c4-9bce9a8b47ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.351028 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669abc34-8dbb-46a1-a2c4-9bce9a8b47ba admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.351714 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669abc34-8dbb-46a1-a2c4-9bce9a8b47ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.352188 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669abc34-8dbb-46a1-a2c4-9bce9a8b47ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.362696 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 289/579] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:51:30 2021] PUT /identity/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/fcd50adcd390465ea6fc8582e1524909/roles/4f557aac969f4c2f95aee8e21d67c802 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:51:30.363901 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669abc34-8dbb-46a1-a2c4-9bce9a8b47ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.365352 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e78a6-ae62-408b-adfe-85a9ca16f1fc admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.366341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669abc34-8dbb-46a1-a2c4-9bce9a8b47ba admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.385496 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-669abc34-8dbb-46a1-a2c4-9bce9a8b47ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:30.387153 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 291/580] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:30.395227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669abc34-8dbb-46a1-a2c4-9bce9a8b47ba admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.416583 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669abc34-8dbb-46a1-a2c4-9bce9a8b47ba admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.439442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e78a6-ae62-408b-adfe-85a9ca16f1fc admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.444938 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2741c6-9274-4bb1-8329-70a6d67bb131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.445686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2741c6-9274-4bb1-8329-70a6d67bb131 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.446031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2741c6-9274-4bb1-8329-70a6d67bb131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.446298 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2741c6-9274-4bb1-8329-70a6d67bb131 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.447050 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2741c6-9274-4bb1-8329-70a6d67bb131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:30.447354 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2741c6-9274-4bb1-8329-70a6d67bb131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.449110 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2741c6-9274-4bb1-8329-70a6d67bb131 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.464713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 290/581] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:30.474279 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2741c6-9274-4bb1-8329-70a6d67bb131 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.484210 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2741c6-9274-4bb1-8329-70a6d67bb131 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.498999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b6fff-7a18-44d2-9c6a-69a4093287dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.499785 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b6fff-7a18-44d2-9c6a-69a4093287dd admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.500066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b6fff-7a18-44d2-9c6a-69a4093287dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.500339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b6fff-7a18-44d2-9c6a-69a4093287dd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.508013 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b6fff-7a18-44d2-9c6a-69a4093287dd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.510463 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b6fff-7a18-44d2-9c6a-69a4093287dd admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.517232 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe10f2-2070-4c99-985f-1167f4d2f9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.518357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe10f2-2070-4c99-985f-1167f4d2f9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.518855 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe10f2-2070-4c99-985f-1167f4d2f9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.519359 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe10f2-2070-4c99-985f-1167f4d2f9b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.520345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe10f2-2070-4c99-985f-1167f4d2f9b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:30.520845 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe10f2-2070-4c99-985f-1167f4d2f9b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.522743 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe10f2-2070-4c99-985f-1167f4d2f9b6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.525857 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-683b6fff-7a18-44d2-9c6a-69a4093287dd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:30.527089 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 291/582] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:30.533460 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b6fff-7a18-44d2-9c6a-69a4093287dd admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.537257 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 292/583] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:30.543354 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b6fff-7a18-44d2-9c6a-69a4093287dd admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.544333 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe10f2-2070-4c99-985f-1167f4d2f9b6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.548310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b710dbc-ed5e-4482-8929-eb14d1ed3ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.548951 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b710dbc-ed5e-4482-8929-eb14d1ed3ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.549239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b710dbc-ed5e-4482-8929-eb14d1ed3ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.549493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b710dbc-ed5e-4482-8929-eb14d1ed3ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.550336 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b710dbc-ed5e-4482-8929-eb14d1ed3ba9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:30.550637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b710dbc-ed5e-4482-8929-eb14d1ed3ba9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.552483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b710dbc-ed5e-4482-8929-eb14d1ed3ba9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.560238 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe10f2-2070-4c99-985f-1167f4d2f9b6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.566009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 292/584] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:30.572550 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b710dbc-ed5e-4482-8929-eb14d1ed3ba9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.577582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ec075-902d-4bce-968e-29d37e3a1ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.578797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ec075-902d-4bce-968e-29d37e3a1ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.579278 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ec075-902d-4bce-968e-29d37e3a1ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.579957 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ec075-902d-4bce-968e-29d37e3a1ec7 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.583729 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b710dbc-ed5e-4482-8929-eb14d1ed3ba9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.589072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f97ab1-298f-4bad-9a9c-c2efe17675b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.595075 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f97ab1-298f-4bad-9a9c-c2efe17675b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.595075 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f97ab1-298f-4bad-9a9c-c2efe17675b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.595075 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f97ab1-298f-4bad-9a9c-c2efe17675b7 admin admin] PATH_INFO: `/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/d543ba91ee284c1384f15fb70910caf6/roles/4f557aac969f4c2f95aee8e21d67c802` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.597006 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ec075-902d-4bce-968e-29d37e3a1ec7 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.602733 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ec075-902d-4bce-968e-29d37e3a1ec7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.624408 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f97ab1-298f-4bad-9a9c-c2efe17675b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user_id=d543ba91ee284c1384f15fb70910caf6, role_id=4f557aac969f4c2f95aee8e21d67c802)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.626304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-085ec075-902d-4bce-968e-29d37e3a1ec7 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 02:51:30.627801 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 293/585] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/users/neutron => generated 85 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:30.633665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ec075-902d-4bce-968e-29d37e3a1ec7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.635828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f97ab1-298f-4bad-9a9c-c2efe17675b7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.645453 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ec075-902d-4bce-968e-29d37e3a1ec7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.650506 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc215b3-ebe1-4d6b-bdba-98fe647b7541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.651357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc215b3-ebe1-4d6b-bdba-98fe647b7541 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.651536 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc215b3-ebe1-4d6b-bdba-98fe647b7541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.651811 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc215b3-ebe1-4d6b-bdba-98fe647b7541 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.652671 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc215b3-ebe1-4d6b-bdba-98fe647b7541 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:30.652977 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc215b3-ebe1-4d6b-bdba-98fe647b7541 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.655420 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc215b3-ebe1-4d6b-bdba-98fe647b7541 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.671995 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 293/586] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:51:30 2021] PUT /identity/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/d543ba91ee284c1384f15fb70910caf6/roles/4f557aac969f4c2f95aee8e21d67c802 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 02:51:30.682372 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 294/587] 10.222.0.18 () {56 vars in 1160 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:30.688943 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f97ab1-298f-4bad-9a9c-c2efe17675b7 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.764530 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f97ab1-298f-4bad-9a9c-c2efe17675b7 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.769906 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfd0e4-c1da-41bb-809b-50bf7f84fd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.771097 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfd0e4-c1da-41bb-809b-50bf7f84fd42 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.771577 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfd0e4-c1da-41bb-809b-50bf7f84fd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.772052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfd0e4-c1da-41bb-809b-50bf7f84fd42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.787251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfd0e4-c1da-41bb-809b-50bf7f84fd42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.789510 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfd0e4-c1da-41bb-809b-50bf7f84fd42 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.812037 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-58dfd0e4-c1da-41bb-809b-50bf7f84fd42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:30.813943 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 294/588] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:30.819634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc215b3-ebe1-4d6b-bdba-98fe647b7541 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.839162 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc215b3-ebe1-4d6b-bdba-98fe647b7541 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.849569 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336c87b-2605-47a2-8025-83ba1ba5d9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.850268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c87b-2605-47a2-8025-83ba1ba5d9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.850546 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c87b-2605-47a2-8025-83ba1ba5d9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.850820 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c87b-2605-47a2-8025-83ba1ba5d9d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.851623 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336c87b-2605-47a2-8025-83ba1ba5d9d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:30.851924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336c87b-2605-47a2-8025-83ba1ba5d9d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.853562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336c87b-2605-47a2-8025-83ba1ba5d9d7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.872591 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 295/589] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:30.878962 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfd0e4-c1da-41bb-809b-50bf7f84fd42 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.895340 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfd0e4-c1da-41bb-809b-50bf7f84fd42 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.906696 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4cb21-fff4-4a58-bc9e-9802fe70ad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.907890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4cb21-fff4-4a58-bc9e-9802fe70ad66 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.908373 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4cb21-fff4-4a58-bc9e-9802fe70ad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.908861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4cb21-fff4-4a58-bc9e-9802fe70ad66 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.923078 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4cb21-fff4-4a58-bc9e-9802fe70ad66 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.925464 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4cb21-fff4-4a58-bc9e-9802fe70ad66 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.947702 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa1a51-35d4-4a31-ae0b-b3a81d02ecfb None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.948010 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa1a51-35d4-4a31-ae0b-b3a81d02ecfb None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.948262 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa1a51-35d4-4a31-ae0b-b3a81d02ecfb None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.950288 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 296/590] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:30.950815 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-f7a4cb21-fff4-4a58-bc9e-9802fe70ad66 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:30.952294 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 295/591] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:30.957390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a3152-be05-4e7e-9fb5-5c95bfdd1412 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.957794 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a3152-be05-4e7e-9fb5-5c95bfdd1412 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.958117 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a3152-be05-4e7e-9fb5-5c95bfdd1412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.958951 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4cb21-fff4-4a58-bc9e-9802fe70ad66 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:30.976167 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4cb21-fff4-4a58-bc9e-9802fe70ad66 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:30.984347 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2de03-1617-46fe-b4b4-ae26c2c3bc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:30.985052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2de03-1617-46fe-b4b4-ae26c2c3bc54 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:30.985334 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2de03-1617-46fe-b4b4-ae26c2c3bc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:30.985607 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2de03-1617-46fe-b4b4-ae26c2c3bc54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:30.986494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2de03-1617-46fe-b4b4-ae26c2c3bc54 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:30.986801 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2de03-1617-46fe-b4b4-ae26c2c3bc54 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:30.987682 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-538a3152-be05-4e7e-9fb5-5c95bfdd1412 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:30.988713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2de03-1617-46fe-b4b4-ae26c2c3bc54 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:30.989391 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-538a3152-be05-4e7e-9fb5-5c95bfdd1412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:31.001479 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 297/592] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:31.002730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 296/593] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:31.009639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a3152-be05-4e7e-9fb5-5c95bfdd1412 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:31.019605 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a3152-be05-4e7e-9fb5-5c95bfdd1412 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:31.025045 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02092cf9-0d71-42c4-bbf7-f10e2f058980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:31.026231 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02092cf9-0d71-42c4-bbf7-f10e2f058980 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:31.026713 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02092cf9-0d71-42c4-bbf7-f10e2f058980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:31.027181 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02092cf9-0d71-42c4-bbf7-f10e2f058980 admin admin] PATH_INFO: `/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/eb120cde66b246909cf8e0b7b8d96ae8/roles/4f557aac969f4c2f95aee8e21d67c802` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:31.029002 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2de03-1617-46fe-b4b4-ae26c2c3bc54 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:31.043524 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02092cf9-0d71-42c4-bbf7-f10e2f058980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user_id=eb120cde66b246909cf8e0b7b8d96ae8, role_id=4f557aac969f4c2f95aee8e21d67c802)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:31.048308 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02092cf9-0d71-42c4-bbf7-f10e2f058980 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:31.048421 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2de03-1617-46fe-b4b4-ae26c2c3bc54 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:31.052829 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e37c2-5e12-4e36-ba07-627389ab0a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:31.053716 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e37c2-5e12-4e36-ba07-627389ab0a0e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:31.054925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e37c2-5e12-4e36-ba07-627389ab0a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:31.054925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e37c2-5e12-4e36-ba07-627389ab0a0e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:31.070004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e37c2-5e12-4e36-ba07-627389ab0a0e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:31.074360 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-797e37c2-5e12-4e36-ba07-627389ab0a0e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:31.074575 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 298/594] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:51:31 2021] PUT /identity/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/eb120cde66b246909cf8e0b7b8d96ae8/roles/4f557aac969f4c2f95aee8e21d67c802 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:51:31.080108 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 297/595] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:31.082633 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02092cf9-0d71-42c4-bbf7-f10e2f058980 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:31.150332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02092cf9-0d71-42c4-bbf7-f10e2f058980 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:31.155830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547550a-cf38-4322-8392-39a16c222803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:31.156770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547550a-cf38-4322-8392-39a16c222803 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:31.157243 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547550a-cf38-4322-8392-39a16c222803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:31.157690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547550a-cf38-4322-8392-39a16c222803 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:31.158742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547550a-cf38-4322-8392-39a16c222803 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:31.159220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547550a-cf38-4322-8392-39a16c222803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:31.161045 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547550a-cf38-4322-8392-39a16c222803 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:31.174142 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 299/596] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:31.177257 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e37c2-5e12-4e36-ba07-627389ab0a0e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:31.189804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e37c2-5e12-4e36-ba07-627389ab0a0e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:31.195040 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32934dcd-d320-4e1b-aee6-4b6f83a25da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:31.196134 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32934dcd-d320-4e1b-aee6-4b6f83a25da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:31.196634 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32934dcd-d320-4e1b-aee6-4b6f83a25da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:31.197142 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32934dcd-d320-4e1b-aee6-4b6f83a25da0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:31.209619 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32934dcd-d320-4e1b-aee6-4b6f83a25da0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:31.211795 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32934dcd-d320-4e1b-aee6-4b6f83a25da0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:31.231519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-32934dcd-d320-4e1b-aee6-4b6f83a25da0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:31.238149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 298/597] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:31.240179 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547550a-cf38-4322-8392-39a16c222803 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:31.254841 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547550a-cf38-4322-8392-39a16c222803 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:31.261406 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177d1e6-62c9-4143-be4c-7e00ee6ca026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:31.262492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177d1e6-62c9-4143-be4c-7e00ee6ca026 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:31.263029 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177d1e6-62c9-4143-be4c-7e00ee6ca026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:31.263472 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177d1e6-62c9-4143-be4c-7e00ee6ca026 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:31.264984 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177d1e6-62c9-4143-be4c-7e00ee6ca026 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:31.265463 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177d1e6-62c9-4143-be4c-7e00ee6ca026 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:31.267337 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177d1e6-62c9-4143-be4c-7e00ee6ca026 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:31.285937 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 300/598] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:31.292132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32934dcd-d320-4e1b-aee6-4b6f83a25da0 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:31.303284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32934dcd-d320-4e1b-aee6-4b6f83a25da0 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:31.311426 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e3cb9-b77e-4d5e-95b8-eedc861b666b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:31.312656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e3cb9-b77e-4d5e-95b8-eedc861b666b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:31.313119 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e3cb9-b77e-4d5e-95b8-eedc861b666b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:31.313660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e3cb9-b77e-4d5e-95b8-eedc861b666b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:31.327166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e3cb9-b77e-4d5e-95b8-eedc861b666b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:31.329702 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e3cb9-b77e-4d5e-95b8-eedc861b666b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:31.348301 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-256e3cb9-b77e-4d5e-95b8-eedc861b666b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 02:51:31.349905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 299/599] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:51:31 2021] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:31.359128 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177d1e6-62c9-4143-be4c-7e00ee6ca026 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:31.369730 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177d1e6-62c9-4143-be4c-7e00ee6ca026 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:31.378329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad404396-2654-4360-81d5-0f359640b935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:31.379057 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad404396-2654-4360-81d5-0f359640b935 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:31.379338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad404396-2654-4360-81d5-0f359640b935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:31.379608 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad404396-2654-4360-81d5-0f359640b935 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:31.380522 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad404396-2654-4360-81d5-0f359640b935 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:31.380830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad404396-2654-4360-81d5-0f359640b935 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:31.382747 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad404396-2654-4360-81d5-0f359640b935 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:31.403571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 301/600] 10.222.0.18 () {56 vars in 1156 bytes} [Wed Dec 15 02:51:31 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:31.409318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e3cb9-b77e-4d5e-95b8-eedc861b666b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:31.422790 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e3cb9-b77e-4d5e-95b8-eedc861b666b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:31.428147 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afac19-b386-4218-b8a5-581d82e51366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:31.429062 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afac19-b386-4218-b8a5-581d82e51366 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:31.429532 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afac19-b386-4218-b8a5-581d82e51366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:31.430017 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afac19-b386-4218-b8a5-581d82e51366 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:31.441932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afac19-b386-4218-b8a5-581d82e51366 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:31.444030 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afac19-b386-4218-b8a5-581d82e51366 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:31.456350 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 300/601] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:31 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:31.462568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad404396-2654-4360-81d5-0f359640b935 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:31.472865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad404396-2654-4360-81d5-0f359640b935 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:31.481296 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5514b-8a7c-4fdf-929a-57489914aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:31.482109 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5514b-8a7c-4fdf-929a-57489914aea8 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:31.482392 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5514b-8a7c-4fdf-929a-57489914aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:31.482698 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5514b-8a7c-4fdf-929a-57489914aea8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:31.502122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5514b-8a7c-4fdf-929a-57489914aea8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:31.503945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5514b-8a7c-4fdf-929a-57489914aea8 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:31.532155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-6eb5514b-8a7c-4fdf-929a-57489914aea8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:31.533658 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 302/602] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:31.539756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afac19-b386-4218-b8a5-581d82e51366 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:31.554620 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afac19-b386-4218-b8a5-581d82e51366 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:31.565581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d41f42-b8ae-4367-9861-d87de199cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:31.566524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d41f42-b8ae-4367-9861-d87de199cd7f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:31.567036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d41f42-b8ae-4367-9861-d87de199cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:31.567497 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d41f42-b8ae-4367-9861-d87de199cd7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:31.568461 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d41f42-b8ae-4367-9861-d87de199cd7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:31.568951 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d41f42-b8ae-4367-9861-d87de199cd7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:31.570853 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d41f42-b8ae-4367-9861-d87de199cd7f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:31.588949 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 301/603] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:31.594640 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5514b-8a7c-4fdf-929a-57489914aea8 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:31.606942 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5514b-8a7c-4fdf-929a-57489914aea8 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:31.617608 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e0494-44c3-4905-a97d-7416bfe248af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:31.618427 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0494-44c3-4905-a97d-7416bfe248af admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:31.618710 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0494-44c3-4905-a97d-7416bfe248af admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:31.618987 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0494-44c3-4905-a97d-7416bfe248af admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:31.631093 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e0494-44c3-4905-a97d-7416bfe248af admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:31.633045 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e0494-44c3-4905-a97d-7416bfe248af admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:31.649674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-6b7e0494-44c3-4905-a97d-7416bfe248af admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:31.651174 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 303/604] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:31.657393 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d41f42-b8ae-4367-9861-d87de199cd7f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:31.671118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d41f42-b8ae-4367-9861-d87de199cd7f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:31.678005 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e44f6-e682-4851-b41f-2ee007d4f7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:31.678659 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e44f6-e682-4851-b41f-2ee007d4f7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:31.678932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e44f6-e682-4851-b41f-2ee007d4f7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:31.679203 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e44f6-e682-4851-b41f-2ee007d4f7e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:31.679999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e44f6-e682-4851-b41f-2ee007d4f7e5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:31.680300 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e44f6-e682-4851-b41f-2ee007d4f7e5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:31.682154 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e44f6-e682-4851-b41f-2ee007d4f7e5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:31.699152 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 302/605] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:31.705531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e0494-44c3-4905-a97d-7416bfe248af admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:31.718865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e0494-44c3-4905-a97d-7416bfe248af admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:31.729667 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7684352-083f-4601-a4cf-561c79c51cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:31.730339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7684352-083f-4601-a4cf-561c79c51cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:31.730622 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7684352-083f-4601-a4cf-561c79c51cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:31.730896 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7684352-083f-4601-a4cf-561c79c51cd4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:31.731729 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7684352-083f-4601-a4cf-561c79c51cd4 admin admin] RBAC: Adding query filter params (role.id=4f557aac969f4c2f95aee8e21d67c802, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=beb0af7ac70d48989852c022c9f83848) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:31.732041 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7684352-083f-4601-a4cf-561c79c51cd4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:31.734423 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7684352-083f-4601-a4cf-561c79c51cd4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:31.742399 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 304/606] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:31 2021] GET /identity/v3/role_assignments?user.id=beb0af7ac70d48989852c022c9f83848&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=4f557aac969f4c2f95aee8e21d67c802 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:32.800155 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b3e5c-09ea-422a-b5d2-24d27b22e18a None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:32.800763 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b3e5c-09ea-422a-b5d2-24d27b22e18a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:32.800763 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b3e5c-09ea-422a-b5d2-24d27b22e18a None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:32.802747 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 303/607] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:32.808382 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a30bfa-5d7e-4f56-b108-2bed78fdf77e None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:32.808777 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a30bfa-5d7e-4f56-b108-2bed78fdf77e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:32.808964 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a30bfa-5d7e-4f56-b108-2bed78fdf77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:32.830076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-86a30bfa-5d7e-4f56-b108-2bed78fdf77e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:32.831238 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-86a30bfa-5d7e-4f56-b108-2bed78fdf77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:32.839120 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 305/608] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:32.883426 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b3e5c-09ea-422a-b5d2-24d27b22e18a None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:32.896393 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b3e5c-09ea-422a-b5d2-24d27b22e18a None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:32.904812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb6c40-270a-4fc9-8acc-0819d9ef21d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:32.905508 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb6c40-270a-4fc9-8acc-0819d9ef21d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:32.905786 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb6c40-270a-4fc9-8acc-0819d9ef21d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:32.906223 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb6c40-270a-4fc9-8acc-0819d9ef21d9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:32.918852 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb6c40-270a-4fc9-8acc-0819d9ef21d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:32.925783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-eddb6c40-270a-4fc9-8acc-0819d9ef21d9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:32.926997 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 304/609] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:32 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:32.933476 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a30bfa-5d7e-4f56-b108-2bed78fdf77e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:32.942869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a30bfa-5d7e-4f56-b108-2bed78fdf77e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:32.948421 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923cb41-e67b-4e2c-a53b-436301bda4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:32.949079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923cb41-e67b-4e2c-a53b-436301bda4fa admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:32.949357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923cb41-e67b-4e2c-a53b-436301bda4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:32.949629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923cb41-e67b-4e2c-a53b-436301bda4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:32.950411 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923cb41-e67b-4e2c-a53b-436301bda4fa admin admin] RBAC: Adding query filter params (name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:32.950717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923cb41-e67b-4e2c-a53b-436301bda4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:32.952909 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923cb41-e67b-4e2c-a53b-436301bda4fa admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:32.961574 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 306/610] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:32 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:32.971041 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb6c40-270a-4fc9-8acc-0819d9ef21d9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:32.982810 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb6c40-270a-4fc9-8acc-0819d9ef21d9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:32.987652 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a861997-1941-4a4c-b72f-04a7389680c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:32.988472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a861997-1941-4a4c-b72f-04a7389680c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:32.988848 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a861997-1941-4a4c-b72f-04a7389680c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:32.989128 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a861997-1941-4a4c-b72f-04a7389680c4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.003323 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a861997-1941-4a4c-b72f-04a7389680c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.005212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a861997-1941-4a4c-b72f-04a7389680c4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:33.025451 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-7a861997-1941-4a4c-b72f-04a7389680c4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:33.026731 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 305/611] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:33.033152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923cb41-e67b-4e2c-a53b-436301bda4fa admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.048015 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923cb41-e67b-4e2c-a53b-436301bda4fa admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.062713 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34539996-7595-4f6f-90cf-52e55bdc2d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.063668 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34539996-7595-4f6f-90cf-52e55bdc2d6b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.064144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34539996-7595-4f6f-90cf-52e55bdc2d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.064604 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34539996-7595-4f6f-90cf-52e55bdc2d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.065529 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34539996-7595-4f6f-90cf-52e55bdc2d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:33.066068 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34539996-7595-4f6f-90cf-52e55bdc2d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.067855 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34539996-7595-4f6f-90cf-52e55bdc2d6b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:33.081482 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 307/612] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:33.087140 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a861997-1941-4a4c-b72f-04a7389680c4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.100634 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a861997-1941-4a4c-b72f-04a7389680c4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.109712 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610919a-d245-4974-b30f-14b8f97961c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.110569 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610919a-d245-4974-b30f-14b8f97961c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.110851 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610919a-d245-4974-b30f-14b8f97961c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.111123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610919a-d245-4974-b30f-14b8f97961c2 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.127141 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610919a-d245-4974-b30f-14b8f97961c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.129204 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610919a-d245-4974-b30f-14b8f97961c2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:33.146524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-6610919a-d245-4974-b30f-14b8f97961c2 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 02:51:33.148070 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 306/613] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/users/glance => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:33.153815 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34539996-7595-4f6f-90cf-52e55bdc2d6b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.167409 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34539996-7595-4f6f-90cf-52e55bdc2d6b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.183152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570709e-f18c-416e-bc65-00b5ad329e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.184111 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570709e-f18c-416e-bc65-00b5ad329e5e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.184585 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570709e-f18c-416e-bc65-00b5ad329e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.185045 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570709e-f18c-416e-bc65-00b5ad329e5e admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.186147 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570709e-f18c-416e-bc65-00b5ad329e5e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:33.186668 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570709e-f18c-416e-bc65-00b5ad329e5e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.188684 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570709e-f18c-416e-bc65-00b5ad329e5e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:33.218423 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 308/614] 10.222.0.18 () {56 vars in 1158 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:33.224470 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610919a-d245-4974-b30f-14b8f97961c2 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.239027 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610919a-d245-4974-b30f-14b8f97961c2 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.249091 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d714e-ef87-4491-9a24-083ac77ea5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.249772 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d714e-ef87-4491-9a24-083ac77ea5fb admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.250078 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d714e-ef87-4491-9a24-083ac77ea5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.250407 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d714e-ef87-4491-9a24-083ac77ea5fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.262734 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d714e-ef87-4491-9a24-083ac77ea5fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.265074 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d714e-ef87-4491-9a24-083ac77ea5fb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:33.280908 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 307/615] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:33.287558 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570709e-f18c-416e-bc65-00b5ad329e5e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.304194 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570709e-f18c-416e-bc65-00b5ad329e5e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.315113 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f0979-8ca7-4f5a-ba18-dadf9c306c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.316131 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f0979-8ca7-4f5a-ba18-dadf9c306c32 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.316626 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f0979-8ca7-4f5a-ba18-dadf9c306c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.317093 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f0979-8ca7-4f5a-ba18-dadf9c306c32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.336439 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f0979-8ca7-4f5a-ba18-dadf9c306c32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.338671 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f0979-8ca7-4f5a-ba18-dadf9c306c32 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:33.359643 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-a63f0979-8ca7-4f5a-ba18-dadf9c306c32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:33.361434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 309/616] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:33.367318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d714e-ef87-4491-9a24-083ac77ea5fb admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.380448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d714e-ef87-4491-9a24-083ac77ea5fb admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.395569 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1ec12-a213-4630-afe0-fe6ec4d65771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.396240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1ec12-a213-4630-afe0-fe6ec4d65771 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.396520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1ec12-a213-4630-afe0-fe6ec4d65771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.396797 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1ec12-a213-4630-afe0-fe6ec4d65771 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.397533 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1ec12-a213-4630-afe0-fe6ec4d65771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:33.397837 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1ec12-a213-4630-afe0-fe6ec4d65771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.399459 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1ec12-a213-4630-afe0-fe6ec4d65771 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:33.412872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 308/617] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:33.418452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f0979-8ca7-4f5a-ba18-dadf9c306c32 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.428479 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f0979-8ca7-4f5a-ba18-dadf9c306c32 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.438593 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588848a3-96f4-40ce-8ad1-38f8f2098855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.439634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588848a3-96f4-40ce-8ad1-38f8f2098855 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.440109 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588848a3-96f4-40ce-8ad1-38f8f2098855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.440571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588848a3-96f4-40ce-8ad1-38f8f2098855 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.453428 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588848a3-96f4-40ce-8ad1-38f8f2098855 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.455640 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588848a3-96f4-40ce-8ad1-38f8f2098855 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:33.475228 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-588848a3-96f4-40ce-8ad1-38f8f2098855 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:33.476729 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 310/618] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:33.482010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539d166-4bb6-437d-a090-4cc4143a6f67 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.482010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539d166-4bb6-437d-a090-4cc4143a6f67 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.482010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539d166-4bb6-437d-a090-4cc4143a6f67 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.482010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 309/619] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:33.483435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588848a3-96f4-40ce-8ad1-38f8f2098855 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.487436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a394c8-be38-4d9c-8ed5-2a17f3b64873 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.487725 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a394c8-be38-4d9c-8ed5-2a17f3b64873 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.488001 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a394c8-be38-4d9c-8ed5-2a17f3b64873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.495096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588848a3-96f4-40ce-8ad1-38f8f2098855 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.505712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423f0db-9baa-4738-8ac4-4d576820895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.506723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423f0db-9baa-4738-8ac4-4d576820895d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.507201 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423f0db-9baa-4738-8ac4-4d576820895d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.507696 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423f0db-9baa-4738-8ac4-4d576820895d admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.508674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423f0db-9baa-4738-8ac4-4d576820895d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:33.509180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423f0db-9baa-4738-8ac4-4d576820895d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.511465 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423f0db-9baa-4738-8ac4-4d576820895d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:33.511645 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-f4a394c8-be38-4d9c-8ed5-2a17f3b64873 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:33.512856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f4a394c8-be38-4d9c-8ed5-2a17f3b64873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:33.525185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 311/620] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:33.531339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423f0db-9baa-4738-8ac4-4d576820895d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.541718 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423f0db-9baa-4738-8ac4-4d576820895d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.546712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5d461-488c-4888-80c9-4c0fd05e08b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.553998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 310/621] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:51:33.554528 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5d461-488c-4888-80c9-4c0fd05e08b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.555016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5d461-488c-4888-80c9-4c0fd05e08b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.555534 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5d461-488c-4888-80c9-4c0fd05e08b9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.556617 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5d461-488c-4888-80c9-4c0fd05e08b9 admin admin] RBAC: Adding query filter params (role.id=4f557aac969f4c2f95aee8e21d67c802, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=e48dcc22c7df4aed8fa6cf32e3c2ec51) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:33.557169 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5d461-488c-4888-80c9-4c0fd05e08b9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.559367 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5d461-488c-4888-80c9-4c0fd05e08b9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:33.569397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 312/622] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/role_assignments?user.id=e48dcc22c7df4aed8fa6cf32e3c2ec51&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=4f557aac969f4c2f95aee8e21d67c802 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:33.607165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a394c8-be38-4d9c-8ed5-2a17f3b64873 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.616842 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a394c8-be38-4d9c-8ed5-2a17f3b64873 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.627018 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235e8e7-2f94-4ae1-a723-54ec1229ca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.627826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235e8e7-2f94-4ae1-a723-54ec1229ca32 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.628109 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235e8e7-2f94-4ae1-a723-54ec1229ca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.628383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235e8e7-2f94-4ae1-a723-54ec1229ca32 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.648110 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235e8e7-2f94-4ae1-a723-54ec1229ca32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:33.655357 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-3235e8e7-2f94-4ae1-a723-54ec1229ca32 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:33.656630 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 311/623] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:33.663193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5d461-488c-4888-80c9-4c0fd05e08b9 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.677964 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5d461-488c-4888-80c9-4c0fd05e08b9 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.682928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43929fe-da68-4939-bfac-30034e109e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.683861 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43929fe-da68-4939-bfac-30034e109e83 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.684339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43929fe-da68-4939-bfac-30034e109e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.684851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43929fe-da68-4939-bfac-30034e109e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.692493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43929fe-da68-4939-bfac-30034e109e83 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:33.693207 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43929fe-da68-4939-bfac-30034e109e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.695144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43929fe-da68-4939-bfac-30034e109e83 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:33.707928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 313/624] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:33.714483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235e8e7-2f94-4ae1-a723-54ec1229ca32 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.725261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235e8e7-2f94-4ae1-a723-54ec1229ca32 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.738908 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c23f7-4aa7-482d-bc45-5642b2ad9042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.739720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c23f7-4aa7-482d-bc45-5642b2ad9042 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.740005 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c23f7-4aa7-482d-bc45-5642b2ad9042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.740281 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c23f7-4aa7-482d-bc45-5642b2ad9042 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.753539 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c23f7-4aa7-482d-bc45-5642b2ad9042 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.755409 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c23f7-4aa7-482d-bc45-5642b2ad9042 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:33.781057 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-4a5c23f7-4aa7-482d-bc45-5642b2ad9042 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:33.782654 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 312/625] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:33.789016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43929fe-da68-4939-bfac-30034e109e83 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.801791 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5009f08-2e4b-4199-94ba-bb4d21062ef0 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.802383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5009f08-2e4b-4199-94ba-bb4d21062ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.802383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5009f08-2e4b-4199-94ba-bb4d21062ef0 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.803760 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43929fe-da68-4939-bfac-30034e109e83 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.804140 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 313/626] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:51:33.808957 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb4c85-1c20-440a-9612-d80c0698bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.809808 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1ae38-be88-40e7-9381-43c6e5141cc3 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.810117 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1ae38-be88-40e7-9381-43c6e5141cc3 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.810395 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1ae38-be88-40e7-9381-43c6e5141cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.811531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb4c85-1c20-440a-9612-d80c0698bdec admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.812006 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb4c85-1c20-440a-9612-d80c0698bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.812492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb4c85-1c20-440a-9612-d80c0698bdec admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.813542 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb4c85-1c20-440a-9612-d80c0698bdec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:33.814097 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb4c85-1c20-440a-9612-d80c0698bdec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.815987 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb4c85-1c20-440a-9612-d80c0698bdec admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:33.841249 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 314/627] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:33.844030 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb4c85-1c20-440a-9612-d80c0698bdec admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.861060 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb4c85-1c20-440a-9612-d80c0698bdec admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.866232 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bfd76-6d33-44ab-af82-cff5710155ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.867118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-01e1ae38-be88-40e7-9381-43c6e5141cc3 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:33.867623 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bfd76-6d33-44ab-af82-cff5710155ad admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.868150 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bfd76-6d33-44ab-af82-cff5710155ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.868322 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-01e1ae38-be88-40e7-9381-43c6e5141cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:33.868777 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bfd76-6d33-44ab-af82-cff5710155ad admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.878831 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bfd76-6d33-44ab-af82-cff5710155ad admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.881511 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bfd76-6d33-44ab-af82-cff5710155ad admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:33.883582 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 314/628] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Dec 15 02:51:33.897036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-2b4bfd76-6d33-44ab-af82-cff5710155ad admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 02:51:33.898885 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 315/629] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:33.904389 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1ae38-be88-40e7-9381-43c6e5141cc3 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.909754 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bfd76-6d33-44ab-af82-cff5710155ad admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.915764 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1ae38-be88-40e7-9381-43c6e5141cc3 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.921667 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bfd76-6d33-44ab-af82-cff5710155ad admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.924934 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc533313-d53e-4579-905b-2e2beaaaec09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.925850 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc533313-d53e-4579-905b-2e2beaaaec09 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.926159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc533313-d53e-4579-905b-2e2beaaaec09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.926430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc533313-d53e-4579-905b-2e2beaaaec09 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.929806 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fed466-4953-4049-afb3-97cc2a49207c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.930810 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fed466-4953-4049-afb3-97cc2a49207c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.931293 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fed466-4953-4049-afb3-97cc2a49207c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.931798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fed466-4953-4049-afb3-97cc2a49207c admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.932922 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fed466-4953-4049-afb3-97cc2a49207c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:33.933430 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fed466-4953-4049-afb3-97cc2a49207c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.935591 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fed466-4953-4049-afb3-97cc2a49207c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:33.940263 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc533313-d53e-4579-905b-2e2beaaaec09 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:33.947374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-dc533313-d53e-4579-905b-2e2beaaaec09 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:33.954132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 316/630] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:33.956324 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc533313-d53e-4579-905b-2e2beaaaec09 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.961306 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 315/631] 10.222.0.18 () {56 vars in 1154 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:33.967317 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc533313-d53e-4579-905b-2e2beaaaec09 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.969135 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fed466-4953-4049-afb3-97cc2a49207c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:33.978146 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0930bee-c94d-45ba-a612-d15f5d39fb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.979124 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0930bee-c94d-45ba-a612-d15f5d39fb6b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.979457 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fed466-4953-4049-afb3-97cc2a49207c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:33.979857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0930bee-c94d-45ba-a612-d15f5d39fb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.980330 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0930bee-c94d-45ba-a612-d15f5d39fb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.981426 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0930bee-c94d-45ba-a612-d15f5d39fb6b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:33.981931 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0930bee-c94d-45ba-a612-d15f5d39fb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.985459 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ac3d7-3f62-4720-833d-a63d1a4b4bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:33.985459 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ac3d7-3f62-4720-833d-a63d1a4b4bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:33.985459 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ac3d7-3f62-4720-833d-a63d1a4b4bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:33.985716 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ac3d7-3f62-4720-833d-a63d1a4b4bd7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:33.986006 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0930bee-c94d-45ba-a612-d15f5d39fb6b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:33.997608 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ac3d7-3f62-4720-833d-a63d1a4b4bd7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:33.999954 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ac3d7-3f62-4720-833d-a63d1a4b4bd7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.000403 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 317/632] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:34.007706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0930bee-c94d-45ba-a612-d15f5d39fb6b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.010451 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 316/633] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 02:51:34.017482 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ac3d7-3f62-4720-833d-a63d1a4b4bd7 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.021004 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0930bee-c94d-45ba-a612-d15f5d39fb6b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.027188 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9e190-074e-4e4a-8f15-529b95d20071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.027536 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ac3d7-3f62-4720-833d-a63d1a4b4bd7 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.028475 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9e190-074e-4e4a-8f15-529b95d20071 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.028975 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9e190-074e-4e4a-8f15-529b95d20071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.029521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9e190-074e-4e4a-8f15-529b95d20071 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.032986 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb778f-ef46-4218-9636-94c13463d98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.034280 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb778f-ef46-4218-9636-94c13463d98d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.034570 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb778f-ef46-4218-9636-94c13463d98d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.034840 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb778f-ef46-4218-9636-94c13463d98d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.042598 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9e190-074e-4e4a-8f15-529b95d20071 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.046092 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9e190-074e-4e4a-8f15-529b95d20071 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.049608 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb778f-ef46-4218-9636-94c13463d98d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.051799 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb778f-ef46-4218-9636-94c13463d98d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.068676 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-edf9e190-074e-4e4a-8f15-529b95d20071 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:34.070508 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 318/634] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:34.074071 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-fafb778f-ef46-4218-9636-94c13463d98d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:34.074071 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 317/635] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:34.077576 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9e190-074e-4e4a-8f15-529b95d20071 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.078684 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb778f-ef46-4218-9636-94c13463d98d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.088450 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9e190-074e-4e4a-8f15-529b95d20071 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.090969 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb778f-ef46-4218-9636-94c13463d98d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.093951 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999de5e0-980b-4d97-8338-405c1453c814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.094755 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999de5e0-980b-4d97-8338-405c1453c814 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.095137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999de5e0-980b-4d97-8338-405c1453c814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.096665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999de5e0-980b-4d97-8338-405c1453c814 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.096665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999de5e0-980b-4d97-8338-405c1453c814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:34.096665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999de5e0-980b-4d97-8338-405c1453c814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.098440 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0defc-a43e-4a3d-b82b-dbec70d20b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.098728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999de5e0-980b-4d97-8338-405c1453c814 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.099388 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0defc-a43e-4a3d-b82b-dbec70d20b0e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.099834 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0defc-a43e-4a3d-b82b-dbec70d20b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.100256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0defc-a43e-4a3d-b82b-dbec70d20b0e admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.101354 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0defc-a43e-4a3d-b82b-dbec70d20b0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:34.102345 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0defc-a43e-4a3d-b82b-dbec70d20b0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.104198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0defc-a43e-4a3d-b82b-dbec70d20b0e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.112696 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 319/636] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:34.118431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999de5e0-980b-4d97-8338-405c1453c814 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.118632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 318/637] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:34.123758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0defc-a43e-4a3d-b82b-dbec70d20b0e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.130777 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999de5e0-980b-4d97-8338-405c1453c814 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.135652 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d2e9d-9449-4549-bc14-8833762aea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.136440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d2e9d-9449-4549-bc14-8833762aea41 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.136727 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d2e9d-9449-4549-bc14-8833762aea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.137008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d2e9d-9449-4549-bc14-8833762aea41 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.146967 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d2e9d-9449-4549-bc14-8833762aea41 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.148958 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d2e9d-9449-4549-bc14-8833762aea41 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.161499 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0defc-a43e-4a3d-b82b-dbec70d20b0e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.165383 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-378d2e9d-9449-4549-bc14-8833762aea41 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 02:51:34.171559 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 320/638] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:34.173207 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d2e9d-9449-4549-bc14-8833762aea41 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.175218 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ed260-4163-4b91-abf8-b60c4bc04a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.176033 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ed260-4163-4b91-abf8-b60c4bc04a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.176300 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ed260-4163-4b91-abf8-b60c4bc04a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.176573 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ed260-4163-4b91-abf8-b60c4bc04a36 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.187004 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d2e9d-9449-4549-bc14-8833762aea41 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.192469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ed260-4163-4b91-abf8-b60c4bc04a36 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.192790 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2b78b-983a-49ea-96aa-2a9b8748e839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.193481 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2b78b-983a-49ea-96aa-2a9b8748e839 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.193762 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2b78b-983a-49ea-96aa-2a9b8748e839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.194068 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2b78b-983a-49ea-96aa-2a9b8748e839 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.194945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2b78b-983a-49ea-96aa-2a9b8748e839 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:34.195251 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2b78b-983a-49ea-96aa-2a9b8748e839 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.196443 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ed260-4163-4b91-abf8-b60c4bc04a36 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.197141 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2b78b-983a-49ea-96aa-2a9b8748e839 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.216901 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-306ed260-4163-4b91-abf8-b60c4bc04a36 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:34.219001 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 321/640] 10.222.0.18 () {56 vars in 1158 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:34.219114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 319/640] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:34.225563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2b78b-983a-49ea-96aa-2a9b8748e839 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.226691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ed260-4163-4b91-abf8-b60c4bc04a36 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.237295 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ed260-4163-4b91-abf8-b60c4bc04a36 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.246234 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39d01e-5e8b-4d5b-aeb3-fcbf5bd95e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.247239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39d01e-5e8b-4d5b-aeb3-fcbf5bd95e76 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.249337 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2b78b-983a-49ea-96aa-2a9b8748e839 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.249764 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39d01e-5e8b-4d5b-aeb3-fcbf5bd95e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.250267 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39d01e-5e8b-4d5b-aeb3-fcbf5bd95e76 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.254673 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f5e06-ffcc-4f13-b4b7-1481c50ec664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.255341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f5e06-ffcc-4f13-b4b7-1481c50ec664 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.255600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f5e06-ffcc-4f13-b4b7-1481c50ec664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.255881 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f5e06-ffcc-4f13-b4b7-1481c50ec664 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.256680 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f5e06-ffcc-4f13-b4b7-1481c50ec664 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:34.256993 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f5e06-ffcc-4f13-b4b7-1481c50ec664 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.259572 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f5e06-ffcc-4f13-b4b7-1481c50ec664 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.262493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39d01e-5e8b-4d5b-aeb3-fcbf5bd95e76 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.265018 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39d01e-5e8b-4d5b-aeb3-fcbf5bd95e76 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.271801 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 322/641] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:34.273167 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bcc91-5c55-4f31-9633-70aa9486d590 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.273492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bcc91-5c55-4f31-9633-70aa9486d590 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.273720 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bcc91-5c55-4f31-9633-70aa9486d590 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.275738 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 323/642] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:34.276866 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 320/643] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:34.282039 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bcc91-5c55-4f31-9633-70aa9486d590 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.282619 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46024252-00c9-4aba-913f-2a2c4444ef89 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.282901 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46024252-00c9-4aba-913f-2a2c4444ef89 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.283169 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46024252-00c9-4aba-913f-2a2c4444ef89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.299606 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bcc91-5c55-4f31-9633-70aa9486d590 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.304850 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-46024252-00c9-4aba-913f-2a2c4444ef89 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:34.306030 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-46024252-00c9-4aba-913f-2a2c4444ef89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:34.306414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01306e8d-2918-40e8-b03d-a72f06a8b3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.307220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306e8d-2918-40e8-b03d-a72f06a8b3bd admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.307557 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306e8d-2918-40e8-b03d-a72f06a8b3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.307836 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306e8d-2918-40e8-b03d-a72f06a8b3bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.308865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01306e8d-2918-40e8-b03d-a72f06a8b3bd admin admin] RBAC: Adding query filter params (role.id=4f557aac969f4c2f95aee8e21d67c802, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=fcd50adcd390465ea6fc8582e1524909) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:34.309262 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01306e8d-2918-40e8-b03d-a72f06a8b3bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.311972 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01306e8d-2918-40e8-b03d-a72f06a8b3bd admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.314641 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 321/644] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:34.315502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46024252-00c9-4aba-913f-2a2c4444ef89 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.324572 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46024252-00c9-4aba-913f-2a2c4444ef89 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.324709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 324/645] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/role_assignments?user.id=fcd50adcd390465ea6fc8582e1524909&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=4f557aac969f4c2f95aee8e21d67c802 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:34.340399 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd518b6-bb7e-4020-b3e4-5f61c1ffcb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.341244 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd518b6-bb7e-4020-b3e4-5f61c1ffcb90 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.341519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd518b6-bb7e-4020-b3e4-5f61c1ffcb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.342019 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd518b6-bb7e-4020-b3e4-5f61c1ffcb90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.346725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01306e8d-2918-40e8-b03d-a72f06a8b3bd admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.357725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01306e8d-2918-40e8-b03d-a72f06a8b3bd admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.362292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd518b6-bb7e-4020-b3e4-5f61c1ffcb90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.363295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8758aee-fde8-4797-af6e-3b0a8d41468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.364094 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8758aee-fde8-4797-af6e-3b0a8d41468a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.364295 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd518b6-bb7e-4020-b3e4-5f61c1ffcb90 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.364376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8758aee-fde8-4797-af6e-3b0a8d41468a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.364709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8758aee-fde8-4797-af6e-3b0a8d41468a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.377615 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8758aee-fde8-4797-af6e-3b0a8d41468a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:34.385948 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-d8758aee-fde8-4797-af6e-3b0a8d41468a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:34.387791 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 325/646] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:34.394359 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8758aee-fde8-4797-af6e-3b0a8d41468a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.395566 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-edd518b6-bb7e-4020-b3e4-5f61c1ffcb90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:34.402355 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 322/647] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:34.403218 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd518b6-bb7e-4020-b3e4-5f61c1ffcb90 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.405107 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8758aee-fde8-4797-af6e-3b0a8d41468a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.409657 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25865f-894d-4a75-9584-54aa2d2337e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.410373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25865f-894d-4a75-9584-54aa2d2337e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.410888 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25865f-894d-4a75-9584-54aa2d2337e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.411174 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25865f-894d-4a75-9584-54aa2d2337e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.411951 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25865f-894d-4a75-9584-54aa2d2337e0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:34.412258 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25865f-894d-4a75-9584-54aa2d2337e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.413877 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25865f-894d-4a75-9584-54aa2d2337e0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.419509 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd518b6-bb7e-4020-b3e4-5f61c1ffcb90 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.423858 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 326/648] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:34.430111 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25865f-894d-4a75-9584-54aa2d2337e0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.432498 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bfb76-111c-4e29-8677-2e3c6e7adec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.433212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bfb76-111c-4e29-8677-2e3c6e7adec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.433488 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bfb76-111c-4e29-8677-2e3c6e7adec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.433755 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bfb76-111c-4e29-8677-2e3c6e7adec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.434676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bfb76-111c-4e29-8677-2e3c6e7adec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:34.434976 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bfb76-111c-4e29-8677-2e3c6e7adec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.437156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bfb76-111c-4e29-8677-2e3c6e7adec1 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.440649 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25865f-894d-4a75-9584-54aa2d2337e0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.445171 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d830e8-8230-40eb-be17-e92722b02d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.445962 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d830e8-8230-40eb-be17-e92722b02d23 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.446287 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d830e8-8230-40eb-be17-e92722b02d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.446563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d830e8-8230-40eb-be17-e92722b02d23 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.459319 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d830e8-8230-40eb-be17-e92722b02d23 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.462001 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d830e8-8230-40eb-be17-e92722b02d23 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.463447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 323/649] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:34.469502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bfb76-111c-4e29-8677-2e3c6e7adec1 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.481230 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-48d830e8-8230-40eb-be17-e92722b02d23 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:34.482931 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 327/650] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:34.483367 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bfb76-111c-4e29-8677-2e3c6e7adec1 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.489076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d830e8-8230-40eb-be17-e92722b02d23 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.493020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cc217-d27a-41c2-ab66-95bbcab1b819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.493859 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cc217-d27a-41c2-ab66-95bbcab1b819 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.494216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cc217-d27a-41c2-ab66-95bbcab1b819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.494488 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cc217-d27a-41c2-ab66-95bbcab1b819 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.500067 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d830e8-8230-40eb-be17-e92722b02d23 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.505154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0900a-58da-484d-95b4-dfda265aefc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.505967 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0900a-58da-484d-95b4-dfda265aefc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.506279 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0900a-58da-484d-95b4-dfda265aefc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.506556 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0900a-58da-484d-95b4-dfda265aefc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.507292 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0900a-58da-484d-95b4-dfda265aefc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:34.507728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0900a-58da-484d-95b4-dfda265aefc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.508432 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cc217-d27a-41c2-ab66-95bbcab1b819 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.509572 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0900a-58da-484d-95b4-dfda265aefc9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.510836 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cc217-d27a-41c2-ab66-95bbcab1b819 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.523281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 328/651] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:34.529534 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0900a-58da-484d-95b4-dfda265aefc9 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.535820 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-da7cc217-d27a-41c2-ab66-95bbcab1b819 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:34.539359 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0900a-58da-484d-95b4-dfda265aefc9 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.543431 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 324/652] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:34.543950 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecf5a4-473a-4f26-ad14-eaae18fb7b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.544811 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecf5a4-473a-4f26-ad14-eaae18fb7b97 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.545137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecf5a4-473a-4f26-ad14-eaae18fb7b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.545416 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecf5a4-473a-4f26-ad14-eaae18fb7b97 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.549645 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cc217-d27a-41c2-ab66-95bbcab1b819 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.553883 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cecf5a4-473a-4f26-ad14-eaae18fb7b97 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.556113 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cecf5a4-473a-4f26-ad14-eaae18fb7b97 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.563811 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cc217-d27a-41c2-ab66-95bbcab1b819 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.571032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-2cecf5a4-473a-4f26-ad14-eaae18fb7b97 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 02:51:34.572665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 329/653] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/users/neutron => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:34.579137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecf5a4-473a-4f26-ad14-eaae18fb7b97 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.580656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b486e43-7696-463e-9f3f-3359833da6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.581562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b486e43-7696-463e-9f3f-3359833da6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.582072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b486e43-7696-463e-9f3f-3359833da6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.582548 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b486e43-7696-463e-9f3f-3359833da6d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.583721 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b486e43-7696-463e-9f3f-3359833da6d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:34.584238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b486e43-7696-463e-9f3f-3359833da6d0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.586348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b486e43-7696-463e-9f3f-3359833da6d0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.594279 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecf5a4-473a-4f26-ad14-eaae18fb7b97 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.605272 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c6165-807b-4c0c-baf0-8dd68fcf1fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.605880 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c6165-807b-4c0c-baf0-8dd68fcf1fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.606190 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c6165-807b-4c0c-baf0-8dd68fcf1fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.606467 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c6165-807b-4c0c-baf0-8dd68fcf1fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.607383 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c6165-807b-4c0c-baf0-8dd68fcf1fc4 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:34.608190 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c6165-807b-4c0c-baf0-8dd68fcf1fc4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.609808 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 325/654] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:34.610081 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c6165-807b-4c0c-baf0-8dd68fcf1fc4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.611378 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d0932-0c8c-4812-82f8-5a9700686ff2 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.611669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d0932-0c8c-4812-82f8-5a9700686ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.611945 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d0932-0c8c-4812-82f8-5a9700686ff2 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.618289 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 326/655] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:34.619111 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d0932-0c8c-4812-82f8-5a9700686ff2 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.629938 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 330/656] 10.222.0.18 () {56 vars in 1160 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:34.631360 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8804b-829d-44af-9503-0d1172a2d655 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.631543 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8804b-829d-44af-9503-0d1172a2d655 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.631836 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8804b-829d-44af-9503-0d1172a2d655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.638942 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d0932-0c8c-4812-82f8-5a9700686ff2 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.644053 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d24bdb-7021-470a-99cd-76cd12fe57a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.645707 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d24bdb-7021-470a-99cd-76cd12fe57a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.646009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d24bdb-7021-470a-99cd-76cd12fe57a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.646314 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d24bdb-7021-470a-99cd-76cd12fe57a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.647176 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d24bdb-7021-470a-99cd-76cd12fe57a9 admin admin] RBAC: Adding query filter params (role.id=4f557aac969f4c2f95aee8e21d67c802, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=d543ba91ee284c1384f15fb70910caf6) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:34.647484 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d24bdb-7021-470a-99cd-76cd12fe57a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.649348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d24bdb-7021-470a-99cd-76cd12fe57a9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.656449 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-f7e8804b-829d-44af-9503-0d1172a2d655 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:34.657016 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 327/657] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/role_assignments?user.id=d543ba91ee284c1384f15fb70910caf6&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=4f557aac969f4c2f95aee8e21d67c802 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:34.657696 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f7e8804b-829d-44af-9503-0d1172a2d655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:34.657939 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d24bdb-7021-470a-99cd-76cd12fe57a9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.665736 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 331/658] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:34.676999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d24bdb-7021-470a-99cd-76cd12fe57a9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.684894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee82502-a8b4-42c6-bbef-bb6c60fe02a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.685691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee82502-a8b4-42c6-bbef-bb6c60fe02a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.686657 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee82502-a8b4-42c6-bbef-bb6c60fe02a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.686981 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee82502-a8b4-42c6-bbef-bb6c60fe02a9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.696587 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee82502-a8b4-42c6-bbef-bb6c60fe02a9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.698495 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee82502-a8b4-42c6-bbef-bb6c60fe02a9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.708882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 328/659] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:34.711102 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8804b-829d-44af-9503-0d1172a2d655 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.715152 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee82502-a8b4-42c6-bbef-bb6c60fe02a9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.720950 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8804b-829d-44af-9503-0d1172a2d655 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.726647 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee82502-a8b4-42c6-bbef-bb6c60fe02a9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.730363 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa3133-5a79-4ca9-9d87-4f3976d9dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.731594 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfda8e-5f13-4f17-ad7a-29a436420674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.732155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa3133-5a79-4ca9-9d87-4f3976d9dd64 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.732473 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfda8e-5f13-4f17-ad7a-29a436420674 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.733160 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa3133-5a79-4ca9-9d87-4f3976d9dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.733305 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfda8e-5f13-4f17-ad7a-29a436420674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.733500 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa3133-5a79-4ca9-9d87-4f3976d9dd64 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.733643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfda8e-5f13-4f17-ad7a-29a436420674 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.745833 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa3133-5a79-4ca9-9d87-4f3976d9dd64 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:34.747947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfda8e-5f13-4f17-ad7a-29a436420674 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.750545 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfda8e-5f13-4f17-ad7a-29a436420674 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.753822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-f5fa3133-5a79-4ca9-9d87-4f3976d9dd64 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:34.755196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 332/660] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:34.762051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa3133-5a79-4ca9-9d87-4f3976d9dd64 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.770388 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-ecdfda8e-5f13-4f17-ad7a-29a436420674 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:34.772323 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa3133-5a79-4ca9-9d87-4f3976d9dd64 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.774080 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 329/661] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:34.778089 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfda8e-5f13-4f17-ad7a-29a436420674 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.782488 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756aa83f-2e97-46ca-b56c-1fa760f14bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.783165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756aa83f-2e97-46ca-b56c-1fa760f14bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.786454 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756aa83f-2e97-46ca-b56c-1fa760f14bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.786809 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756aa83f-2e97-46ca-b56c-1fa760f14bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.787681 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756aa83f-2e97-46ca-b56c-1fa760f14bf1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:34.787996 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756aa83f-2e97-46ca-b56c-1fa760f14bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.789692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756aa83f-2e97-46ca-b56c-1fa760f14bf1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.792386 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfda8e-5f13-4f17-ad7a-29a436420674 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.798414 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269d0a5-7729-4510-b30e-dd9649db9506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.799084 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269d0a5-7729-4510-b30e-dd9649db9506 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.799365 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269d0a5-7729-4510-b30e-dd9649db9506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.799636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269d0a5-7729-4510-b30e-dd9649db9506 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.800383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269d0a5-7729-4510-b30e-dd9649db9506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:34.800687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269d0a5-7729-4510-b30e-dd9649db9506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.801830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 333/662] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:34.802658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269d0a5-7729-4510-b30e-dd9649db9506 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.808438 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756aa83f-2e97-46ca-b56c-1fa760f14bf1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.818665 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 330/663] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:34.823738 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756aa83f-2e97-46ca-b56c-1fa760f14bf1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.825363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269d0a5-7729-4510-b30e-dd9649db9506 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.837205 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95f3db-64a3-438c-8af5-6e8c8a353775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.838090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95f3db-64a3-438c-8af5-6e8c8a353775 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.838376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95f3db-64a3-438c-8af5-6e8c8a353775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.838673 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95f3db-64a3-438c-8af5-6e8c8a353775 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.841105 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269d0a5-7729-4510-b30e-dd9649db9506 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.846429 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ab9ed-5edf-4c61-9167-e182be637eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.847513 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ab9ed-5edf-4c61-9167-e182be637eea admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.848025 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ab9ed-5edf-4c61-9167-e182be637eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.848442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ab9ed-5edf-4c61-9167-e182be637eea admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.852051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95f3db-64a3-438c-8af5-6e8c8a353775 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.853896 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95f3db-64a3-438c-8af5-6e8c8a353775 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.858240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ab9ed-5edf-4c61-9167-e182be637eea admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.860524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ab9ed-5edf-4c61-9167-e182be637eea admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.874796 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-bf95f3db-64a3-438c-8af5-6e8c8a353775 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:34.876474 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-563ab9ed-5edf-4c61-9167-e182be637eea admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:34.877875 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 331/665] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:34.882019 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 334/665] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:34.883217 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ab9ed-5edf-4c61-9167-e182be637eea admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.887333 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95f3db-64a3-438c-8af5-6e8c8a353775 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.895463 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ab9ed-5edf-4c61-9167-e182be637eea admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.900921 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95f3db-64a3-438c-8af5-6e8c8a353775 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.901226 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a83040-841d-4a02-a9a6-3347f4557a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.902002 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a83040-841d-4a02-a9a6-3347f4557a24 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.902276 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a83040-841d-4a02-a9a6-3347f4557a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.902640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a83040-841d-4a02-a9a6-3347f4557a24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.903554 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a83040-841d-4a02-a9a6-3347f4557a24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:34.903862 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a83040-841d-4a02-a9a6-3347f4557a24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.905677 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a83040-841d-4a02-a9a6-3347f4557a24 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.907126 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f9711-324e-40c6-85f5-8e4809f55b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.908023 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f9711-324e-40c6-85f5-8e4809f55b63 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.908303 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f9711-324e-40c6-85f5-8e4809f55b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.908575 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f9711-324e-40c6-85f5-8e4809f55b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.909885 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f9711-324e-40c6-85f5-8e4809f55b63 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:34.910242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f9711-324e-40c6-85f5-8e4809f55b63 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.912082 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f9711-324e-40c6-85f5-8e4809f55b63 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.925309 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 335/666] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:34.925727 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 332/667] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:34.927176 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f9711-324e-40c6-85f5-8e4809f55b63 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.931406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a83040-841d-4a02-a9a6-3347f4557a24 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.939551 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f9711-324e-40c6-85f5-8e4809f55b63 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.944873 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3decbe-c6d2-490d-8878-a856e0db60f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.945205 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a83040-841d-4a02-a9a6-3347f4557a24 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:34.945665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3decbe-c6d2-490d-8878-a856e0db60f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.946066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3decbe-c6d2-490d-8878-a856e0db60f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.946346 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3decbe-c6d2-490d-8878-a856e0db60f1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.954043 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc086895-f67b-4a31-b22e-92575182186c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:34.954700 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc086895-f67b-4a31-b22e-92575182186c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:34.955031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc086895-f67b-4a31-b22e-92575182186c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:34.955130 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3decbe-c6d2-490d-8878-a856e0db60f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.955300 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc086895-f67b-4a31-b22e-92575182186c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:34.956203 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc086895-f67b-4a31-b22e-92575182186c admin admin] RBAC: Adding query filter params (role.id=4f557aac969f4c2f95aee8e21d67c802, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=eb120cde66b246909cf8e0b7b8d96ae8) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:34.956574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc086895-f67b-4a31-b22e-92575182186c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:34.957069 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3decbe-c6d2-490d-8878-a856e0db60f1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.958529 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc086895-f67b-4a31-b22e-92575182186c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:34.965379 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 333/668] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/role_assignments?user.id=eb120cde66b246909cf8e0b7b8d96ae8&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=4f557aac969f4c2f95aee8e21d67c802 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:34.973743 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-1d3decbe-c6d2-490d-8878-a856e0db60f1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 02:51:34.975706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 336/669] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:34.982202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc086895-f67b-4a31-b22e-92575182186c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:34.993901 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc086895-f67b-4a31-b22e-92575182186c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:35.002052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d5cb7-d65c-4086-acca-2a48c31ddf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:35.003099 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5cb7-d65c-4086-acca-2a48c31ddf5b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:35.003573 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5cb7-d65c-4086-acca-2a48c31ddf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:35.004035 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5cb7-d65c-4086-acca-2a48c31ddf5b admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:35.005098 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d5cb7-d65c-4086-acca-2a48c31ddf5b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:35.005627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d5cb7-d65c-4086-acca-2a48c31ddf5b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:35.007844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d5cb7-d65c-4086-acca-2a48c31ddf5b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:35.026649 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 334/670] 10.222.0.18 () {56 vars in 1156 bytes} [Wed Dec 15 02:51:34 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:35.033865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3decbe-c6d2-490d-8878-a856e0db60f1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:35.047883 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3decbe-c6d2-490d-8878-a856e0db60f1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:35.052703 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a6f1c-d34a-4aca-bb6f-70e8579e707f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:35.053566 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a6f1c-d34a-4aca-bb6f-70e8579e707f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:35.053851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a6f1c-d34a-4aca-bb6f-70e8579e707f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:35.054155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a6f1c-d34a-4aca-bb6f-70e8579e707f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:35.067709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a6f1c-d34a-4aca-bb6f-70e8579e707f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:35.069629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a6f1c-d34a-4aca-bb6f-70e8579e707f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:35.089532 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-931a6f1c-d34a-4aca-bb6f-70e8579e707f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:35.091164 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 337/671] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:35.098004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d5cb7-d65c-4086-acca-2a48c31ddf5b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:35.109101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d5cb7-d65c-4086-acca-2a48c31ddf5b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:35.113702 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea05c1f-4cf7-4dfc-acff-a3ee0b9d5e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:35.114488 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea05c1f-4cf7-4dfc-acff-a3ee0b9d5e6e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:35.114770 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea05c1f-4cf7-4dfc-acff-a3ee0b9d5e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:35.115089 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea05c1f-4cf7-4dfc-acff-a3ee0b9d5e6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:35.115875 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea05c1f-4cf7-4dfc-acff-a3ee0b9d5e6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:35.116180 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea05c1f-4cf7-4dfc-acff-a3ee0b9d5e6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:35.117812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea05c1f-4cf7-4dfc-acff-a3ee0b9d5e6e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:35.131096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 335/672] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:35.137636 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a6f1c-d34a-4aca-bb6f-70e8579e707f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:35.148100 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a6f1c-d34a-4aca-bb6f-70e8579e707f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:35.152787 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bb5c8-3952-4dec-afc1-71b439468ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:35.153644 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bb5c8-3952-4dec-afc1-71b439468ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:35.153924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bb5c8-3952-4dec-afc1-71b439468ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:35.154266 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bb5c8-3952-4dec-afc1-71b439468ff9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:35.162709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8bb5c8-3952-4dec-afc1-71b439468ff9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:35.164797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8bb5c8-3952-4dec-afc1-71b439468ff9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:35.179831 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-0e8bb5c8-3952-4dec-afc1-71b439468ff9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:35.181389 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 338/673] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:35.187988 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea05c1f-4cf7-4dfc-acff-a3ee0b9d5e6e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:35.208454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea05c1f-4cf7-4dfc-acff-a3ee0b9d5e6e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:35.213353 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb19fb-5f98-400e-9608-3029875eb6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:35.214162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb19fb-5f98-400e-9608-3029875eb6cd admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:35.214442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb19fb-5f98-400e-9608-3029875eb6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:35.214765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb19fb-5f98-400e-9608-3029875eb6cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:35.215568 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb19fb-5f98-400e-9608-3029875eb6cd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:35.215870 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb19fb-5f98-400e-9608-3029875eb6cd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:35.218456 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb19fb-5f98-400e-9608-3029875eb6cd admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:35.232493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 336/674] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:35.239238 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bb5c8-3952-4dec-afc1-71b439468ff9 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:35.249496 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bb5c8-3952-4dec-afc1-71b439468ff9 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:35.254346 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5333f-2457-4e97-a2a8-62f12ec8644e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:35.255282 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5333f-2457-4e97-a2a8-62f12ec8644e admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:35.255562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5333f-2457-4e97-a2a8-62f12ec8644e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:35.255835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5333f-2457-4e97-a2a8-62f12ec8644e admin admin] PATH_INFO: `/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/beb0af7ac70d48989852c022c9f83848/roles/4f557aac969f4c2f95aee8e21d67c802` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:35.272001 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5333f-2457-4e97-a2a8-62f12ec8644e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user_id=beb0af7ac70d48989852c022c9f83848, role_id=4f557aac969f4c2f95aee8e21d67c802)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:35.274912 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5333f-2457-4e97-a2a8-62f12ec8644e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:35.290293 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 339/675] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:51:35 2021] PUT /identity/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/beb0af7ac70d48989852c022c9f83848/roles/4f557aac969f4c2f95aee8e21d67c802 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:51:36.922479 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946891c-1493-412c-bf77-64d51b4f1b18 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:36.923200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946891c-1493-412c-bf77-64d51b4f1b18 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:36.923200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946891c-1493-412c-bf77-64d51b4f1b18 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:36.925022 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 337/676] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:36.937145 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0402672-788d-49c8-a2ee-95f90409ff46 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:36.938156 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0402672-788d-49c8-a2ee-95f90409ff46 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:36.938650 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0402672-788d-49c8-a2ee-95f90409ff46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:36.962959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-d0402672-788d-49c8-a2ee-95f90409ff46 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:36.964448 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d0402672-788d-49c8-a2ee-95f90409ff46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:37.031738 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 340/677] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:37.081525 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946891c-1493-412c-bf77-64d51b4f1b18 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:37.101197 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946891c-1493-412c-bf77-64d51b4f1b18 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:37.111093 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02488080-9069-4575-86ac-c85e365a135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:37.111874 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02488080-9069-4575-86ac-c85e365a135b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.112152 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02488080-9069-4575-86ac-c85e365a135b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.112423 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02488080-9069-4575-86ac-c85e365a135b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.125487 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02488080-9069-4575-86ac-c85e365a135b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:37.127410 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02488080-9069-4575-86ac-c85e365a135b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:37.148507 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-02488080-9069-4575-86ac-c85e365a135b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:37.150694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 338/678] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:37.156549 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0402672-788d-49c8-a2ee-95f90409ff46 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:37.171119 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0402672-788d-49c8-a2ee-95f90409ff46 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:37.184044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1548f-6522-4043-8b69-fc930456a49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:37.184653 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1548f-6522-4043-8b69-fc930456a49c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.184937 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1548f-6522-4043-8b69-fc930456a49c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.185214 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1548f-6522-4043-8b69-fc930456a49c admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.186504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1548f-6522-4043-8b69-fc930456a49c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:37.186815 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1548f-6522-4043-8b69-fc930456a49c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:37.188422 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1548f-6522-4043-8b69-fc930456a49c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:37.224267 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 341/679] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:37.229801 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02488080-9069-4575-86ac-c85e365a135b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:37.242893 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02488080-9069-4575-86ac-c85e365a135b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:37.250722 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624d4ad-49f5-4e81-b67b-5f431d4ebe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:37.251371 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624d4ad-49f5-4e81-b67b-5f431d4ebe57 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.251651 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624d4ad-49f5-4e81-b67b-5f431d4ebe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.251924 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624d4ad-49f5-4e81-b67b-5f431d4ebe57 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.252650 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624d4ad-49f5-4e81-b67b-5f431d4ebe57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:37.254653 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624d4ad-49f5-4e81-b67b-5f431d4ebe57 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:37.302050 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 339/680] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:51:37 2021] POST /identity/v3/users => generated 254 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:51:37.518758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c0983-202e-4286-9ba8-7a25c5b99334 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.518939 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c0983-202e-4286-9ba8-7a25c5b99334 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.519212 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c0983-202e-4286-9ba8-7a25c5b99334 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.521276 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 342/681] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:37.527078 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c3bc4-6bb4-4de8-a8c0-da08e9e3256c None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.527359 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c3bc4-6bb4-4de8-a8c0-da08e9e3256c None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.527633 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c3bc4-6bb4-4de8-a8c0-da08e9e3256c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.551893 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-f15c3bc4-6bb4-4de8-a8c0-da08e9e3256c None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:37.553109 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f15c3bc4-6bb4-4de8-a8c0-da08e9e3256c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:37.567236 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 340/682] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:51:37.594143 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c0983-202e-4286-9ba8-7a25c5b99334 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:37.608986 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c0983-202e-4286-9ba8-7a25c5b99334 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:37.617230 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbef9e8-715c-433f-bc97-9aeee8bb8998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:37.618454 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbef9e8-715c-433f-bc97-9aeee8bb8998 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.618939 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbef9e8-715c-433f-bc97-9aeee8bb8998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.619504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbef9e8-715c-433f-bc97-9aeee8bb8998 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.635410 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbef9e8-715c-433f-bc97-9aeee8bb8998 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:37.643045 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-1fbef9e8-715c-433f-bc97-9aeee8bb8998 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:51:37.644631 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 343/683] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:51:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:37.651308 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c3bc4-6bb4-4de8-a8c0-da08e9e3256c None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:37.663638 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c3bc4-6bb4-4de8-a8c0-da08e9e3256c None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:37.671255 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881c85a-390a-4937-8080-e6fc21a24491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:37.671920 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881c85a-390a-4937-8080-e6fc21a24491 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.672198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881c85a-390a-4937-8080-e6fc21a24491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.672469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881c85a-390a-4937-8080-e6fc21a24491 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.673241 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881c85a-390a-4937-8080-e6fc21a24491 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:37.673536 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881c85a-390a-4937-8080-e6fc21a24491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:37.675233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881c85a-390a-4937-8080-e6fc21a24491 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:37.687520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 341/684] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:37.693200 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbef9e8-715c-433f-bc97-9aeee8bb8998 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:37.706947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbef9e8-715c-433f-bc97-9aeee8bb8998 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:37.713953 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593a054-62f0-42c7-8051-11c710e9b29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:37.714756 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593a054-62f0-42c7-8051-11c710e9b29d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.715032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593a054-62f0-42c7-8051-11c710e9b29d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.715303 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593a054-62f0-42c7-8051-11c710e9b29d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.728843 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593a054-62f0-42c7-8051-11c710e9b29d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:37.731193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593a054-62f0-42c7-8051-11c710e9b29d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:37.750398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-4593a054-62f0-42c7-8051-11c710e9b29d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:37.752152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 344/685] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:37.758127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881c85a-390a-4937-8080-e6fc21a24491 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:37.768519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881c85a-390a-4937-8080-e6fc21a24491 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:37.773326 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cf12a-96d1-400d-8c4c-43c443ef52a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:37.774251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cf12a-96d1-400d-8c4c-43c443ef52a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.774777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cf12a-96d1-400d-8c4c-43c443ef52a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.775240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cf12a-96d1-400d-8c4c-43c443ef52a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.776307 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cf12a-96d1-400d-8c4c-43c443ef52a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:37.776820 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cf12a-96d1-400d-8c4c-43c443ef52a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:37.778667 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cf12a-96d1-400d-8c4c-43c443ef52a6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:37.788375 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677e06b-ff68-41d6-bd1d-ad8c56c6821a None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.788921 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677e06b-ff68-41d6-bd1d-ad8c56c6821a None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.789428 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677e06b-ff68-41d6-bd1d-ad8c56c6821a None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.791717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 345/686] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:37.791890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 342/687] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:37.798262 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4be11-9dd9-4a36-a9c7-16af0dc3d2f0 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.798668 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677e06b-ff68-41d6-bd1d-ad8c56c6821a None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:37.798999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4be11-9dd9-4a36-a9c7-16af0dc3d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.799620 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4be11-9dd9-4a36-a9c7-16af0dc3d2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.821753 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-b5b4be11-9dd9-4a36-a9c7-16af0dc3d2f0 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:37.823356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b5b4be11-9dd9-4a36-a9c7-16af0dc3d2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:37.828149 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677e06b-ff68-41d6-bd1d-ad8c56c6821a None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:37.833316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a758da-70d9-4312-a487-369e9ac1d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:37.833915 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 343/688] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:37.834110 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a758da-70d9-4312-a487-369e9ac1d191 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.834431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a758da-70d9-4312-a487-369e9ac1d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.834755 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a758da-70d9-4312-a487-369e9ac1d191 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.851122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a758da-70d9-4312-a487-369e9ac1d191 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:37.853679 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a758da-70d9-4312-a487-369e9ac1d191 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:37.865504 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4be11-9dd9-4a36-a9c7-16af0dc3d2f0 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:37.876350 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4be11-9dd9-4a36-a9c7-16af0dc3d2f0 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:37.878798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-57a758da-70d9-4312-a487-369e9ac1d191 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 02:51:37.880830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 346/689] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Dec 15 02:51:37 2021] GET /identity/v3/users/nova => generated 82 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:37.880957 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25024e-c60f-4b9d-a6ea-6e26fffdbc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:37.882138 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25024e-c60f-4b9d-a6ea-6e26fffdbc73 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.882138 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25024e-c60f-4b9d-a6ea-6e26fffdbc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.882315 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25024e-c60f-4b9d-a6ea-6e26fffdbc73 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.883753 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25024e-c60f-4b9d-a6ea-6e26fffdbc73 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:37.884550 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-ea25024e-c60f-4b9d-a6ea-6e26fffdbc73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:37.884550 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:51:37.884550 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:51:37.885618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25024e-c60f-4b9d-a6ea-6e26fffdbc73 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:37.886783 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a758da-70d9-4312-a487-369e9ac1d191 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:37.897678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a758da-70d9-4312-a487-369e9ac1d191 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:37.900652 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-ea25024e-c60f-4b9d-a6ea-6e26fffdbc73 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 02:51:37.901616 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 344/690] 10.222.0.18 () {56 vars in 1150 bytes} [Wed Dec 15 02:51:37 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:37.904708 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5082957-d70e-4e0e-ab10-6c76742c0ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:37.905605 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5082957-d70e-4e0e-ab10-6c76742c0ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.906105 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5082957-d70e-4e0e-ab10-6c76742c0ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.906591 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5082957-d70e-4e0e-ab10-6c76742c0ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.907633 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5082957-d70e-4e0e-ab10-6c76742c0ee7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:37.907917 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25024e-c60f-4b9d-a6ea-6e26fffdbc73 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:37.908431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5082957-d70e-4e0e-ab10-6c76742c0ee7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:37.910574 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5082957-d70e-4e0e-ab10-6c76742c0ee7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:37.922053 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25024e-c60f-4b9d-a6ea-6e26fffdbc73 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:37.930860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04f02f-d03e-4f21-8032-4c83891de60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:37.931564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04f02f-d03e-4f21-8032-4c83891de60e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.931842 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04f02f-d03e-4f21-8032-4c83891de60e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.932106 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04f02f-d03e-4f21-8032-4c83891de60e admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.934938 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04f02f-d03e-4f21-8032-4c83891de60e admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:37.935248 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04f02f-d03e-4f21-8032-4c83891de60e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:37.936978 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-3a04f02f-d03e-4f21-8032-4c83891de60e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:37.936978 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:51:37.936978 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:51:37.939991 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04f02f-d03e-4f21-8032-4c83891de60e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:37.946137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 347/691] 10.222.0.18 () {56 vars in 1154 bytes} [Wed Dec 15 02:51:37 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:37.948348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 345/692] 10.222.0.18 () {56 vars in 1145 bytes} [Wed Dec 15 02:51:37 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:37.952594 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5082957-d70e-4e0e-ab10-6c76742c0ee7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:37.960424 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04f02f-d03e-4f21-8032-4c83891de60e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:37.972672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5082957-d70e-4e0e-ab10-6c76742c0ee7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:37.975932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04f02f-d03e-4f21-8032-4c83891de60e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:37.981897 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07bca8-d81f-4fb5-a102-e36c274ba0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:37.983669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07bca8-d81f-4fb5-a102-e36c274ba0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.983951 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07bca8-d81f-4fb5-a102-e36c274ba0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.984770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07bca8-d81f-4fb5-a102-e36c274ba0a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.985888 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a05b00-a6f5-4f06-bafa-4890e7540e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:37.986555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a05b00-a6f5-4f06-bafa-4890e7540e25 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:37.986884 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a05b00-a6f5-4f06-bafa-4890e7540e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:37.987414 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a05b00-a6f5-4f06-bafa-4890e7540e25 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:37.988125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a05b00-a6f5-4f06-bafa-4890e7540e25 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:37.988425 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a05b00-a6f5-4f06-bafa-4890e7540e25 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:37.992564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a05b00-a6f5-4f06-bafa-4890e7540e25 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.002054 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07bca8-d81f-4fb5-a102-e36c274ba0a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.004898 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07bca8-d81f-4fb5-a102-e36c274ba0a1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.006379 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 346/693] 10.222.0.18 () {56 vars in 1145 bytes} [Wed Dec 15 02:51:37 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:38.015557 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 348/694] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:37 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:38.023176 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a05b00-a6f5-4f06-bafa-4890e7540e25 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.042194 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2250d5-a13c-4141-8dc4-76abdcd6b9ec None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.042496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a05b00-a6f5-4f06-bafa-4890e7540e25 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.042656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2250d5-a13c-4141-8dc4-76abdcd6b9ec None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.042656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2250d5-a13c-4141-8dc4-76abdcd6b9ec None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.044722 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 349/695] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:51:38.053752 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8026c0-6cfc-44b1-a6b1-8f0127ddb79e None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.054098 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8026c0-6cfc-44b1-a6b1-8f0127ddb79e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.054322 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8026c0-6cfc-44b1-a6b1-8f0127ddb79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.058372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802a08d-3241-4075-87d7-340cd463eb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.060311 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a08d-3241-4075-87d7-340cd463eb19 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.061926 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a08d-3241-4075-87d7-340cd463eb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.062274 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a08d-3241-4075-87d7-340cd463eb19 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.087163 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802a08d-3241-4075-87d7-340cd463eb19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.089092 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802a08d-3241-4075-87d7-340cd463eb19 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.090773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-5b8026c0-6cfc-44b1-a6b1-8f0127ddb79e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:38.095152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5b8026c0-6cfc-44b1-a6b1-8f0127ddb79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:38.114032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 350/696] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:51:38.129627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-6802a08d-3241-4075-87d7-340cd463eb19 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:38.131221 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 347/697] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:38.137431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8026c0-6cfc-44b1-a6b1-8f0127ddb79e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.149653 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8026c0-6cfc-44b1-a6b1-8f0127ddb79e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.155752 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802a08d-3241-4075-87d7-340cd463eb19 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.168931 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802a08d-3241-4075-87d7-340cd463eb19 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.171840 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59698f-8aca-4f45-a0e5-85a6a7f0675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.172507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59698f-8aca-4f45-a0e5-85a6a7f0675d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.172784 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59698f-8aca-4f45-a0e5-85a6a7f0675d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.173049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59698f-8aca-4f45-a0e5-85a6a7f0675d admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.173789 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59698f-8aca-4f45-a0e5-85a6a7f0675d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:38.174120 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59698f-8aca-4f45-a0e5-85a6a7f0675d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.175744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59698f-8aca-4f45-a0e5-85a6a7f0675d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.186436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f363fa7-3cf2-4238-a06a-c1665119446b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.187232 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f363fa7-3cf2-4238-a06a-c1665119446b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.187508 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f363fa7-3cf2-4238-a06a-c1665119446b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.187777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f363fa7-3cf2-4238-a06a-c1665119446b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.200431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 351/698] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:38.206434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59698f-8aca-4f45-a0e5-85a6a7f0675d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.207552 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f363fa7-3cf2-4238-a06a-c1665119446b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:38.220305 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-2f363fa7-3cf2-4238-a06a-c1665119446b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:38.222984 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 348/699] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:38.224880 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59698f-8aca-4f45-a0e5-85a6a7f0675d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.230494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f363fa7-3cf2-4238-a06a-c1665119446b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.231417 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23ea69-89b3-4810-9d40-32751014bc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.232242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23ea69-89b3-4810-9d40-32751014bc7f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.232594 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23ea69-89b3-4810-9d40-32751014bc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.233366 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23ea69-89b3-4810-9d40-32751014bc7f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.248574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f363fa7-3cf2-4238-a06a-c1665119446b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.251396 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23ea69-89b3-4810-9d40-32751014bc7f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.253354 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23ea69-89b3-4810-9d40-32751014bc7f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.258165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35c58d-2cab-42df-836b-912744e10fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.258829 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35c58d-2cab-42df-836b-912744e10fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.259105 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35c58d-2cab-42df-836b-912744e10fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.259629 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35c58d-2cab-42df-836b-912744e10fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.260380 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35c58d-2cab-42df-836b-912744e10fe1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:38.260681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35c58d-2cab-42df-836b-912744e10fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.262271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35c58d-2cab-42df-836b-912744e10fe1 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.271236 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 349/700] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:38.274938 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-7d23ea69-89b3-4810-9d40-32751014bc7f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:38.276107 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 352/701] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:38.278296 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35c58d-2cab-42df-836b-912744e10fe1 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.283522 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23ea69-89b3-4810-9d40-32751014bc7f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.288417 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35c58d-2cab-42df-836b-912744e10fe1 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.293032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23ea69-89b3-4810-9d40-32751014bc7f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.293230 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f056b6-e1a4-402b-a1e0-ee923c1daff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.293998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f056b6-e1a4-402b-a1e0-ee923c1daff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.294292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f056b6-e1a4-402b-a1e0-ee923c1daff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.294562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f056b6-e1a4-402b-a1e0-ee923c1daff3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.301519 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737ded3-deca-4a61-9275-a332d3e84eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.302995 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737ded3-deca-4a61-9275-a332d3e84eaf admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.303503 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737ded3-deca-4a61-9275-a332d3e84eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.304005 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737ded3-deca-4a61-9275-a332d3e84eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.305745 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737ded3-deca-4a61-9275-a332d3e84eaf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:38.306290 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737ded3-deca-4a61-9275-a332d3e84eaf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.306392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f056b6-e1a4-402b-a1e0-ee923c1daff3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.308151 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f056b6-e1a4-402b-a1e0-ee923c1daff3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.308793 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737ded3-deca-4a61-9275-a332d3e84eaf admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.327144 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-f0f056b6-e1a4-402b-a1e0-ee923c1daff3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:38.327349 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 353/702] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:38.327429 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 350/703] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:38.327876 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9db66-ec35-4763-a70f-80be4cbcc9a5 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.328160 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9db66-ec35-4763-a70f-80be4cbcc9a5 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.328435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9db66-ec35-4763-a70f-80be4cbcc9a5 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.330108 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 354/704] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:38.333651 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f056b6-e1a4-402b-a1e0-ee923c1daff3 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.333772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9db66-ec35-4763-a70f-80be4cbcc9a5 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.345266 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f056b6-e1a4-402b-a1e0-ee923c1daff3 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.349219 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9db66-ec35-4763-a70f-80be4cbcc9a5 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.350713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab98f0f-6717-4705-b57b-05638b0801cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.351353 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab98f0f-6717-4705-b57b-05638b0801cb admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.351632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab98f0f-6717-4705-b57b-05638b0801cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.351903 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab98f0f-6717-4705-b57b-05638b0801cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.352623 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab98f0f-6717-4705-b57b-05638b0801cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:38.352922 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab98f0f-6717-4705-b57b-05638b0801cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.353874 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce4e34-29ee-4b06-9ced-016699d6b545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.354522 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab98f0f-6717-4705-b57b-05638b0801cb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.354619 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce4e34-29ee-4b06-9ced-016699d6b545 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.354801 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce4e34-29ee-4b06-9ced-016699d6b545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.355068 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce4e34-29ee-4b06-9ced-016699d6b545 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.355927 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce4e34-29ee-4b06-9ced-016699d6b545 admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=fcd50adcd390465ea6fc8582e1524909) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:38.356191 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce4e34-29ee-4b06-9ced-016699d6b545 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.358038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce4e34-29ee-4b06-9ced-016699d6b545 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.363945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 355/705] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/role_assignments?user.id=fcd50adcd390465ea6fc8582e1524909&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:38.365280 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e02a-b71b-4343-8f99-43afe6ca228d None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.365527 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e02a-b71b-4343-8f99-43afe6ca228d None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.365805 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e02a-b71b-4343-8f99-43afe6ca228d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.366637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 351/706] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:38.372645 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab98f0f-6717-4705-b57b-05638b0801cb admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.384093 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab98f0f-6717-4705-b57b-05638b0801cb admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.385003 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-e9e1e02a-b71b-4343-8f99-43afe6ca228d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:38.386267 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e9e1e02a-b71b-4343-8f99-43afe6ca228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:38.389680 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d9eb7-ac0b-43dd-a285-7770199bf532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.390587 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d9eb7-ac0b-43dd-a285-7770199bf532 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.390861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d9eb7-ac0b-43dd-a285-7770199bf532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.391191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d9eb7-ac0b-43dd-a285-7770199bf532 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.395434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 356/707] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:38.399796 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d9eb7-ac0b-43dd-a285-7770199bf532 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.401915 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d9eb7-ac0b-43dd-a285-7770199bf532 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.417444 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-097d9eb7-ac0b-43dd-a285-7770199bf532 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 02:51:38.419010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 352/708] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:38.420041 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1e02a-b71b-4343-8f99-43afe6ca228d None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.425277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d9eb7-ac0b-43dd-a285-7770199bf532 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.429958 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1e02a-b71b-4343-8f99-43afe6ca228d None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.434894 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97912440-b409-4972-8fc3-dbd044eb71cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.436005 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97912440-b409-4972-8fc3-dbd044eb71cd admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.436400 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d9eb7-ac0b-43dd-a285-7770199bf532 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.436648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97912440-b409-4972-8fc3-dbd044eb71cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.437090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97912440-b409-4972-8fc3-dbd044eb71cd admin admin] PATH_INFO: `/v3/services/network` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.438106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97912440-b409-4972-8fc3-dbd044eb71cd admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.439285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-97912440-b409-4972-8fc3-dbd044eb71cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:38.439285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:51:38.439285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:51:38.440488 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97912440-b409-4972-8fc3-dbd044eb71cd admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.441648 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a32bb-8cd6-47d8-bee5-1f6ae806c824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.442440 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a32bb-8cd6-47d8-bee5-1f6ae806c824 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.442826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a32bb-8cd6-47d8-bee5-1f6ae806c824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.443099 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a32bb-8cd6-47d8-bee5-1f6ae806c824 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.444001 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a32bb-8cd6-47d8-bee5-1f6ae806c824 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:38.444306 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a32bb-8cd6-47d8-bee5-1f6ae806c824 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.446281 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a32bb-8cd6-47d8-bee5-1f6ae806c824 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.455989 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-97912440-b409-4972-8fc3-dbd044eb71cd admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 02:51:38.457830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 357/709] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/services/network => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:38.464299 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97912440-b409-4972-8fc3-dbd044eb71cd admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.466384 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 353/710] 10.222.0.18 () {56 vars in 1156 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:38.472973 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a32bb-8cd6-47d8-bee5-1f6ae806c824 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.475820 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97912440-b409-4972-8fc3-dbd044eb71cd admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.480609 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee857a8-bc53-471f-87cb-1cac916c83ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.481518 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee857a8-bc53-471f-87cb-1cac916c83ea admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.482053 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee857a8-bc53-471f-87cb-1cac916c83ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.482587 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee857a8-bc53-471f-87cb-1cac916c83ea admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.483497 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee857a8-bc53-471f-87cb-1cac916c83ea admin admin] RBAC: Adding query filter params (name=network) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:38.483599 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a32bb-8cd6-47d8-bee5-1f6ae806c824 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.484084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee857a8-bc53-471f-87cb-1cac916c83ea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.485398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-4ee857a8-bc53-471f-87cb-1cac916c83ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:38.485398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:51:38.485398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:51:38.486629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee857a8-bc53-471f-87cb-1cac916c83ea admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.488148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76243343-a474-4459-b103-33cd3c0eff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.488862 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76243343-a474-4459-b103-33cd3c0eff43 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.489193 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76243343-a474-4459-b103-33cd3c0eff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.489518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76243343-a474-4459-b103-33cd3c0eff43 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.495078 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 358/711] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/services?name=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:38.500153 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76243343-a474-4459-b103-33cd3c0eff43 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.501062 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee857a8-bc53-471f-87cb-1cac916c83ea admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.502507 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76243343-a474-4459-b103-33cd3c0eff43 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.511405 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee857a8-bc53-471f-87cb-1cac916c83ea admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.514570 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 354/712] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 02:51:38.521952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973685f-0903-4117-a9ef-c16abb157fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.522320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76243343-a474-4459-b103-33cd3c0eff43 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.523374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973685f-0903-4117-a9ef-c16abb157fba admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.523846 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973685f-0903-4117-a9ef-c16abb157fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.524311 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973685f-0903-4117-a9ef-c16abb157fba admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.525242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973685f-0903-4117-a9ef-c16abb157fba admin admin] RBAC: Adding query filter params (type=network) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:38.525741 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973685f-0903-4117-a9ef-c16abb157fba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.527582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973685f-0903-4117-a9ef-c16abb157fba admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.532434 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76243343-a474-4459-b103-33cd3c0eff43 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.535133 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 359/713] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/services?type=network => generated 124 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:38.538728 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a5f8a-1c7c-4830-86b6-2607989fc2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.539890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a5f8a-1c7c-4830-86b6-2607989fc2bb admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.540387 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a5f8a-1c7c-4830-86b6-2607989fc2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.540856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a5f8a-1c7c-4830-86b6-2607989fc2bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.563412 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a5f8a-1c7c-4830-86b6-2607989fc2bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.565347 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a5f8a-1c7c-4830-86b6-2607989fc2bb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.587487 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-b00a5f8a-1c7c-4830-86b6-2607989fc2bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:38.589066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 355/714] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:38.595627 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973685f-0903-4117-a9ef-c16abb157fba admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.607239 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973685f-0903-4117-a9ef-c16abb157fba admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.618651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5639c3-3dc1-4554-b949-2d74be0a5bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.619332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5639c3-3dc1-4554-b949-2d74be0a5bcb admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.619610 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5639c3-3dc1-4554-b949-2d74be0a5bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.619883 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5639c3-3dc1-4554-b949-2d74be0a5bcb admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.620638 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5639c3-3dc1-4554-b949-2d74be0a5bcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:38.620941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5639c3-3dc1-4554-b949-2d74be0a5bcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.622779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5639c3-3dc1-4554-b949-2d74be0a5bcb admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.643260 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 360/715] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:38.649259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a5f8a-1c7c-4830-86b6-2607989fc2bb admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.660140 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a5f8a-1c7c-4830-86b6-2607989fc2bb admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.670555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81eafc5-f6ea-4224-8b66-54c2e8e75e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.671367 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81eafc5-f6ea-4224-8b66-54c2e8e75e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.671641 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81eafc5-f6ea-4224-8b66-54c2e8e75e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.671905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81eafc5-f6ea-4224-8b66-54c2e8e75e66 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.685483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81eafc5-f6ea-4224-8b66-54c2e8e75e66 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.688176 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81eafc5-f6ea-4224-8b66-54c2e8e75e66 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.708617 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-b81eafc5-f6ea-4224-8b66-54c2e8e75e66 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:38.710109 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 356/716] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:38.716843 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5639c3-3dc1-4554-b949-2d74be0a5bcb admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.727931 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5639c3-3dc1-4554-b949-2d74be0a5bcb admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.732965 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7938075-fd5c-4e45-8a60-1ae9775d6202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.733625 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7938075-fd5c-4e45-8a60-1ae9775d6202 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.733895 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7938075-fd5c-4e45-8a60-1ae9775d6202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.734199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7938075-fd5c-4e45-8a60-1ae9775d6202 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.735000 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7938075-fd5c-4e45-8a60-1ae9775d6202 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:38.735306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7938075-fd5c-4e45-8a60-1ae9775d6202 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.737189 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7938075-fd5c-4e45-8a60-1ae9775d6202 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.752014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 361/717] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:38.760424 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81eafc5-f6ea-4224-8b66-54c2e8e75e66 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:38.777729 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81eafc5-f6ea-4224-8b66-54c2e8e75e66 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:38.786612 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97b628-a6ce-4445-b50f-ab889a033bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:38.787261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b628-a6ce-4445-b50f-ab889a033bcf admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:38.787539 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b628-a6ce-4445-b50f-ab889a033bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:38.787811 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b628-a6ce-4445-b50f-ab889a033bcf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:38.788647 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97b628-a6ce-4445-b50f-ab889a033bcf admin admin] RBAC: Adding query filter params (role.id=4f557aac969f4c2f95aee8e21d67c802, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=beb0af7ac70d48989852c022c9f83848) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:38.788950 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97b628-a6ce-4445-b50f-ab889a033bcf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:38.790790 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97b628-a6ce-4445-b50f-ab889a033bcf admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:38.797419 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 357/718] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:38 2021] GET /identity/v3/role_assignments?user.id=beb0af7ac70d48989852c022c9f83848&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=4f557aac969f4c2f95aee8e21d67c802 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:40.401263 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2c1b1-9273-4a72-8ee4-2f243d7f3c93 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:40.402283 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2c1b1-9273-4a72-8ee4-2f243d7f3c93 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:40.402799 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2c1b1-9273-4a72-8ee4-2f243d7f3c93 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:40.405623 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 362/719] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:40.411180 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7202991-6f60-4013-ae0d-8bd43aa545c8 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:40.411989 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7202991-6f60-4013-ae0d-8bd43aa545c8 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:40.412458 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7202991-6f60-4013-ae0d-8bd43aa545c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:40.431603 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-d7202991-6f60-4013-ae0d-8bd43aa545c8 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:40.432766 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d7202991-6f60-4013-ae0d-8bd43aa545c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:40.443798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 358/720] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 02:51:40.480860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2c1b1-9273-4a72-8ee4-2f243d7f3c93 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:40.500166 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2c1b1-9273-4a72-8ee4-2f243d7f3c93 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:40.505952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b24239-ef5e-4c3c-aa87-a6ff9070de30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:40.507131 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b24239-ef5e-4c3c-aa87-a6ff9070de30 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:40.507619 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b24239-ef5e-4c3c-aa87-a6ff9070de30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:40.508087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b24239-ef5e-4c3c-aa87-a6ff9070de30 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:40.525212 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b24239-ef5e-4c3c-aa87-a6ff9070de30 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:40.533279 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-c0b24239-ef5e-4c3c-aa87-a6ff9070de30 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:40.534911 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 363/721] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:40 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:40.541421 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7202991-6f60-4013-ae0d-8bd43aa545c8 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:40.554884 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7202991-6f60-4013-ae0d-8bd43aa545c8 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:40.565443 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ef82d-81df-45e2-ad0e-97ffd936e150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:40.566133 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ef82d-81df-45e2-ad0e-97ffd936e150 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:40.566411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ef82d-81df-45e2-ad0e-97ffd936e150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:40.566683 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ef82d-81df-45e2-ad0e-97ffd936e150 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:40.567441 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ef82d-81df-45e2-ad0e-97ffd936e150 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:40.567739 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ef82d-81df-45e2-ad0e-97ffd936e150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:40.569329 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ef82d-81df-45e2-ad0e-97ffd936e150 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:40.578620 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 359/722] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:40 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:40.584128 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b24239-ef5e-4c3c-aa87-a6ff9070de30 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:40.594412 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b24239-ef5e-4c3c-aa87-a6ff9070de30 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:40.605377 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce072127-6c3f-4ead-b2b9-6e4bb65856c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:40.606217 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce072127-6c3f-4ead-b2b9-6e4bb65856c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:40.606504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce072127-6c3f-4ead-b2b9-6e4bb65856c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:40.606780 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce072127-6c3f-4ead-b2b9-6e4bb65856c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:40.625920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce072127-6c3f-4ead-b2b9-6e4bb65856c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:40.627825 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce072127-6c3f-4ead-b2b9-6e4bb65856c5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:40.653771 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-ce072127-6c3f-4ead-b2b9-6e4bb65856c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:40.655733 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 364/723] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:40.661808 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ef82d-81df-45e2-ad0e-97ffd936e150 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:40.675473 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ef82d-81df-45e2-ad0e-97ffd936e150 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:40.685650 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5699a1-444f-40de-9579-7749ffe3bb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:40.686371 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5699a1-444f-40de-9579-7749ffe3bb28 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:40.686651 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5699a1-444f-40de-9579-7749ffe3bb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:40.686923 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5699a1-444f-40de-9579-7749ffe3bb28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:40.687663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5699a1-444f-40de-9579-7749ffe3bb28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:40.687963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5699a1-444f-40de-9579-7749ffe3bb28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:40.689586 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5699a1-444f-40de-9579-7749ffe3bb28 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:40.712391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 360/724] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:40.718692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce072127-6c3f-4ead-b2b9-6e4bb65856c5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:40.733157 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce072127-6c3f-4ead-b2b9-6e4bb65856c5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:40.741709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9647b4-51d6-42a9-81e6-fee03827534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:40.742545 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9647b4-51d6-42a9-81e6-fee03827534c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:40.742826 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9647b4-51d6-42a9-81e6-fee03827534c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:40.743104 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9647b4-51d6-42a9-81e6-fee03827534c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:40.752648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9647b4-51d6-42a9-81e6-fee03827534c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:40.754709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9647b4-51d6-42a9-81e6-fee03827534c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:40.777730 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-7e9647b4-51d6-42a9-81e6-fee03827534c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 02:51:40.778937 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 365/725] 10.222.0.18 () {56 vars in 1138 bytes} [Wed Dec 15 02:51:40 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:40.785721 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5699a1-444f-40de-9579-7749ffe3bb28 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:40.799056 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5699a1-444f-40de-9579-7749ffe3bb28 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:40.809533 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516873b-8b81-4395-a348-0019391ba4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:40.810215 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516873b-8b81-4395-a348-0019391ba4de admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:40.810531 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516873b-8b81-4395-a348-0019391ba4de admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:40.810805 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516873b-8b81-4395-a348-0019391ba4de admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:40.811650 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516873b-8b81-4395-a348-0019391ba4de admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:40.811949 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516873b-8b81-4395-a348-0019391ba4de admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:40.813777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516873b-8b81-4395-a348-0019391ba4de admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:40.836080 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 361/726] 10.222.0.18 () {56 vars in 1170 bytes} [Wed Dec 15 02:51:40 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:40.842341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9647b4-51d6-42a9-81e6-fee03827534c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:40.855567 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9647b4-51d6-42a9-81e6-fee03827534c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:40.871203 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d84cb8-565a-46d6-bcf2-7d8cc91325aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:40.871859 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d84cb8-565a-46d6-bcf2-7d8cc91325aa admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:40.872140 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d84cb8-565a-46d6-bcf2-7d8cc91325aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:40.872417 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d84cb8-565a-46d6-bcf2-7d8cc91325aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:40.886140 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d84cb8-565a-46d6-bcf2-7d8cc91325aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:40.887898 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d84cb8-565a-46d6-bcf2-7d8cc91325aa admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:40.905182 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 366/727] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:40 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 02:51:40.911468 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516873b-8b81-4395-a348-0019391ba4de admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:40.925872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516873b-8b81-4395-a348-0019391ba4de admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:40.932624 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ab4fc-e766-4138-8c3b-2cd187e4faef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:40.933418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ab4fc-e766-4138-8c3b-2cd187e4faef admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:40.933817 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ab4fc-e766-4138-8c3b-2cd187e4faef admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:40.934160 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ab4fc-e766-4138-8c3b-2cd187e4faef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:40.952680 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ab4fc-e766-4138-8c3b-2cd187e4faef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:40.954593 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ab4fc-e766-4138-8c3b-2cd187e4faef admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:40.977183 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-1a1ab4fc-e766-4138-8c3b-2cd187e4faef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:40.978745 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 362/728] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:40.984462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d84cb8-565a-46d6-bcf2-7d8cc91325aa admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.004763 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d84cb8-565a-46d6-bcf2-7d8cc91325aa admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.019839 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172746a-512c-4608-8592-624e454e7726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.020517 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172746a-512c-4608-8592-624e454e7726 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.020798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172746a-512c-4608-8592-624e454e7726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.021077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172746a-512c-4608-8592-624e454e7726 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.021825 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172746a-512c-4608-8592-624e454e7726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:41.022164 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172746a-512c-4608-8592-624e454e7726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:41.023773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172746a-512c-4608-8592-624e454e7726 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:41.047260 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 367/729] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:41.053157 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ab4fc-e766-4138-8c3b-2cd187e4faef admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.066206 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ab4fc-e766-4138-8c3b-2cd187e4faef admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.073604 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95e4b8-9135-4ef3-9fc7-51c911d64827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.074456 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95e4b8-9135-4ef3-9fc7-51c911d64827 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.074782 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95e4b8-9135-4ef3-9fc7-51c911d64827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.075051 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95e4b8-9135-4ef3-9fc7-51c911d64827 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.088797 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95e4b8-9135-4ef3-9fc7-51c911d64827 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:41.090825 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95e4b8-9135-4ef3-9fc7-51c911d64827 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:41.106713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-fa95e4b8-9135-4ef3-9fc7-51c911d64827 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:41.108238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 363/730] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:41.112894 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da9db9-34b9-4133-b3e5-84fff1d0030c None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.113192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da9db9-34b9-4133-b3e5-84fff1d0030c None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.113476 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da9db9-34b9-4133-b3e5-84fff1d0030c None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.115541 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 368/731] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:41.118440 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95e4b8-9135-4ef3-9fc7-51c911d64827 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.122084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659410c-7d56-445c-9b57-36a2c931fd94 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.122084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659410c-7d56-445c-9b57-36a2c931fd94 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.122084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659410c-7d56-445c-9b57-36a2c931fd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.132727 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95e4b8-9135-4ef3-9fc7-51c911d64827 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.140910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aeff99-ba98-4f49-9774-4790e3b99271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.141553 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aeff99-ba98-4f49-9774-4790e3b99271 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.141826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aeff99-ba98-4f49-9774-4790e3b99271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.142584 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aeff99-ba98-4f49-9774-4790e3b99271 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.143438 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aeff99-ba98-4f49-9774-4790e3b99271 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:41.144088 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aeff99-ba98-4f49-9774-4790e3b99271 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:41.146096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aeff99-ba98-4f49-9774-4790e3b99271 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:41.147914 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-0659410c-7d56-445c-9b57-36a2c931fd94 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:41.149504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-0659410c-7d56-445c-9b57-36a2c931fd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:41.158962 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 369/732] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:51:41.159354 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 364/733] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:41.160456 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8bd1c-93e0-471e-9984-bf5a7614b4f2 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.160744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8bd1c-93e0-471e-9984-bf5a7614b4f2 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.161019 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8bd1c-93e0-471e-9984-bf5a7614b4f2 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.166023 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 370/734] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:41.170675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aeff99-ba98-4f49-9774-4790e3b99271 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.172542 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2457f-9e87-4a7a-8c99-0266a3c7cebe None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.173079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2457f-9e87-4a7a-8c99-0266a3c7cebe None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.173619 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2457f-9e87-4a7a-8c99-0266a3c7cebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.184321 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aeff99-ba98-4f49-9774-4790e3b99271 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.189331 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fdfda-82d8-4595-9526-f9f36ab66885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.190122 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fdfda-82d8-4595-9526-f9f36ab66885 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.190310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fdfda-82d8-4595-9526-f9f36ab66885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.190605 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fdfda-82d8-4595-9526-f9f36ab66885 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.191435 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fdfda-82d8-4595-9526-f9f36ab66885 admin admin] RBAC: Adding query filter params (role.id=4f557aac969f4c2f95aee8e21d67c802, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=39cddc4e2ea943cd882b6a1addd98e8c) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:41.191742 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fdfda-82d8-4595-9526-f9f36ab66885 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:41.193575 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fdfda-82d8-4595-9526-f9f36ab66885 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:41.201942 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-dfd2457f-9e87-4a7a-8c99-0266a3c7cebe None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:41.203399 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-dfd2457f-9e87-4a7a-8c99-0266a3c7cebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:41.210450 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 365/735] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:41 2021] GET /identity/v3/role_assignments?user.id=39cddc4e2ea943cd882b6a1addd98e8c&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=4f557aac969f4c2f95aee8e21d67c802 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:41.211377 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fdfda-82d8-4595-9526-f9f36ab66885 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.218247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 371/736] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 02:51:41.223478 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fdfda-82d8-4595-9526-f9f36ab66885 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.228179 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c784a23-2d7d-4415-84d4-9ca9670b22ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.228891 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c784a23-2d7d-4415-84d4-9ca9670b22ae admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.229172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c784a23-2d7d-4415-84d4-9ca9670b22ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.229446 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c784a23-2d7d-4415-84d4-9ca9670b22ae admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.230327 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c784a23-2d7d-4415-84d4-9ca9670b22ae admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:41.231522 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-4c784a23-2d7d-4415-84d4-9ca9670b22ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:41.231522 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:51:41.231522 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:51:41.232520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c784a23-2d7d-4415-84d4-9ca9670b22ae admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:41.242446 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2457f-9e87-4a7a-8c99-0266a3c7cebe None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.260887 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2457f-9e87-4a7a-8c99-0266a3c7cebe None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.266035 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 366/737] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Dec 15 02:51:41 2021] POST /identity/v3/services => generated 251 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:51:41.323430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b74f5-ac8d-4d01-9736-166247c8a96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.324267 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b74f5-ac8d-4d01-9736-166247c8a96e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.324544 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b74f5-ac8d-4d01-9736-166247c8a96e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.324813 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b74f5-ac8d-4d01-9736-166247c8a96e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.341534 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b74f5-ac8d-4d01-9736-166247c8a96e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:41.354097 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-fd4b74f5-ac8d-4d01-9736-166247c8a96e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:51:41.355573 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 372/738] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:51:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:41.363165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c784a23-2d7d-4415-84d4-9ca9670b22ae admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.366748 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81ea2f-8fad-405b-9019-b8556bd68c13 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.368852 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81ea2f-8fad-405b-9019-b8556bd68c13 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.368852 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81ea2f-8fad-405b-9019-b8556bd68c13 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.370032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 373/739] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:51:41.377651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19d486-9e17-411b-8aa2-c29820b798ca None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.378314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19d486-9e17-411b-8aa2-c29820b798ca None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.378779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19d486-9e17-411b-8aa2-c29820b798ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.390109 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c784a23-2d7d-4415-84d4-9ca9670b22ae admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.400108 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc1029-f333-40e4-bd14-9670fc54b7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.401068 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc1029-f333-40e4-bd14-9670fc54b7ca admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.401505 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc1029-f333-40e4-bd14-9670fc54b7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.401926 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc1029-f333-40e4-bd14-9670fc54b7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.403146 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc1029-f333-40e4-bd14-9670fc54b7ca admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:41.403615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc1029-f333-40e4-bd14-9670fc54b7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:41.403735 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-8d19d486-9e17-411b-8aa2-c29820b798ca None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:41.405054 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-8d19d486-9e17-411b-8aa2-c29820b798ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:41.410399 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc1029-f333-40e4-bd14-9670fc54b7ca admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:41.424304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 374/740] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:41 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:51:41.432832 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 367/741] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:41.440012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19d486-9e17-411b-8aa2-c29820b798ca None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.450472 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19d486-9e17-411b-8aa2-c29820b798ca None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.453260 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc1029-f333-40e4-bd14-9670fc54b7ca admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.459159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca7814-1d80-4418-806c-d1c00734fa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.459962 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca7814-1d80-4418-806c-d1c00734fa9f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.460241 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca7814-1d80-4418-806c-d1c00734fa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.460513 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca7814-1d80-4418-806c-d1c00734fa9f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.464739 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc1029-f333-40e4-bd14-9670fc54b7ca admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.472650 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dccd07-3655-4817-a989-8e2e07b960b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.473368 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dccd07-3655-4817-a989-8e2e07b960b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.473698 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dccd07-3655-4817-a989-8e2e07b960b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.474001 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dccd07-3655-4817-a989-8e2e07b960b1 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.474179 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca7814-1d80-4418-806c-d1c00734fa9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:41.475818 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dccd07-3655-4817-a989-8e2e07b960b1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:41.476004 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca7814-1d80-4418-806c-d1c00734fa9f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:41.477536 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dccd07-3655-4817-a989-8e2e07b960b1 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:41.496851 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 368/742] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Dec 15 02:51:41 2021] POST /identity/v3/services => generated 240 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:51:41.503494 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-c1ca7814-1d80-4418-806c-d1c00734fa9f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:41.505023 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 375/743] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:41.511521 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dccd07-3655-4817-a989-8e2e07b960b1 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.533666 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dccd07-3655-4817-a989-8e2e07b960b1 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.540120 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ac96-0c05-4cb7-b133-d717693f2fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.540839 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ac96-0c05-4cb7-b133-d717693f2fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.541127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ac96-0c05-4cb7-b133-d717693f2fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.541459 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ac96-0c05-4cb7-b133-d717693f2fd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.542286 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04ac96-0c05-4cb7-b133-d717693f2fd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:41.542594 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04ac96-0c05-4cb7-b133-d717693f2fd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:41.544362 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04ac96-0c05-4cb7-b133-d717693f2fd9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:41.559094 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 369/744] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:41.566242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca7814-1d80-4418-806c-d1c00734fa9f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.576924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca7814-1d80-4418-806c-d1c00734fa9f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.582170 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e4636-3b3b-4223-8e48-d22eacf119fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.583311 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e4636-3b3b-4223-8e48-d22eacf119fc admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.583794 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e4636-3b3b-4223-8e48-d22eacf119fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.584273 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e4636-3b3b-4223-8e48-d22eacf119fc admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.593056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e4636-3b3b-4223-8e48-d22eacf119fc admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:41.595661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e4636-3b3b-4223-8e48-d22eacf119fc admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:41.616216 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-d39e4636-3b3b-4223-8e48-d22eacf119fc admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 02:51:41.618231 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 376/745] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Dec 15 02:51:41 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:41.624701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ac96-0c05-4cb7-b133-d717693f2fd9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.635737 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ac96-0c05-4cb7-b133-d717693f2fd9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.640971 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716c740-ab4d-4fb2-8b62-eebe6f4e1809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.642083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716c740-ab4d-4fb2-8b62-eebe6f4e1809 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.642663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716c740-ab4d-4fb2-8b62-eebe6f4e1809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.643148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716c740-ab4d-4fb2-8b62-eebe6f4e1809 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.644255 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716c740-ab4d-4fb2-8b62-eebe6f4e1809 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:41.644794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716c740-ab4d-4fb2-8b62-eebe6f4e1809 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:41.647051 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716c740-ab4d-4fb2-8b62-eebe6f4e1809 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:41.671470 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 370/746] 10.222.0.18 () {56 vars in 1154 bytes} [Wed Dec 15 02:51:41 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:41.677778 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e4636-3b3b-4223-8e48-d22eacf119fc admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.688932 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e4636-3b3b-4223-8e48-d22eacf119fc admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.694102 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3358a-419e-42bf-8b3a-150158e4a844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.695395 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3358a-419e-42bf-8b3a-150158e4a844 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.695894 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3358a-419e-42bf-8b3a-150158e4a844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.696428 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3358a-419e-42bf-8b3a-150158e4a844 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.708570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3358a-419e-42bf-8b3a-150158e4a844 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:41.710890 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3358a-419e-42bf-8b3a-150158e4a844 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:41.730345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-82e3358a-419e-42bf-8b3a-150158e4a844 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:41.732942 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 377/747] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:41.738886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716c740-ab4d-4fb2-8b62-eebe6f4e1809 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.751613 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716c740-ab4d-4fb2-8b62-eebe6f4e1809 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.757201 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5f1fa-4eac-4ff9-9daf-04a8167e0e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.757877 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5f1fa-4eac-4ff9-9daf-04a8167e0e1d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.758195 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5f1fa-4eac-4ff9-9daf-04a8167e0e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.758482 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5f1fa-4eac-4ff9-9daf-04a8167e0e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.759538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5f1fa-4eac-4ff9-9daf-04a8167e0e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:41.759844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5f1fa-4eac-4ff9-9daf-04a8167e0e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:41.761448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5f1fa-4eac-4ff9-9daf-04a8167e0e1d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:41.774946 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 371/748] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:41.781855 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3358a-419e-42bf-8b3a-150158e4a844 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.793889 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3358a-419e-42bf-8b3a-150158e4a844 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.799639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2dd4f-887c-425b-9fcc-4b9db74946ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.800644 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2dd4f-887c-425b-9fcc-4b9db74946ee admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.801076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2dd4f-887c-425b-9fcc-4b9db74946ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.801448 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2dd4f-887c-425b-9fcc-4b9db74946ee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.809619 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2dd4f-887c-425b-9fcc-4b9db74946ee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:41.811845 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2dd4f-887c-425b-9fcc-4b9db74946ee admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:41.825789 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-5ec2dd4f-887c-425b-9fcc-4b9db74946ee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:41.827504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 378/749] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:41.833673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5f1fa-4eac-4ff9-9daf-04a8167e0e1d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.846886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5f1fa-4eac-4ff9-9daf-04a8167e0e1d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.851553 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a1664-00f9-441c-abfa-13fcd2c8143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.852376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a1664-00f9-441c-abfa-13fcd2c8143f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.852798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a1664-00f9-441c-abfa-13fcd2c8143f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.853215 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a1664-00f9-441c-abfa-13fcd2c8143f admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.854182 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a1664-00f9-441c-abfa-13fcd2c8143f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:41.854759 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a1664-00f9-441c-abfa-13fcd2c8143f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:41.856751 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a1664-00f9-441c-abfa-13fcd2c8143f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:41.875875 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 372/750] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:41.877450 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2dd4f-887c-425b-9fcc-4b9db74946ee admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:41.892524 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2dd4f-887c-425b-9fcc-4b9db74946ee admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:41.897346 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f5195-4605-4e5a-9f29-d9fc5b144244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:41.898531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f5195-4605-4e5a-9f29-d9fc5b144244 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:41.898957 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f5195-4605-4e5a-9f29-d9fc5b144244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:41.899440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f5195-4605-4e5a-9f29-d9fc5b144244 admin admin] PATH_INFO: `/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/fcd50adcd390465ea6fc8582e1524909/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:41.901736 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f5195-4605-4e5a-9f29-d9fc5b144244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user_id=fcd50adcd390465ea6fc8582e1524909, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:41.905172 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f5195-4605-4e5a-9f29-d9fc5b144244 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:41.928687 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 379/751] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:51:41 2021] PUT /identity/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/fcd50adcd390465ea6fc8582e1524909/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:51:42.490577 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f8761-e560-4fe9-bfc0-e5530a66617d None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:42.491075 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f8761-e560-4fe9-bfc0-e5530a66617d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:42.491075 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f8761-e560-4fe9-bfc0-e5530a66617d None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:42.493086 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 373/752] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:42.499276 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb795ee-1dfa-4050-9982-8428a2f4f7e4 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:42.499725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb795ee-1dfa-4050-9982-8428a2f4f7e4 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:42.499910 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb795ee-1dfa-4050-9982-8428a2f4f7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:42.526976 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-1cb795ee-1dfa-4050-9982-8428a2f4f7e4 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:42.528163 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-1cb795ee-1dfa-4050-9982-8428a2f4f7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:42.600712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 380/753] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:42 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:42.633629 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f8761-e560-4fe9-bfc0-e5530a66617d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:42.656120 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f8761-e560-4fe9-bfc0-e5530a66617d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:42.663962 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6ce81-2e90-4791-9cf0-a80622fea4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:42.664749 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6ce81-2e90-4791-9cf0-a80622fea4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:42.665027 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6ce81-2e90-4791-9cf0-a80622fea4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:42.665304 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6ce81-2e90-4791-9cf0-a80622fea4e2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:42.682713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6ce81-2e90-4791-9cf0-a80622fea4e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:42.689877 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-06f6ce81-2e90-4791-9cf0-a80622fea4e2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:51:42.691522 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 374/754] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:51:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:42.697616 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb795ee-1dfa-4050-9982-8428a2f4f7e4 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:42.712715 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb795ee-1dfa-4050-9982-8428a2f4f7e4 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:42.722110 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954212a9-e03a-49e2-b9eb-c61fb863dc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:42.722838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954212a9-e03a-49e2-b9eb-c61fb863dc9c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:42.723120 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954212a9-e03a-49e2-b9eb-c61fb863dc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:42.723396 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954212a9-e03a-49e2-b9eb-c61fb863dc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:42.724150 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954212a9-e03a-49e2-b9eb-c61fb863dc9c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:42.724456 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954212a9-e03a-49e2-b9eb-c61fb863dc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:42.726048 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954212a9-e03a-49e2-b9eb-c61fb863dc9c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:42.740292 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 381/755] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:42.746579 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6ce81-2e90-4791-9cf0-a80622fea4e2 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:42.759510 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6ce81-2e90-4791-9cf0-a80622fea4e2 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:42.764241 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb084c-9480-4730-893f-3226cd7e17ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:42.765074 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb084c-9480-4730-893f-3226cd7e17ce admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:42.765354 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb084c-9480-4730-893f-3226cd7e17ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:42.765628 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb084c-9480-4730-893f-3226cd7e17ce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:42.776889 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb084c-9480-4730-893f-3226cd7e17ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:42.778807 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb084c-9480-4730-893f-3226cd7e17ce admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:42.796390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-d9cb084c-9480-4730-893f-3226cd7e17ce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:42.797902 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 375/756] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:42.803634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954212a9-e03a-49e2-b9eb-c61fb863dc9c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:42.818787 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954212a9-e03a-49e2-b9eb-c61fb863dc9c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:42.825881 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64712fdc-f6ee-43be-93ae-77b7b5b85a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:42.827333 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64712fdc-f6ee-43be-93ae-77b7b5b85a41 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:42.827829 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64712fdc-f6ee-43be-93ae-77b7b5b85a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:42.828320 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64712fdc-f6ee-43be-93ae-77b7b5b85a41 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:42.829245 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64712fdc-f6ee-43be-93ae-77b7b5b85a41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:42.829754 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64712fdc-f6ee-43be-93ae-77b7b5b85a41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:42.831563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64712fdc-f6ee-43be-93ae-77b7b5b85a41 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:42.853726 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 382/757] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:42.860011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb084c-9480-4730-893f-3226cd7e17ce admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:42.873282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb084c-9480-4730-893f-3226cd7e17ce admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:42.881577 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cce91-72b9-412c-a0bf-3cb531855efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:42.882397 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cce91-72b9-412c-a0bf-3cb531855efb admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:42.882669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cce91-72b9-412c-a0bf-3cb531855efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:42.882945 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cce91-72b9-412c-a0bf-3cb531855efb admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:42.893052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cce91-72b9-412c-a0bf-3cb531855efb admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:42.895091 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cce91-72b9-412c-a0bf-3cb531855efb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:42.917482 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-c44cce91-72b9-412c-a0bf-3cb531855efb admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 02:51:42.927083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 376/758] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:51:42 2021] GET /identity/v3/users/swift => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:42.932792 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64712fdc-f6ee-43be-93ae-77b7b5b85a41 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:42.946970 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64712fdc-f6ee-43be-93ae-77b7b5b85a41 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:42.958233 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4f90a-94d8-4ff5-a4c6-54c5d08818ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:42.959247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4f90a-94d8-4ff5-a4c6-54c5d08818ab admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:42.959747 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4f90a-94d8-4ff5-a4c6-54c5d08818ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:42.960216 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4f90a-94d8-4ff5-a4c6-54c5d08818ab admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:42.961260 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4f90a-94d8-4ff5-a4c6-54c5d08818ab admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:42.961762 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4f90a-94d8-4ff5-a4c6-54c5d08818ab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:42.963827 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4f90a-94d8-4ff5-a4c6-54c5d08818ab admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:42.993348 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 383/759] 10.222.0.18 () {56 vars in 1156 bytes} [Wed Dec 15 02:51:42 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:42.999681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cce91-72b9-412c-a0bf-3cb531855efb admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:43.016006 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cce91-72b9-412c-a0bf-3cb531855efb admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:43.023973 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a685b7-b2d3-4d4b-86a0-dcb89f197b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:43.024615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a685b7-b2d3-4d4b-86a0-dcb89f197b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:43.024898 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a685b7-b2d3-4d4b-86a0-dcb89f197b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:43.025173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a685b7-b2d3-4d4b-86a0-dcb89f197b50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:43.038153 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a685b7-b2d3-4d4b-86a0-dcb89f197b50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:43.039910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a685b7-b2d3-4d4b-86a0-dcb89f197b50 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:43.055002 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 377/760] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:42 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:51:43.061407 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4f90a-94d8-4ff5-a4c6-54c5d08818ab admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:43.075275 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4f90a-94d8-4ff5-a4c6-54c5d08818ab admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:43.080687 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc7a14-1065-4c42-9ea5-68d15ddbc88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:43.081712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc7a14-1065-4c42-9ea5-68d15ddbc88c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:43.082239 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc7a14-1065-4c42-9ea5-68d15ddbc88c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:43.082710 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc7a14-1065-4c42-9ea5-68d15ddbc88c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:43.093922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc7a14-1065-4c42-9ea5-68d15ddbc88c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:43.096052 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc7a14-1065-4c42-9ea5-68d15ddbc88c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:43.112853 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-f3fc7a14-1065-4c42-9ea5-68d15ddbc88c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:43.114599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 384/761] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:43.122803 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a685b7-b2d3-4d4b-86a0-dcb89f197b50 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:43.131872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a685b7-b2d3-4d4b-86a0-dcb89f197b50 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:43.147196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db06b3-8130-4cf8-b2b5-fb98717a1f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:43.147860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db06b3-8130-4cf8-b2b5-fb98717a1f34 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:43.148141 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db06b3-8130-4cf8-b2b5-fb98717a1f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:43.148416 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db06b3-8130-4cf8-b2b5-fb98717a1f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:43.149150 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db06b3-8130-4cf8-b2b5-fb98717a1f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:43.149454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db06b3-8130-4cf8-b2b5-fb98717a1f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:43.151088 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db06b3-8130-4cf8-b2b5-fb98717a1f34 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:43.169780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 378/762] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:43.175606 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc7a14-1065-4c42-9ea5-68d15ddbc88c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:43.191031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc7a14-1065-4c42-9ea5-68d15ddbc88c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:43.195979 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb185c7-3a07-4e40-8100-7699405eb4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:43.197105 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb185c7-3a07-4e40-8100-7699405eb4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:43.197680 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb185c7-3a07-4e40-8100-7699405eb4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:43.198242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb185c7-3a07-4e40-8100-7699405eb4e1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:43.217026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb185c7-3a07-4e40-8100-7699405eb4e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:43.219330 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb185c7-3a07-4e40-8100-7699405eb4e1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:43.232453 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-4fb185c7-3a07-4e40-8100-7699405eb4e1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:43.238320 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 385/763] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:43.240612 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db06b3-8130-4cf8-b2b5-fb98717a1f34 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:43.256148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db06b3-8130-4cf8-b2b5-fb98717a1f34 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:43.276044 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e22937-58d2-4a1a-996e-efa532ab9576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:43.276707 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e22937-58d2-4a1a-996e-efa532ab9576 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:43.276988 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e22937-58d2-4a1a-996e-efa532ab9576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:43.277262 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e22937-58d2-4a1a-996e-efa532ab9576 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:43.278094 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e22937-58d2-4a1a-996e-efa532ab9576 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:43.278402 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e22937-58d2-4a1a-996e-efa532ab9576 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:43.280296 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e22937-58d2-4a1a-996e-efa532ab9576 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:43.299445 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 379/764] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:43.306071 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb185c7-3a07-4e40-8100-7699405eb4e1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:43.322947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb185c7-3a07-4e40-8100-7699405eb4e1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:43.330242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb87c55-38c2-4966-adb7-5c3d70a386d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:43.331230 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb87c55-38c2-4966-adb7-5c3d70a386d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:43.331726 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb87c55-38c2-4966-adb7-5c3d70a386d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:43.332247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb87c55-38c2-4966-adb7-5c3d70a386d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:43.333275 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb87c55-38c2-4966-adb7-5c3d70a386d9 admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=beb0af7ac70d48989852c022c9f83848) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:43.333818 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb87c55-38c2-4966-adb7-5c3d70a386d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:43.335932 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb87c55-38c2-4966-adb7-5c3d70a386d9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:43.346166 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 386/765] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:43 2021] GET /identity/v3/role_assignments?user.id=beb0af7ac70d48989852c022c9f83848&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:44.102939 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a0d47-7954-4525-859c-ec4a59e65e63 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.103483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a0d47-7954-4525-859c-ec4a59e65e63 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.103483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a0d47-7954-4525-859c-ec4a59e65e63 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.105546 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 380/766] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:44.111836 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39d852-f047-4bc5-975f-8ca27a80163e None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.112250 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39d852-f047-4bc5-975f-8ca27a80163e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.112420 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39d852-f047-4bc5-975f-8ca27a80163e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.138325 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-ad39d852-f047-4bc5-975f-8ca27a80163e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:44.139577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-ad39d852-f047-4bc5-975f-8ca27a80163e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:44.153039 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 387/767] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:44 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:44.188825 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a0d47-7954-4525-859c-ec4a59e65e63 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.207656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a0d47-7954-4525-859c-ec4a59e65e63 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.214092 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7a6ed-28c3-4852-806a-bb31fdac6086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.214894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7a6ed-28c3-4852-806a-bb31fdac6086 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.215180 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7a6ed-28c3-4852-806a-bb31fdac6086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.215459 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7a6ed-28c3-4852-806a-bb31fdac6086 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.230929 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7a6ed-28c3-4852-806a-bb31fdac6086 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:44.238375 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-18b7a6ed-28c3-4852-806a-bb31fdac6086 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:44.239856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 381/768] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:44.245748 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39d852-f047-4bc5-975f-8ca27a80163e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.258872 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39d852-f047-4bc5-975f-8ca27a80163e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.271512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ad9be-be85-456f-8ce3-ff7524064d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.272180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad9be-be85-456f-8ce3-ff7524064d42 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.272465 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad9be-be85-456f-8ce3-ff7524064d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.272742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad9be-be85-456f-8ce3-ff7524064d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.273505 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ad9be-be85-456f-8ce3-ff7524064d42 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:44.273812 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ad9be-be85-456f-8ce3-ff7524064d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.275427 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ad9be-be85-456f-8ce3-ff7524064d42 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.289452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 388/769] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:44.295923 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7a6ed-28c3-4852-806a-bb31fdac6086 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.311510 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7a6ed-28c3-4852-806a-bb31fdac6086 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.322266 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29747e82-a8a4-4ed1-9fbe-f3d966020279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.323044 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29747e82-a8a4-4ed1-9fbe-f3d966020279 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.323320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29747e82-a8a4-4ed1-9fbe-f3d966020279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.323583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29747e82-a8a4-4ed1-9fbe-f3d966020279 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.342370 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29747e82-a8a4-4ed1-9fbe-f3d966020279 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.344217 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29747e82-a8a4-4ed1-9fbe-f3d966020279 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.367656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba49b6-56d8-4e8f-97e7-2fc799ac9b51 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.367945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba49b6-56d8-4e8f-97e7-2fc799ac9b51 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.368136 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba49b6-56d8-4e8f-97e7-2fc799ac9b51 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.370473 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-29747e82-a8a4-4ed1-9fbe-f3d966020279 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:44.372028 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 382/771] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:44.372867 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 389/771] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:51:44.375571 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfa0e0-2c0d-4ec6-a2e5-8822ab4e09dc None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.375858 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfa0e0-2c0d-4ec6-a2e5-8822ab4e09dc None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.376135 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfa0e0-2c0d-4ec6-a2e5-8822ab4e09dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.377411 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba49b6-56d8-4e8f-97e7-2fc799ac9b51 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.396827 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c5dfa0e0-2c0d-4ec6-a2e5-8822ab4e09dc None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:44.398074 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c5dfa0e0-2c0d-4ec6-a2e5-8822ab4e09dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:44.406902 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 383/772] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:44 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:44.415192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba49b6-56d8-4e8f-97e7-2fc799ac9b51 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.431512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7d0aa-4996-4cd2-9a18-d4248a748966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.432173 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7d0aa-4996-4cd2-9a18-d4248a748966 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.432452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7d0aa-4996-4cd2-9a18-d4248a748966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.432722 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7d0aa-4996-4cd2-9a18-d4248a748966 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.433459 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7d0aa-4996-4cd2-9a18-d4248a748966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:44.433752 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7d0aa-4996-4cd2-9a18-d4248a748966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.435408 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7d0aa-4996-4cd2-9a18-d4248a748966 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.440051 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfa0e0-2c0d-4ec6-a2e5-8822ab4e09dc None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.453781 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfa0e0-2c0d-4ec6-a2e5-8822ab4e09dc None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.454471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 390/773] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:44.457095 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7d0aa-4996-4cd2-9a18-d4248a748966 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.467228 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1292e-b530-4ff2-b8ca-b790f5c5345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.468044 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1292e-b530-4ff2-b8ca-b790f5c5345a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.468220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7d0aa-4996-4cd2-9a18-d4248a748966 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.468316 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1292e-b530-4ff2-b8ca-b790f5c5345a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.468591 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1292e-b530-4ff2-b8ca-b790f5c5345a admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.469265 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1292e-b530-4ff2-b8ca-b790f5c5345a admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.470905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1292e-b530-4ff2-b8ca-b790f5c5345a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.472771 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c88e4-55bb-4349-af6f-85698f46cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.473564 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c88e4-55bb-4349-af6f-85698f46cec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.473846 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c88e4-55bb-4349-af6f-85698f46cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.474147 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c88e4-55bb-4349-af6f-85698f46cec0 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.481571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c88e4-55bb-4349-af6f-85698f46cec0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.482659 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-71c1292e-b530-4ff2-b8ca-b790f5c5345a admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 02:51:44.483957 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c88e4-55bb-4349-af6f-85698f46cec0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.484192 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 384/774] 10.222.0.18 () {56 vars in 1150 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:44.485391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676aa9a-d735-4d4a-b980-d1ead7639906 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.485676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676aa9a-d735-4d4a-b980-d1ead7639906 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.485963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676aa9a-d735-4d4a-b980-d1ead7639906 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.487760 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 385/775] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:44.493910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676aa9a-d735-4d4a-b980-d1ead7639906 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.504716 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-697c88e4-55bb-4349-af6f-85698f46cec0 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 02:51:44.506197 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676aa9a-d735-4d4a-b980-d1ead7639906 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.506968 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 391/776] 10.222.0.18 () {56 vars in 1138 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:44.508460 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d8729-f81a-471f-b481-9e95e05dde30 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.508910 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d8729-f81a-471f-b481-9e95e05dde30 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.509637 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d8729-f81a-471f-b481-9e95e05dde30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.516584 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be06575-c8e6-48f7-99f7-7c0eb1f6b4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.517306 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be06575-c8e6-48f7-99f7-7c0eb1f6b4ab admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.517655 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be06575-c8e6-48f7-99f7-7c0eb1f6b4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.518032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be06575-c8e6-48f7-99f7-7c0eb1f6b4ab admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.518834 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be06575-c8e6-48f7-99f7-7c0eb1f6b4ab admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:44.519228 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be06575-c8e6-48f7-99f7-7c0eb1f6b4ab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.520893 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be06575-c8e6-48f7-99f7-7c0eb1f6b4ab admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.525905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 386/777] 10.222.0.18 () {56 vars in 1145 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:44.526640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be06575-c8e6-48f7-99f7-7c0eb1f6b4ab admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.532187 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-113d8729-f81a-471f-b481-9e95e05dde30 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:44.533635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-113d8729-f81a-471f-b481-9e95e05dde30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:44.536962 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be06575-c8e6-48f7-99f7-7c0eb1f6b4ab admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.541534 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8f824-97c6-4495-9ee5-0daf5db4721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.542309 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8f824-97c6-4495-9ee5-0daf5db4721d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.542663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8f824-97c6-4495-9ee5-0daf5db4721d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.543014 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8f824-97c6-4495-9ee5-0daf5db4721d admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.543968 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8f824-97c6-4495-9ee5-0daf5db4721d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:44.544156 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 392/778] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:44 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:44.544313 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8f824-97c6-4495-9ee5-0daf5db4721d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.550059 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8f824-97c6-4495-9ee5-0daf5db4721d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.551194 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d8729-f81a-471f-b481-9e95e05dde30 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.564608 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 387/779] 10.222.0.18 () {56 vars in 1170 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:44.570566 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8f824-97c6-4495-9ee5-0daf5db4721d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.571464 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d8729-f81a-471f-b481-9e95e05dde30 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.581057 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8f824-97c6-4495-9ee5-0daf5db4721d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.585429 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c7ecf-6b8a-43c4-b698-58465bf57989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.586240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c7ecf-6b8a-43c4-b698-58465bf57989 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.586527 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c7ecf-6b8a-43c4-b698-58465bf57989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.586801 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c7ecf-6b8a-43c4-b698-58465bf57989 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.588086 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b37b3-b247-4721-9bdd-d9040213b061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.589214 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b37b3-b247-4721-9bdd-d9040213b061 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.590023 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b37b3-b247-4721-9bdd-d9040213b061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.590477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b37b3-b247-4721-9bdd-d9040213b061 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.591395 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b37b3-b247-4721-9bdd-d9040213b061 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:44.592435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b37b3-b247-4721-9bdd-d9040213b061 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.594247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b37b3-b247-4721-9bdd-d9040213b061 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.598588 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c7ecf-6b8a-43c4-b698-58465bf57989 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.600613 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c7ecf-6b8a-43c4-b698-58465bf57989 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.602598 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 393/780] 10.222.0.18 () {56 vars in 1145 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:44.603642 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b37b3-b247-4721-9bdd-d9040213b061 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.613862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b37b3-b247-4721-9bdd-d9040213b061 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.619248 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad6b3b-25f6-4280-bb1a-55f4115292e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.620241 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad6b3b-25f6-4280-bb1a-55f4115292e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.620719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad6b3b-25f6-4280-bb1a-55f4115292e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.621206 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad6b3b-25f6-4280-bb1a-55f4115292e7 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.622071 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad6b3b-25f6-4280-bb1a-55f4115292e7 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.623607 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-659c7ecf-6b8a-43c4-b698-58465bf57989 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:44.624053 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad6b3b-25f6-4280-bb1a-55f4115292e7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.625132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 388/781] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:44.630959 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c7ecf-6b8a-43c4-b698-58465bf57989 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.636834 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-e4ad6b3b-25f6-4280-bb1a-55f4115292e7 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 02:51:44.644678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 394/782] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/services/network => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:44.644798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c7ecf-6b8a-43c4-b698-58465bf57989 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.646390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad6b3b-25f6-4280-bb1a-55f4115292e7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.649060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e67ae-4918-4c06-8c16-80a3cafd5180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.649705 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e67ae-4918-4c06-8c16-80a3cafd5180 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.650041 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e67ae-4918-4c06-8c16-80a3cafd5180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.650336 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e67ae-4918-4c06-8c16-80a3cafd5180 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.651149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e67ae-4918-4c06-8c16-80a3cafd5180 admin admin] RBAC: Adding query filter params (interface=public, service_id=7453ebbccd1447c0b15b596c6453e0fe, region_id=RegionOne) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:44.651564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e67ae-4918-4c06-8c16-80a3cafd5180 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.652592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-b43e67ae-4918-4c06-8c16-80a3cafd5180 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:44.652592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:51:44.652592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:51:44.653519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e67ae-4918-4c06-8c16-80a3cafd5180 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.659596 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad6b3b-25f6-4280-bb1a-55f4115292e7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.662177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 389/783] 10.222.0.18 () {56 vars in 1272 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/endpoints?service_id=7453ebbccd1447c0b15b596c6453e0fe&interface=public®ion_id=RegionOne => generated 194 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:44.664907 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d95e3c-f028-43e3-a91d-31cdc638c0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.665794 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d95e3c-f028-43e3-a91d-31cdc638c0fd admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.666300 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d95e3c-f028-43e3-a91d-31cdc638c0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.666769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d95e3c-f028-43e3-a91d-31cdc638c0fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.667652 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e67ae-4918-4c06-8c16-80a3cafd5180 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.668002 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d95e3c-f028-43e3-a91d-31cdc638c0fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:44.668671 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d95e3c-f028-43e3-a91d-31cdc638c0fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.670533 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d95e3c-f028-43e3-a91d-31cdc638c0fd admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.677513 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e67ae-4918-4c06-8c16-80a3cafd5180 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.682005 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621836c0-355b-4fcb-91bd-7eb060afcfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.682664 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621836c0-355b-4fcb-91bd-7eb060afcfdd admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.682949 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621836c0-355b-4fcb-91bd-7eb060afcfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.683224 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621836c0-355b-4fcb-91bd-7eb060afcfdd admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.683956 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621836c0-355b-4fcb-91bd-7eb060afcfdd admin admin] RBAC: Adding query filter params (name=network) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:44.684237 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621836c0-355b-4fcb-91bd-7eb060afcfdd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.686401 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621836c0-355b-4fcb-91bd-7eb060afcfdd admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.687080 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 395/784] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:44.688347 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d95e3c-f028-43e3-a91d-31cdc638c0fd admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.696348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 390/785] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/services?name=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:44.702065 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621836c0-355b-4fcb-91bd-7eb060afcfdd admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.702182 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d95e3c-f028-43e3-a91d-31cdc638c0fd admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.710764 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67574671-dc6e-4035-8600-575629b2e967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.711692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67574671-dc6e-4035-8600-575629b2e967 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.712070 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621836c0-355b-4fcb-91bd-7eb060afcfdd admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.712416 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67574671-dc6e-4035-8600-575629b2e967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.712980 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67574671-dc6e-4035-8600-575629b2e967 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.714150 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67574671-dc6e-4035-8600-575629b2e967 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.716438 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67574671-dc6e-4035-8600-575629b2e967 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.716980 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd37eb-85f6-4c57-9993-87f8caa0d739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.717855 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd37eb-85f6-4c57-9993-87f8caa0d739 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.718183 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd37eb-85f6-4c57-9993-87f8caa0d739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.718447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd37eb-85f6-4c57-9993-87f8caa0d739 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.723720 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 396/786] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/services => generated 772 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:44.724819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67574671-dc6e-4035-8600-575629b2e967 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.735895 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67574671-dc6e-4035-8600-575629b2e967 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.741091 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad696e-db71-4f5b-a5a6-c51e363af5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.742200 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad696e-db71-4f5b-a5a6-c51e363af5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.742735 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad696e-db71-4f5b-a5a6-c51e363af5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.742978 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd37eb-85f6-4c57-9993-87f8caa0d739 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.743477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad696e-db71-4f5b-a5a6-c51e363af5c4 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.744401 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad696e-db71-4f5b-a5a6-c51e363af5c4 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:44.744936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad696e-db71-4f5b-a5a6-c51e363af5c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.745054 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd37eb-85f6-4c57-9993-87f8caa0d739 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.747200 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad696e-db71-4f5b-a5a6-c51e363af5c4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.754657 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 397/787] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/services?type=network => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:44.761715 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad696e-db71-4f5b-a5a6-c51e363af5c4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.773156 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad696e-db71-4f5b-a5a6-c51e363af5c4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.773483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-c6bd37eb-85f6-4c57-9993-87f8caa0d739 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:44.774727 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 391/788] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:44.779031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2396c81-85a5-455d-b3a1-bb1d2cf181b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.780604 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2396c81-85a5-455d-b3a1-bb1d2cf181b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.781130 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd37eb-85f6-4c57-9993-87f8caa0d739 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.781369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2396c81-85a5-455d-b3a1-bb1d2cf181b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.782054 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2396c81-85a5-455d-b3a1-bb1d2cf181b0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.783291 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2396c81-85a5-455d-b3a1-bb1d2cf181b0 admin admin] RBAC: Adding query filter params (interface=public, service_id=687abfeaa4394142b61ab0ddc5b83555, region_id=RegionOne) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:44.783914 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2396c81-85a5-455d-b3a1-bb1d2cf181b0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.785287 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-b2396c81-85a5-455d-b3a1-bb1d2cf181b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:44.785287 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:51:44.785287 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:51:44.786913 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2396c81-85a5-455d-b3a1-bb1d2cf181b0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.797034 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 398/789] 10.222.0.18 () {56 vars in 1272 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/endpoints?service_id=687abfeaa4394142b61ab0ddc5b83555&interface=public®ion_id=RegionOne => generated 194 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:44.804381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2396c81-85a5-455d-b3a1-bb1d2cf181b0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.810252 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd37eb-85f6-4c57-9993-87f8caa0d739 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.816154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2396c81-85a5-455d-b3a1-bb1d2cf181b0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.821351 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9553c0-dfa2-4f99-8077-6be8062eb97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.822545 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9553c0-dfa2-4f99-8077-6be8062eb97d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.823149 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9553c0-dfa2-4f99-8077-6be8062eb97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.823624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9553c0-dfa2-4f99-8077-6be8062eb97d admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.824610 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9553c0-dfa2-4f99-8077-6be8062eb97d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.827343 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9553c0-dfa2-4f99-8077-6be8062eb97d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.833951 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 399/790] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/services => generated 772 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:44.838101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae585c-89df-4e13-b357-e9df1b7fbdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.838101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae585c-89df-4e13-b357-e9df1b7fbdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.838101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae585c-89df-4e13-b357-e9df1b7fbdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.838101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae585c-89df-4e13-b357-e9df1b7fbdc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.838453 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae585c-89df-4e13-b357-e9df1b7fbdc9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:44.838453 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae585c-89df-4e13-b357-e9df1b7fbdc9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.839091 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae585c-89df-4e13-b357-e9df1b7fbdc9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.863897 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 392/791] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:44.870363 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9553c0-dfa2-4f99-8077-6be8062eb97d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:44.888062 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9553c0-dfa2-4f99-8077-6be8062eb97d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:44.893833 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490057ed-8f0e-430e-9988-fdf2b5b77f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:44.895157 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490057ed-8f0e-430e-9988-fdf2b5b77f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:44.895642 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490057ed-8f0e-430e-9988-fdf2b5b77f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:44.896192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490057ed-8f0e-430e-9988-fdf2b5b77f51 admin admin] PATH_INFO: `/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/39cddc4e2ea943cd882b6a1addd98e8c/roles/4f557aac969f4c2f95aee8e21d67c802` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:44.921021 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490057ed-8f0e-430e-9988-fdf2b5b77f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user_id=39cddc4e2ea943cd882b6a1addd98e8c, role_id=4f557aac969f4c2f95aee8e21d67c802)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:44.924218 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490057ed-8f0e-430e-9988-fdf2b5b77f51 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:44.954278 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 400/792] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:51:44 2021] PUT /identity/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/39cddc4e2ea943cd882b6a1addd98e8c/roles/4f557aac969f4c2f95aee8e21d67c802 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:51:45.214985 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff8975-1dd2-4100-9377-0862dc99f38a None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:45.215542 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff8975-1dd2-4100-9377-0862dc99f38a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:45.215542 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff8975-1dd2-4100-9377-0862dc99f38a None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:45.218070 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 393/793] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:45.224840 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851286ba-54e5-4657-9a7f-faf4cfae3692 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:45.224840 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851286ba-54e5-4657-9a7f-faf4cfae3692 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:45.224840 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851286ba-54e5-4657-9a7f-faf4cfae3692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:45.247719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-851286ba-54e5-4657-9a7f-faf4cfae3692 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:45.249176 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-851286ba-54e5-4657-9a7f-faf4cfae3692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:45.320255 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 401/794] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:45 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:51:45.347653 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff8975-1dd2-4100-9377-0862dc99f38a None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:45.363843 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff8975-1dd2-4100-9377-0862dc99f38a None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:45.368331 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d83b7c-9969-4df2-b429-57ff7f78c817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:45.369106 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d83b7c-9969-4df2-b429-57ff7f78c817 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:45.369385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d83b7c-9969-4df2-b429-57ff7f78c817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:45.369665 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d83b7c-9969-4df2-b429-57ff7f78c817 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:45.384577 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d83b7c-9969-4df2-b429-57ff7f78c817 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:45.391988 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-34d83b7c-9969-4df2-b429-57ff7f78c817 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:51:45.393277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 394/795] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:51:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:45.400871 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851286ba-54e5-4657-9a7f-faf4cfae3692 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:45.410730 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851286ba-54e5-4657-9a7f-faf4cfae3692 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:45.418057 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e7587-623d-45d0-9e12-af9eb362b078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:45.418718 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e7587-623d-45d0-9e12-af9eb362b078 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:45.419001 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e7587-623d-45d0-9e12-af9eb362b078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:45.419279 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e7587-623d-45d0-9e12-af9eb362b078 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:45.420090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e7587-623d-45d0-9e12-af9eb362b078 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:45.420398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e7587-623d-45d0-9e12-af9eb362b078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:45.422014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e7587-623d-45d0-9e12-af9eb362b078 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:45.430922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 402/796] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:45.437417 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d83b7c-9969-4df2-b429-57ff7f78c817 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:45.451596 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d83b7c-9969-4df2-b429-57ff7f78c817 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:45.460002 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b4ba8-7e72-45b0-9e74-255793287026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:45.460730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b4ba8-7e72-45b0-9e74-255793287026 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:45.461014 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b4ba8-7e72-45b0-9e74-255793287026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:45.461288 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b4ba8-7e72-45b0-9e74-255793287026 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:45.473617 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b4ba8-7e72-45b0-9e74-255793287026 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:45.475638 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b4ba8-7e72-45b0-9e74-255793287026 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:45.504438 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-3c8b4ba8-7e72-45b0-9e74-255793287026 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:45.506128 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 395/797] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:45.512563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e7587-623d-45d0-9e12-af9eb362b078 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:45.523452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e7587-623d-45d0-9e12-af9eb362b078 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:45.540000 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52aded-5f8a-4a8c-8016-3a24603ba43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:45.540664 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52aded-5f8a-4a8c-8016-3a24603ba43b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:45.540944 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52aded-5f8a-4a8c-8016-3a24603ba43b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:45.541225 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52aded-5f8a-4a8c-8016-3a24603ba43b admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:45.541963 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52aded-5f8a-4a8c-8016-3a24603ba43b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:45.542293 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52aded-5f8a-4a8c-8016-3a24603ba43b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:45.543880 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52aded-5f8a-4a8c-8016-3a24603ba43b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:45.564369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 403/798] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:45.570385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b4ba8-7e72-45b0-9e74-255793287026 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:45.582841 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b4ba8-7e72-45b0-9e74-255793287026 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:45.594584 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851b341-e541-4f4e-9862-ccd5cc8a93f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:45.595524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851b341-e541-4f4e-9862-ccd5cc8a93f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:45.595941 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851b341-e541-4f4e-9862-ccd5cc8a93f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:45.596370 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851b341-e541-4f4e-9862-ccd5cc8a93f1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:45.607031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851b341-e541-4f4e-9862-ccd5cc8a93f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:45.609205 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851b341-e541-4f4e-9862-ccd5cc8a93f1 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:45.634658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-4851b341-e541-4f4e-9862-ccd5cc8a93f1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 02:51:45.636543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 396/799] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Dec 15 02:51:45 2021] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:45.643481 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52aded-5f8a-4a8c-8016-3a24603ba43b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:45.660226 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52aded-5f8a-4a8c-8016-3a24603ba43b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:45.674612 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c4aab-082f-44fb-b133-d9de97c2f82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:45.675295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c4aab-082f-44fb-b133-d9de97c2f82e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:45.675580 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c4aab-082f-44fb-b133-d9de97c2f82e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:45.675856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c4aab-082f-44fb-b133-d9de97c2f82e admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:45.676715 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c4aab-082f-44fb-b133-d9de97c2f82e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:45.677025 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c4aab-082f-44fb-b133-d9de97c2f82e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:45.678893 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c4aab-082f-44fb-b133-d9de97c2f82e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:45.701888 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 404/800] 10.222.0.18 () {56 vars in 1154 bytes} [Wed Dec 15 02:51:45 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:45.707903 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851b341-e541-4f4e-9862-ccd5cc8a93f1 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:45.722970 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851b341-e541-4f4e-9862-ccd5cc8a93f1 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:45.734595 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440910d-c6de-4fb1-bed0-73ac2d4f79ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:45.735424 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440910d-c6de-4fb1-bed0-73ac2d4f79ce admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:45.735840 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440910d-c6de-4fb1-bed0-73ac2d4f79ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:45.736272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440910d-c6de-4fb1-bed0-73ac2d4f79ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:45.750131 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440910d-c6de-4fb1-bed0-73ac2d4f79ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:45.752049 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440910d-c6de-4fb1-bed0-73ac2d4f79ce admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:45.767858 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 397/801] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:45 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:51:45.773950 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c4aab-082f-44fb-b133-d9de97c2f82e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:45.787030 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c4aab-082f-44fb-b133-d9de97c2f82e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:45.798601 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced9e30-f503-4b81-ba8a-8b291a9ac1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:45.799400 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced9e30-f503-4b81-ba8a-8b291a9ac1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:45.799684 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced9e30-f503-4b81-ba8a-8b291a9ac1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:45.799959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced9e30-f503-4b81-ba8a-8b291a9ac1b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:45.811236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced9e30-f503-4b81-ba8a-8b291a9ac1b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:45.813056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced9e30-f503-4b81-ba8a-8b291a9ac1b0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:45.843709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-5ced9e30-f503-4b81-ba8a-8b291a9ac1b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:45.844942 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 405/802] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:45.851072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440910d-c6de-4fb1-bed0-73ac2d4f79ce admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:45.862797 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440910d-c6de-4fb1-bed0-73ac2d4f79ce admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:45.878596 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f671d-fdf1-4850-a288-b26635c3b146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:45.879432 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f671d-fdf1-4850-a288-b26635c3b146 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:45.879873 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f671d-fdf1-4850-a288-b26635c3b146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:45.880279 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f671d-fdf1-4850-a288-b26635c3b146 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:45.881160 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f671d-fdf1-4850-a288-b26635c3b146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:45.881599 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f671d-fdf1-4850-a288-b26635c3b146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:45.883346 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f671d-fdf1-4850-a288-b26635c3b146 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:45.898700 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 398/803] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:45.904820 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced9e30-f503-4b81-ba8a-8b291a9ac1b0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:45.918791 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced9e30-f503-4b81-ba8a-8b291a9ac1b0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:45.929772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc1dc1-0295-4e21-9772-225cb56e327d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:45.930607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc1dc1-0295-4e21-9772-225cb56e327d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:45.930890 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc1dc1-0295-4e21-9772-225cb56e327d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:45.931162 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc1dc1-0295-4e21-9772-225cb56e327d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:45.941581 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc1dc1-0295-4e21-9772-225cb56e327d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:45.943550 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc1dc1-0295-4e21-9772-225cb56e327d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:45.962913 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-6adc1dc1-0295-4e21-9772-225cb56e327d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:45.964101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 406/804] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:45.970443 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f671d-fdf1-4850-a288-b26635c3b146 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:45.983589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f671d-fdf1-4850-a288-b26635c3b146 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:45.999602 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc3a72-9811-48c0-a8b7-592e1067fdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:46.000525 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc3a72-9811-48c0-a8b7-592e1067fdab admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:46.001004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc3a72-9811-48c0-a8b7-592e1067fdab admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:46.001469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc3a72-9811-48c0-a8b7-592e1067fdab admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:46.002528 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc3a72-9811-48c0-a8b7-592e1067fdab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:46.003039 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc3a72-9811-48c0-a8b7-592e1067fdab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:46.005072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc3a72-9811-48c0-a8b7-592e1067fdab admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:46.022755 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 399/805] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:46.029186 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc1dc1-0295-4e21-9772-225cb56e327d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:46.043726 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc1dc1-0295-4e21-9772-225cb56e327d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:46.054115 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3836c4-8c0c-4855-b331-b68b72cd2c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:46.054768 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3836c4-8c0c-4855-b331-b68b72cd2c2c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:46.055052 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3836c4-8c0c-4855-b331-b68b72cd2c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:46.055329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3836c4-8c0c-4855-b331-b68b72cd2c2c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:46.056180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3836c4-8c0c-4855-b331-b68b72cd2c2c admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=fcd50adcd390465ea6fc8582e1524909) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:46.056491 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3836c4-8c0c-4855-b331-b68b72cd2c2c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:46.058352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3836c4-8c0c-4855-b331-b68b72cd2c2c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:46.067049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 407/806] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:46 2021] GET /identity/v3/role_assignments?user.id=fcd50adcd390465ea6fc8582e1524909&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:46.068657 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c15f8e-96db-4500-b8c1-1797ea66f99d None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:46.068657 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c15f8e-96db-4500-b8c1-1797ea66f99d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:46.068657 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c15f8e-96db-4500-b8c1-1797ea66f99d None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:46.071431 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 400/807] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:51:46.076745 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b5065-3348-4b47-9359-e5f1509e2eb4 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:46.077034 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b5065-3348-4b47-9359-e5f1509e2eb4 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:46.077313 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b5065-3348-4b47-9359-e5f1509e2eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:46.107142 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-ac6b5065-3348-4b47-9359-e5f1509e2eb4 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:46.108882 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-ac6b5065-3348-4b47-9359-e5f1509e2eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:46.121884 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 408/808] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:46 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:46.162289 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c15f8e-96db-4500-b8c1-1797ea66f99d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:46.181431 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c15f8e-96db-4500-b8c1-1797ea66f99d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:46.190769 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d69c3-6b49-4ec2-83e3-4697611e9770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:46.191568 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d69c3-6b49-4ec2-83e3-4697611e9770 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:46.191846 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d69c3-6b49-4ec2-83e3-4697611e9770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:46.192121 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d69c3-6b49-4ec2-83e3-4697611e9770 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:46.213520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d69c3-6b49-4ec2-83e3-4697611e9770 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:46.221083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-b24d69c3-6b49-4ec2-83e3-4697611e9770 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:51:46.222368 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 401/809] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:51:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:46.229350 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b5065-3348-4b47-9359-e5f1509e2eb4 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:46.239606 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b5065-3348-4b47-9359-e5f1509e2eb4 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:46.244184 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e8817-5b50-4150-b93b-8ffc4d5a8263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:46.244862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e8817-5b50-4150-b93b-8ffc4d5a8263 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:46.245144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e8817-5b50-4150-b93b-8ffc4d5a8263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:46.245416 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e8817-5b50-4150-b93b-8ffc4d5a8263 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:46.246283 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e8817-5b50-4150-b93b-8ffc4d5a8263 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:46.246590 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e8817-5b50-4150-b93b-8ffc4d5a8263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:46.248258 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e8817-5b50-4150-b93b-8ffc4d5a8263 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:46.264268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 409/810] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:46.270463 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d69c3-6b49-4ec2-83e3-4697611e9770 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:46.285796 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d69c3-6b49-4ec2-83e3-4697611e9770 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:46.290471 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15019079-d0e4-4ae6-837f-9280b4128b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:46.291260 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15019079-d0e4-4ae6-837f-9280b4128b77 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:46.291543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15019079-d0e4-4ae6-837f-9280b4128b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:46.291812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15019079-d0e4-4ae6-837f-9280b4128b77 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:46.303847 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15019079-d0e4-4ae6-837f-9280b4128b77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:46.305748 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15019079-d0e4-4ae6-837f-9280b4128b77 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:46.323753 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-15019079-d0e4-4ae6-837f-9280b4128b77 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:46.328266 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 402/811] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:46.331661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e8817-5b50-4150-b93b-8ffc4d5a8263 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:46.342616 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e8817-5b50-4150-b93b-8ffc4d5a8263 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:46.347275 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdff4bb-ca2e-42ee-a789-d887e3d7c566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:46.348018 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdff4bb-ca2e-42ee-a789-d887e3d7c566 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:46.348313 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdff4bb-ca2e-42ee-a789-d887e3d7c566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:46.348589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdff4bb-ca2e-42ee-a789-d887e3d7c566 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:46.349379 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdff4bb-ca2e-42ee-a789-d887e3d7c566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:46.349690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdff4bb-ca2e-42ee-a789-d887e3d7c566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:46.351361 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdff4bb-ca2e-42ee-a789-d887e3d7c566 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:46.372563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 410/812] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:46.379667 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15019079-d0e4-4ae6-837f-9280b4128b77 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:46.392126 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15019079-d0e4-4ae6-837f-9280b4128b77 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:46.402881 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fa7b1-aa3f-4659-ae70-e16af4ba8ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:46.403747 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fa7b1-aa3f-4659-ae70-e16af4ba8ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:46.404026 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fa7b1-aa3f-4659-ae70-e16af4ba8ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:46.404392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fa7b1-aa3f-4659-ae70-e16af4ba8ec3 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:46.419473 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fa7b1-aa3f-4659-ae70-e16af4ba8ec3 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:46.421586 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fa7b1-aa3f-4659-ae70-e16af4ba8ec3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:46.440217 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-c76fa7b1-aa3f-4659-ae70-e16af4ba8ec3 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 02:51:46.441469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 403/813] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:51:46 2021] GET /identity/v3/users/swift => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:46.447924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdff4bb-ca2e-42ee-a789-d887e3d7c566 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:46.464706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdff4bb-ca2e-42ee-a789-d887e3d7c566 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:46.474068 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f827d-0e2e-4163-b91b-ecf2ffad667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:46.474744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f827d-0e2e-4163-b91b-ecf2ffad667d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:46.475025 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f827d-0e2e-4163-b91b-ecf2ffad667d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:46.475297 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f827d-0e2e-4163-b91b-ecf2ffad667d admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:46.476148 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f827d-0e2e-4163-b91b-ecf2ffad667d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:46.476634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f827d-0e2e-4163-b91b-ecf2ffad667d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:46.478513 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f827d-0e2e-4163-b91b-ecf2ffad667d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:46.502188 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 411/814] 10.222.0.18 () {56 vars in 1156 bytes} [Wed Dec 15 02:51:46 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:46.503906 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fa7b1-aa3f-4659-ae70-e16af4ba8ec3 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:46.514710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fa7b1-aa3f-4659-ae70-e16af4ba8ec3 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:46.519876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d886ec9-2f91-4326-9dd5-4f1fc81ff65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:46.520737 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d886ec9-2f91-4326-9dd5-4f1fc81ff65c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:46.521023 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d886ec9-2f91-4326-9dd5-4f1fc81ff65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:46.521297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d886ec9-2f91-4326-9dd5-4f1fc81ff65c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:46.533023 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d886ec9-2f91-4326-9dd5-4f1fc81ff65c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:46.534958 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d886ec9-2f91-4326-9dd5-4f1fc81ff65c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:46.553585 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-1d886ec9-2f91-4326-9dd5-4f1fc81ff65c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:46.560978 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 404/815] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:46.562454 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f827d-0e2e-4163-b91b-ecf2ffad667d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:46.572674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f827d-0e2e-4163-b91b-ecf2ffad667d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:46.578172 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a168bfa-2294-4807-94c4-d1cc9f643086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:46.578835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a168bfa-2294-4807-94c4-d1cc9f643086 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:46.579167 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a168bfa-2294-4807-94c4-d1cc9f643086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:46.579439 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a168bfa-2294-4807-94c4-d1cc9f643086 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:46.580209 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a168bfa-2294-4807-94c4-d1cc9f643086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:46.580521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a168bfa-2294-4807-94c4-d1cc9f643086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:46.582207 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a168bfa-2294-4807-94c4-d1cc9f643086 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:46.598106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 412/816] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:46.600549 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d886ec9-2f91-4326-9dd5-4f1fc81ff65c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:46.611135 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d886ec9-2f91-4326-9dd5-4f1fc81ff65c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:46.615802 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649e412-5065-46c9-a250-1819619a068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:46.616674 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649e412-5065-46c9-a250-1819619a068f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:46.616953 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649e412-5065-46c9-a250-1819619a068f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:46.617227 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649e412-5065-46c9-a250-1819619a068f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:46.625834 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649e412-5065-46c9-a250-1819619a068f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:46.627826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649e412-5065-46c9-a250-1819619a068f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:46.641665 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-7649e412-5065-46c9-a250-1819619a068f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:46.648079 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 405/817] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:46.649422 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a168bfa-2294-4807-94c4-d1cc9f643086 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:46.659449 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a168bfa-2294-4807-94c4-d1cc9f643086 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:46.664145 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7636c-cb71-44ac-84c6-197e6f6ace2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:46.664849 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7636c-cb71-44ac-84c6-197e6f6ace2a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:46.665126 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7636c-cb71-44ac-84c6-197e6f6ace2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:46.665402 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7636c-cb71-44ac-84c6-197e6f6ace2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:46.666286 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7636c-cb71-44ac-84c6-197e6f6ace2a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:46.666589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7636c-cb71-44ac-84c6-197e6f6ace2a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:46.668537 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7636c-cb71-44ac-84c6-197e6f6ace2a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:46.688695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 413/818] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:46.690042 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649e412-5065-46c9-a250-1819619a068f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:46.700628 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649e412-5065-46c9-a250-1819619a068f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:46.705229 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bd9f4-2f03-48d8-8559-b22e93dd73eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:46.706195 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bd9f4-2f03-48d8-8559-b22e93dd73eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:46.706473 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bd9f4-2f03-48d8-8559-b22e93dd73eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:46.706794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bd9f4-2f03-48d8-8559-b22e93dd73eb admin admin] PATH_INFO: `/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/beb0af7ac70d48989852c022c9f83848/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:46.708828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bd9f4-2f03-48d8-8559-b22e93dd73eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user_id=beb0af7ac70d48989852c022c9f83848, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:46.711624 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bd9f4-2f03-48d8-8559-b22e93dd73eb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:46.729310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 406/819] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:51:46 2021] PUT /identity/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/beb0af7ac70d48989852c022c9f83848/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:51:47.596373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c845e76-7526-438f-a973-20f2dbe85b33 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:47.596373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c845e76-7526-438f-a973-20f2dbe85b33 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:47.596373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c845e76-7526-438f-a973-20f2dbe85b33 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:47.596373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 414/820] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:47.607809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137e1e9-04ea-4ae1-a21d-1a040cb4bede None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:47.607809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137e1e9-04ea-4ae1-a21d-1a040cb4bede None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:47.607809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137e1e9-04ea-4ae1-a21d-1a040cb4bede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:47.623382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c137e1e9-04ea-4ae1-a21d-1a040cb4bede None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:47.624854 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c137e1e9-04ea-4ae1-a21d-1a040cb4bede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:47.689665 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 407/821] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:47 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:47.725882 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c845e76-7526-438f-a973-20f2dbe85b33 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:47.743647 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c845e76-7526-438f-a973-20f2dbe85b33 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:47.751910 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910c0c3-6193-4c62-a4d3-a935bcd86af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:47.752692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910c0c3-6193-4c62-a4d3-a935bcd86af8 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:47.752971 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910c0c3-6193-4c62-a4d3-a935bcd86af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:47.753245 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910c0c3-6193-4c62-a4d3-a935bcd86af8 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:47.753900 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910c0c3-6193-4c62-a4d3-a935bcd86af8 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:47.755500 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910c0c3-6193-4c62-a4d3-a935bcd86af8 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:47.769635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-8910c0c3-6193-4c62-a4d3-a935bcd86af8 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 02:51:47.771133 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 415/822] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:47 2021] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:47.777240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137e1e9-04ea-4ae1-a21d-1a040cb4bede None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:47.787057 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137e1e9-04ea-4ae1-a21d-1a040cb4bede None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:47.798812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b8080-d3eb-46fc-91c1-cee45c3c532a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:47.799477 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b8080-d3eb-46fc-91c1-cee45c3c532a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:47.799757 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b8080-d3eb-46fc-91c1-cee45c3c532a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:47.800032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b8080-d3eb-46fc-91c1-cee45c3c532a admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:47.800763 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b8080-d3eb-46fc-91c1-cee45c3c532a admin admin] RBAC: Adding query filter params (name=network) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:47.801065 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b8080-d3eb-46fc-91c1-cee45c3c532a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:47.802711 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b8080-d3eb-46fc-91c1-cee45c3c532a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:47.807690 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 408/823] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Dec 15 02:51:47 2021] GET /identity/v3/services?name=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:47.813822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910c0c3-6193-4c62-a4d3-a935bcd86af8 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:47.826903 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910c0c3-6193-4c62-a4d3-a935bcd86af8 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:47.834014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e4d55-f0a3-4691-ac1f-1d94fcdaaecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:47.834674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e4d55-f0a3-4691-ac1f-1d94fcdaaecc admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:47.834957 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e4d55-f0a3-4691-ac1f-1d94fcdaaecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:47.835231 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e4d55-f0a3-4691-ac1f-1d94fcdaaecc admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:47.835943 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e4d55-f0a3-4691-ac1f-1d94fcdaaecc admin admin] RBAC: Adding query filter params (type=network) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:47.836244 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e4d55-f0a3-4691-ac1f-1d94fcdaaecc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:47.837814 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e4d55-f0a3-4691-ac1f-1d94fcdaaecc admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:47.846190 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 416/824] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Dec 15 02:51:47 2021] GET /identity/v3/services?type=network => generated 350 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:47.852052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b8080-d3eb-46fc-91c1-cee45c3c532a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:47.862442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b8080-d3eb-46fc-91c1-cee45c3c532a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:47.870111 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b00d30-5804-48ed-91d0-c29da3949f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:47.871118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b00d30-5804-48ed-91d0-c29da3949f8b admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:47.871629 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b00d30-5804-48ed-91d0-c29da3949f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:47.872153 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b00d30-5804-48ed-91d0-c29da3949f8b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:47.873156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b00d30-5804-48ed-91d0-c29da3949f8b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:47.874436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-b6b00d30-5804-48ed-91d0-c29da3949f8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:47.874436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:51:47.874436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:51:47.875679 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b00d30-5804-48ed-91d0-c29da3949f8b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:47.917216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 409/825] 10.222.0.18 () {60 vars in 1165 bytes} [Wed Dec 15 02:51:47 2021] POST /identity/v3/endpoints => generated 327 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:51:48.011512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed38e8-2723-4fb3-835a-88dab3d511d4 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.011792 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed38e8-2723-4fb3-835a-88dab3d511d4 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.012067 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed38e8-2723-4fb3-835a-88dab3d511d4 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.014252 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 417/826] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:48.020716 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d72e2-5ab6-4ed5-8f44-47fc0e4749a0 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.021166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d72e2-5ab6-4ed5-8f44-47fc0e4749a0 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.021534 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d72e2-5ab6-4ed5-8f44-47fc0e4749a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.042896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-3d0d72e2-5ab6-4ed5-8f44-47fc0e4749a0 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:48.044238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-3d0d72e2-5ab6-4ed5-8f44-47fc0e4749a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:48.067524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 410/827] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:48 2021] POST /identity/v3/auth/tokens => generated 1266 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:48.089476 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5d552-7fad-4a23-adda-c16e8b542510 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.089912 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5d552-7fad-4a23-adda-c16e8b542510 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.090377 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5d552-7fad-4a23-adda-c16e8b542510 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.093109 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 418/828] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:48.094301 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d72e2-5ab6-4ed5-8f44-47fc0e4749a0 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:48.098925 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9724-e1bb-44d0-b613-6d4e51c426fe None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.099209 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9724-e1bb-44d0-b613-6d4e51c426fe None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.099486 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9724-e1bb-44d0-b613-6d4e51c426fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.104228 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d72e2-5ab6-4ed5-8f44-47fc0e4749a0 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:48.109171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f8877-b72e-42cb-85b9-5b1ba176c778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:48.109972 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f8877-b72e-42cb-85b9-5b1ba176c778 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.110284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f8877-b72e-42cb-85b9-5b1ba176c778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.110559 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f8877-b72e-42cb-85b9-5b1ba176c778 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.111227 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f8877-b72e-42cb-85b9-5b1ba176c778 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:48.112873 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f8877-b72e-42cb-85b9-5b1ba176c778 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:48.126969 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-dc3f8877-b72e-42cb-85b9-5b1ba176c778 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 02:51:48.128572 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 411/829] 10.222.0.18 () {56 vars in 1150 bytes} [Wed Dec 15 02:51:48 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:48.135510 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-390d9724-e1bb-44d0-b613-6d4e51c426fe None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:48.136753 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-390d9724-e1bb-44d0-b613-6d4e51c426fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:48.137695 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f8877-b72e-42cb-85b9-5b1ba176c778 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:48.149396 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f8877-b72e-42cb-85b9-5b1ba176c778 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:48.154776 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc717848-1088-4753-a001-42088ea0886b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:48.155584 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc717848-1088-4753-a001-42088ea0886b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.155868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc717848-1088-4753-a001-42088ea0886b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.156138 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc717848-1088-4753-a001-42088ea0886b admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.156927 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc717848-1088-4753-a001-42088ea0886b admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:48.157225 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc717848-1088-4753-a001-42088ea0886b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:48.159008 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc717848-1088-4753-a001-42088ea0886b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:48.164669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 412/830] 10.222.0.18 () {56 vars in 1145 bytes} [Wed Dec 15 02:51:48 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:48.170918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc717848-1088-4753-a001-42088ea0886b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:48.172508 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 419/831] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:48 2021] POST /identity/v3/auth/tokens => generated 1266 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:48.181579 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc717848-1088-4753-a001-42088ea0886b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:48.186387 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efb660-d1b9-485b-a9f6-62fedea5d8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:48.187102 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efb660-d1b9-485b-a9f6-62fedea5d8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.187379 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efb660-d1b9-485b-a9f6-62fedea5d8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.187649 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efb660-d1b9-485b-a9f6-62fedea5d8b5 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.188436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efb660-d1b9-485b-a9f6-62fedea5d8b5 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:48.188735 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efb660-d1b9-485b-a9f6-62fedea5d8b5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:48.190427 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efb660-d1b9-485b-a9f6-62fedea5d8b5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:48.196632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 413/832] 10.222.0.18 () {56 vars in 1145 bytes} [Wed Dec 15 02:51:48 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:48.204295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d9724-e1bb-44d0-b613-6d4e51c426fe None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:48.214453 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d9724-e1bb-44d0-b613-6d4e51c426fe None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:48.223728 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efb660-d1b9-485b-a9f6-62fedea5d8b5 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:48.232840 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554f03a-99a3-479d-9a61-2948a06cb22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:48.233499 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554f03a-99a3-479d-9a61-2948a06cb22c admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.233774 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554f03a-99a3-479d-9a61-2948a06cb22c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.234790 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554f03a-99a3-479d-9a61-2948a06cb22c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.234971 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554f03a-99a3-479d-9a61-2948a06cb22c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:48.237297 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-0554f03a-99a3-479d-9a61-2948a06cb22c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:48.237297 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:51:48.237297 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:51:48.237751 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efb660-d1b9-485b-a9f6-62fedea5d8b5 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:48.237906 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554f03a-99a3-479d-9a61-2948a06cb22c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:48.246105 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5553ee-ef84-4eb1-bb58-f42b72d28123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:48.248064 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5553ee-ef84-4eb1-bb58-f42b72d28123 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.248064 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5553ee-ef84-4eb1-bb58-f42b72d28123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.248064 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5553ee-ef84-4eb1-bb58-f42b72d28123 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.262393 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5553ee-ef84-4eb1-bb58-f42b72d28123 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:48.270755 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-6c5553ee-ef84-4eb1-bb58-f42b72d28123 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:51:48.272617 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 414/833] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:51:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:48.283828 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 420/834] 10.222.0.18 () {60 vars in 1165 bytes} [Wed Dec 15 02:51:48 2021] POST /identity/v3/endpoints => generated 346 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:51:48.284492 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5553ee-ef84-4eb1-bb58-f42b72d28123 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:48.295794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5553ee-ef84-4eb1-bb58-f42b72d28123 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:48.312203 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85459da1-f97b-44f1-986b-6a7d1c91f50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:48.313201 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85459da1-f97b-44f1-986b-6a7d1c91f50b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.313664 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85459da1-f97b-44f1-986b-6a7d1c91f50b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.314112 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85459da1-f97b-44f1-986b-6a7d1c91f50b admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.315179 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85459da1-f97b-44f1-986b-6a7d1c91f50b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:48.315643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85459da1-f97b-44f1-986b-6a7d1c91f50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:48.317588 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85459da1-f97b-44f1-986b-6a7d1c91f50b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:48.328583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 415/835] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:51:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:48.334670 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554f03a-99a3-479d-9a61-2948a06cb22c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:48.350540 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554f03a-99a3-479d-9a61-2948a06cb22c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:48.356505 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec62e77-2101-4bab-a152-721a972f5ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:48.357376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec62e77-2101-4bab-a152-721a972f5ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.357721 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec62e77-2101-4bab-a152-721a972f5ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.358102 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec62e77-2101-4bab-a152-721a972f5ae3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.371521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec62e77-2101-4bab-a152-721a972f5ae3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:48.373481 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec62e77-2101-4bab-a152-721a972f5ae3 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:48.392963 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-3ec62e77-2101-4bab-a152-721a972f5ae3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:48.394259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 421/836] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:48.400691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85459da1-f97b-44f1-986b-6a7d1c91f50b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:48.411767 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85459da1-f97b-44f1-986b-6a7d1c91f50b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:48.417338 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0725a27-61b6-43c2-9170-db02e21d2661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:48.418021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0725a27-61b6-43c2-9170-db02e21d2661 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.418309 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0725a27-61b6-43c2-9170-db02e21d2661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.418649 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0725a27-61b6-43c2-9170-db02e21d2661 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.419393 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0725a27-61b6-43c2-9170-db02e21d2661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:48.419821 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0725a27-61b6-43c2-9170-db02e21d2661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:48.421483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0725a27-61b6-43c2-9170-db02e21d2661 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:48.436021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 416/837] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:48.442251 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec62e77-2101-4bab-a152-721a972f5ae3 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:48.453624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec62e77-2101-4bab-a152-721a972f5ae3 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:48.458543 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e2b69-c8ed-4041-b804-2f38a99bd6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:48.459367 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e2b69-c8ed-4041-b804-2f38a99bd6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.459701 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e2b69-c8ed-4041-b804-2f38a99bd6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.459979 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e2b69-c8ed-4041-b804-2f38a99bd6a5 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.469164 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e2b69-c8ed-4041-b804-2f38a99bd6a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:48.471312 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e2b69-c8ed-4041-b804-2f38a99bd6a5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:48.486652 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-d26e2b69-c8ed-4041-b804-2f38a99bd6a5 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 02:51:48.488304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 422/838] 10.222.0.18 () {56 vars in 1138 bytes} [Wed Dec 15 02:51:48 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:48.494546 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0725a27-61b6-43c2-9170-db02e21d2661 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:48.505483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0725a27-61b6-43c2-9170-db02e21d2661 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:48.510680 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa079fb-8ab7-4a39-b326-14a94f3f8b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:48.511364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa079fb-8ab7-4a39-b326-14a94f3f8b1e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.511701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa079fb-8ab7-4a39-b326-14a94f3f8b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.511977 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa079fb-8ab7-4a39-b326-14a94f3f8b1e admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.512883 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa079fb-8ab7-4a39-b326-14a94f3f8b1e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:48.513190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa079fb-8ab7-4a39-b326-14a94f3f8b1e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:48.515778 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa079fb-8ab7-4a39-b326-14a94f3f8b1e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:48.536036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 417/839] 10.222.0.18 () {56 vars in 1170 bytes} [Wed Dec 15 02:51:48 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:48.543213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e2b69-c8ed-4041-b804-2f38a99bd6a5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:48.552547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e2b69-c8ed-4041-b804-2f38a99bd6a5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:48.557061 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8f448-1d29-45c8-99e7-13d3b4d89d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:48.557703 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8f448-1d29-45c8-99e7-13d3b4d89d04 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.557997 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8f448-1d29-45c8-99e7-13d3b4d89d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.558295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8f448-1d29-45c8-99e7-13d3b4d89d04 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.566951 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e8f448-1d29-45c8-99e7-13d3b4d89d04 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:48.568700 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e8f448-1d29-45c8-99e7-13d3b4d89d04 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:48.578501 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 423/840] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:48 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:51:48.584466 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa079fb-8ab7-4a39-b326-14a94f3f8b1e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:48.594533 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa079fb-8ab7-4a39-b326-14a94f3f8b1e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:48.599201 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aba17e-9c94-4a15-aff5-e1e5907d8ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:48.599980 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aba17e-9c94-4a15-aff5-e1e5907d8ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.600262 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aba17e-9c94-4a15-aff5-e1e5907d8ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.600538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aba17e-9c94-4a15-aff5-e1e5907d8ef5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.611282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aba17e-9c94-4a15-aff5-e1e5907d8ef5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:48.613154 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aba17e-9c94-4a15-aff5-e1e5907d8ef5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:48.630666 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-16aba17e-9c94-4a15-aff5-e1e5907d8ef5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:48.632212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 418/841] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:48.639000 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8f448-1d29-45c8-99e7-13d3b4d89d04 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:48.648066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8f448-1d29-45c8-99e7-13d3b4d89d04 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:48.652805 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a6473-9d08-4d09-b78b-698b548f7f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:48.653457 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a6473-9d08-4d09-b78b-698b548f7f63 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.653741 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a6473-9d08-4d09-b78b-698b548f7f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.654089 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a6473-9d08-4d09-b78b-698b548f7f63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.654823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a6473-9d08-4d09-b78b-698b548f7f63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:48.655189 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a6473-9d08-4d09-b78b-698b548f7f63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:48.656843 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a6473-9d08-4d09-b78b-698b548f7f63 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:48.669654 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 424/842] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:48.675598 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aba17e-9c94-4a15-aff5-e1e5907d8ef5 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:48.686910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aba17e-9c94-4a15-aff5-e1e5907d8ef5 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:48.690942 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6d114-18c8-4604-8506-6cb26a71116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:48.691968 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6d114-18c8-4604-8506-6cb26a71116d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.692447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6d114-18c8-4604-8506-6cb26a71116d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.692934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6d114-18c8-4604-8506-6cb26a71116d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.700196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6d114-18c8-4604-8506-6cb26a71116d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:48.703004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6d114-18c8-4604-8506-6cb26a71116d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:48.716030 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-2be6d114-18c8-4604-8506-6cb26a71116d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:48.717731 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 419/843] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:48.723723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a6473-9d08-4d09-b78b-698b548f7f63 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:48.733670 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a6473-9d08-4d09-b78b-698b548f7f63 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:48.738465 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba75092-82bf-4fad-974e-1a75ea2380d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:48.739109 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba75092-82bf-4fad-974e-1a75ea2380d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.739449 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba75092-82bf-4fad-974e-1a75ea2380d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.739727 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba75092-82bf-4fad-974e-1a75ea2380d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.740582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba75092-82bf-4fad-974e-1a75ea2380d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:48.740890 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba75092-82bf-4fad-974e-1a75ea2380d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:48.742878 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba75092-82bf-4fad-974e-1a75ea2380d5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:48.755518 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 425/844] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:48.762050 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6d114-18c8-4604-8506-6cb26a71116d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:48.773184 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6d114-18c8-4604-8506-6cb26a71116d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:48.777823 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad71d8-b20a-4a2a-ab70-f7e0f1dddd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:48.778528 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad71d8-b20a-4a2a-ab70-f7e0f1dddd76 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:48.778810 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad71d8-b20a-4a2a-ab70-f7e0f1dddd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:48.779296 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad71d8-b20a-4a2a-ab70-f7e0f1dddd76 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:48.780002 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad71d8-b20a-4a2a-ab70-f7e0f1dddd76 admin admin] RBAC: Adding query filter params (role.id=4f557aac969f4c2f95aee8e21d67c802, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=39cddc4e2ea943cd882b6a1addd98e8c) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:48.780357 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad71d8-b20a-4a2a-ab70-f7e0f1dddd76 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:48.782280 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad71d8-b20a-4a2a-ab70-f7e0f1dddd76 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:48.788624 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 420/845] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:48 2021] GET /identity/v3/role_assignments?user.id=39cddc4e2ea943cd882b6a1addd98e8c&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=4f557aac969f4c2f95aee8e21d67c802 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:49.291282 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838441d7-e06e-4716-b494-2babdbc64723 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:49.291635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838441d7-e06e-4716-b494-2babdbc64723 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:49.291842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838441d7-e06e-4716-b494-2babdbc64723 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:49.293874 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 426/846] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:49.300358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd859528-c130-4624-a345-d688465868a1 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:49.300646 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd859528-c130-4624-a345-d688465868a1 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:49.300923 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd859528-c130-4624-a345-d688465868a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:49.318597 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-fd859528-c130-4624-a345-d688465868a1 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:49.319775 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-fd859528-c130-4624-a345-d688465868a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:49.327729 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 421/847] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:49 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:51:49.351611 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838441d7-e06e-4716-b494-2babdbc64723 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:49.364432 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838441d7-e06e-4716-b494-2babdbc64723 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:49.368788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb6e1a-1987-4bdf-a0b3-f2266b5c09fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:49.369575 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb6e1a-1987-4bdf-a0b3-f2266b5c09fe admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:49.369858 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb6e1a-1987-4bdf-a0b3-f2266b5c09fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:49.370174 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb6e1a-1987-4bdf-a0b3-f2266b5c09fe admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:49.370833 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb6e1a-1987-4bdf-a0b3-f2266b5c09fe admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:49.372476 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb6e1a-1987-4bdf-a0b3-f2266b5c09fe admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:49.383928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-79cb6e1a-1987-4bdf-a0b3-f2266b5c09fe admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 02:51:49.385609 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 427/848] 10.222.0.18 () {56 vars in 1153 bytes} [Wed Dec 15 02:51:49 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:49.392026 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd859528-c130-4624-a345-d688465868a1 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:49.400951 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd859528-c130-4624-a345-d688465868a1 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:49.407348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335abfb5-b7ea-4770-9479-a65211b0d0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:49.408222 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335abfb5-b7ea-4770-9479-a65211b0d0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:49.408701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335abfb5-b7ea-4770-9479-a65211b0d0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:49.409186 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335abfb5-b7ea-4770-9479-a65211b0d0f6 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:49.410123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335abfb5-b7ea-4770-9479-a65211b0d0f6 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:49.410646 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335abfb5-b7ea-4770-9479-a65211b0d0f6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:49.412443 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335abfb5-b7ea-4770-9479-a65211b0d0f6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:49.417448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 422/849] 10.222.0.18 () {56 vars in 1147 bytes} [Wed Dec 15 02:51:49 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:49.423489 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb6e1a-1987-4bdf-a0b3-f2266b5c09fe admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:49.433206 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb6e1a-1987-4bdf-a0b3-f2266b5c09fe admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:49.437954 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3713a-f22f-43f8-bd60-bd3f8d49a631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:49.438625 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3713a-f22f-43f8-bd60-bd3f8d49a631 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:49.438966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3713a-f22f-43f8-bd60-bd3f8d49a631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:49.439248 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3713a-f22f-43f8-bd60-bd3f8d49a631 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:49.440013 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3713a-f22f-43f8-bd60-bd3f8d49a631 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:49.440322 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3713a-f22f-43f8-bd60-bd3f8d49a631 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:49.441944 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3713a-f22f-43f8-bd60-bd3f8d49a631 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:49.446946 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 428/850] 10.222.0.18 () {56 vars in 1147 bytes} [Wed Dec 15 02:51:49 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:49.606873 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432b945-10a7-4109-9547-b308401e7823 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:49.607294 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432b945-10a7-4109-9547-b308401e7823 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:49.607497 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432b945-10a7-4109-9547-b308401e7823 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:49.609668 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 423/851] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:49.615964 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2d3d0-9486-4ec2-963a-132822f5e145 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:49.616252 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2d3d0-9486-4ec2-963a-132822f5e145 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:49.616531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2d3d0-9486-4ec2-963a-132822f5e145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:49.635898 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-3fc2d3d0-9486-4ec2-963a-132822f5e145 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:49.637100 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3fc2d3d0-9486-4ec2-963a-132822f5e145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:49.645693 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 429/852] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:49 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:49.670750 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432b945-10a7-4109-9547-b308401e7823 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:49.683564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432b945-10a7-4109-9547-b308401e7823 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:49.688048 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eab8a3-cc4d-4114-a61e-14a48e4ec508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:49.688813 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eab8a3-cc4d-4114-a61e-14a48e4ec508 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:49.689091 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eab8a3-cc4d-4114-a61e-14a48e4ec508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:49.689363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eab8a3-cc4d-4114-a61e-14a48e4ec508 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:49.703561 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eab8a3-cc4d-4114-a61e-14a48e4ec508 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:49.710512 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-45eab8a3-cc4d-4114-a61e-14a48e4ec508 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:51:49.717709 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 424/853] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:51:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:49.719066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2d3d0-9486-4ec2-963a-132822f5e145 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:49.728230 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2d3d0-9486-4ec2-963a-132822f5e145 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:49.732809 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36e32e-3470-43ba-bd68-f3c801bac032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:49.733474 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36e32e-3470-43ba-bd68-f3c801bac032 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:49.733752 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36e32e-3470-43ba-bd68-f3c801bac032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:49.734066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36e32e-3470-43ba-bd68-f3c801bac032 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:49.734828 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36e32e-3470-43ba-bd68-f3c801bac032 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:49.735132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36e32e-3470-43ba-bd68-f3c801bac032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:49.736712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36e32e-3470-43ba-bd68-f3c801bac032 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:49.745681 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 430/854] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:51:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:49.751759 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eab8a3-cc4d-4114-a61e-14a48e4ec508 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:49.762050 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eab8a3-cc4d-4114-a61e-14a48e4ec508 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:49.767311 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcbad3-bada-4cd2-bb2e-facf01048f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:49.768139 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcbad3-bada-4cd2-bb2e-facf01048f58 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:49.768419 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcbad3-bada-4cd2-bb2e-facf01048f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:49.768694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcbad3-bada-4cd2-bb2e-facf01048f58 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:49.780613 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fcbad3-bada-4cd2-bb2e-facf01048f58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:49.782595 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fcbad3-bada-4cd2-bb2e-facf01048f58 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:49.799253 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-14fcbad3-bada-4cd2-bb2e-facf01048f58 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:49.800803 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 425/855] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:49.806485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36e32e-3470-43ba-bd68-f3c801bac032 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:49.816350 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36e32e-3470-43ba-bd68-f3c801bac032 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:49.820773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63eef47-e1b5-4f7a-a755-38ec241c551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:49.821422 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eef47-e1b5-4f7a-a755-38ec241c551e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:49.821697 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eef47-e1b5-4f7a-a755-38ec241c551e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:49.821970 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eef47-e1b5-4f7a-a755-38ec241c551e admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:49.822730 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63eef47-e1b5-4f7a-a755-38ec241c551e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:49.823024 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63eef47-e1b5-4f7a-a755-38ec241c551e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:49.824603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63eef47-e1b5-4f7a-a755-38ec241c551e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:49.837694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 431/856] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:49.844262 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcbad3-bada-4cd2-bb2e-facf01048f58 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:49.853849 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcbad3-bada-4cd2-bb2e-facf01048f58 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:49.858411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168dd17-97aa-4c9f-93d3-f8b6e9410f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:49.859119 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168dd17-97aa-4c9f-93d3-f8b6e9410f00 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:49.859391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168dd17-97aa-4c9f-93d3-f8b6e9410f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:49.859658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168dd17-97aa-4c9f-93d3-f8b6e9410f00 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:49.867701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168dd17-97aa-4c9f-93d3-f8b6e9410f00 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:49.869685 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168dd17-97aa-4c9f-93d3-f8b6e9410f00 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:49.882620 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-9168dd17-97aa-4c9f-93d3-f8b6e9410f00 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 02:51:49.884284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 426/857] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:51:49 2021] GET /identity/v3/users/swift => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:49.890830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63eef47-e1b5-4f7a-a755-38ec241c551e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:49.900470 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63eef47-e1b5-4f7a-a755-38ec241c551e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:49.905584 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702745b-0947-42d0-9577-1feb3918686f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:49.906266 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702745b-0947-42d0-9577-1feb3918686f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:49.906545 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702745b-0947-42d0-9577-1feb3918686f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:49.906817 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702745b-0947-42d0-9577-1feb3918686f admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:49.907649 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702745b-0947-42d0-9577-1feb3918686f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:49.907947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702745b-0947-42d0-9577-1feb3918686f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:49.909758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702745b-0947-42d0-9577-1feb3918686f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:49.927804 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 432/858] 10.222.0.18 () {56 vars in 1156 bytes} [Wed Dec 15 02:51:49 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:49.933721 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168dd17-97aa-4c9f-93d3-f8b6e9410f00 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:49.943802 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168dd17-97aa-4c9f-93d3-f8b6e9410f00 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:49.948181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9b091-7de5-4962-852a-1d007179ac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:49.948797 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9b091-7de5-4962-852a-1d007179ac5e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:49.949072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9b091-7de5-4962-852a-1d007179ac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:49.949341 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9b091-7de5-4962-852a-1d007179ac5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:49.957031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9b091-7de5-4962-852a-1d007179ac5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:49.958809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9b091-7de5-4962-852a-1d007179ac5e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:49.968170 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 427/859] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:49 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:51:49.974045 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702745b-0947-42d0-9577-1feb3918686f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:49.984320 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702745b-0947-42d0-9577-1feb3918686f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:49.988784 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d50d7-5342-419c-b4df-a6aebcf62b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:49.989559 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d50d7-5342-419c-b4df-a6aebcf62b6d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:49.989838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d50d7-5342-419c-b4df-a6aebcf62b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:49.990141 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d50d7-5342-419c-b4df-a6aebcf62b6d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:50.001176 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d50d7-5342-419c-b4df-a6aebcf62b6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:50.003017 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d50d7-5342-419c-b4df-a6aebcf62b6d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:50.020223 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-563d50d7-5342-419c-b4df-a6aebcf62b6d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:50.021645 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 433/860] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:50.027552 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9b091-7de5-4962-852a-1d007179ac5e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:50.036283 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9b091-7de5-4962-852a-1d007179ac5e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:50.040763 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f714f-23a5-473a-80ed-e8c7aec98bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:50.041399 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f714f-23a5-473a-80ed-e8c7aec98bea admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:50.041674 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f714f-23a5-473a-80ed-e8c7aec98bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:50.041945 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f714f-23a5-473a-80ed-e8c7aec98bea admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:50.042690 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f714f-23a5-473a-80ed-e8c7aec98bea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:50.042987 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f714f-23a5-473a-80ed-e8c7aec98bea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:50.044576 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f714f-23a5-473a-80ed-e8c7aec98bea admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:50.057548 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 428/861] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:50.064171 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d50d7-5342-419c-b4df-a6aebcf62b6d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:50.074047 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d50d7-5342-419c-b4df-a6aebcf62b6d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:50.079044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386a1a-8415-47be-a815-a092e45748c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:50.079822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386a1a-8415-47be-a815-a092e45748c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:50.080100 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386a1a-8415-47be-a815-a092e45748c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:50.080372 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386a1a-8415-47be-a815-a092e45748c5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:50.087246 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1386a1a-8415-47be-a815-a092e45748c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:50.089175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1386a1a-8415-47be-a815-a092e45748c5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:50.101947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-c1386a1a-8415-47be-a815-a092e45748c5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:50.103387 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 434/862] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:50.109518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f714f-23a5-473a-80ed-e8c7aec98bea admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:50.118984 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f714f-23a5-473a-80ed-e8c7aec98bea admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:50.123927 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8dc6c1-a449-424d-908c-6b34c4969450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:50.124557 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dc6c1-a449-424d-908c-6b34c4969450 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:50.124833 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dc6c1-a449-424d-908c-6b34c4969450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:50.125104 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dc6c1-a449-424d-908c-6b34c4969450 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:50.125889 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8dc6c1-a449-424d-908c-6b34c4969450 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:50.126216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8dc6c1-a449-424d-908c-6b34c4969450 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:50.128025 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8dc6c1-a449-424d-908c-6b34c4969450 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:50.140701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 429/863] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:50.146870 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386a1a-8415-47be-a815-a092e45748c5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:50.157723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386a1a-8415-47be-a815-a092e45748c5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:50.162220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1f065-8821-419e-a56a-7ceed1d170f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:50.162849 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1f065-8821-419e-a56a-7ceed1d170f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:50.163122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1f065-8821-419e-a56a-7ceed1d170f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:50.163391 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1f065-8821-419e-a56a-7ceed1d170f9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:50.164220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1f065-8821-419e-a56a-7ceed1d170f9 admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=beb0af7ac70d48989852c022c9f83848) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:50.164524 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1f065-8821-419e-a56a-7ceed1d170f9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:50.166386 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1f065-8821-419e-a56a-7ceed1d170f9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:50.173402 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 435/864] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:50 2021] GET /identity/v3/role_assignments?user.id=beb0af7ac70d48989852c022c9f83848&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:50.814852 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411ae8-e7e3-4d28-896e-6923c7598829 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:50.815560 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411ae8-e7e3-4d28-896e-6923c7598829 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:50.815560 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411ae8-e7e3-4d28-896e-6923c7598829 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:50.817472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 430/865] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:50.823422 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754590b-c8a5-4673-95f0-02639e37394b None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:50.823914 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754590b-c8a5-4673-95f0-02639e37394b None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:50.824073 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754590b-c8a5-4673-95f0-02639e37394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:50.842210 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a754590b-c8a5-4673-95f0-02639e37394b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:50.843434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a754590b-c8a5-4673-95f0-02639e37394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:50.851571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 436/866] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:50 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:50.875044 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411ae8-e7e3-4d28-896e-6923c7598829 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:50.887598 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411ae8-e7e3-4d28-896e-6923c7598829 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:50.892029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bfc15-9bd8-4630-9086-d8cb4a72f739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:50.892813 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bfc15-9bd8-4630-9086-d8cb4a72f739 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:50.893093 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bfc15-9bd8-4630-9086-d8cb4a72f739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:50.893370 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bfc15-9bd8-4630-9086-d8cb4a72f739 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:50.894064 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bfc15-9bd8-4630-9086-d8cb4a72f739 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:50.895678 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bfc15-9bd8-4630-9086-d8cb4a72f739 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:50.907681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-da4bfc15-9bd8-4630-9086-d8cb4a72f739 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 02:51:50.908945 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 431/867] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:51:50 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:50.915647 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754590b-c8a5-4673-95f0-02639e37394b None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:50.925996 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754590b-c8a5-4673-95f0-02639e37394b None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:50.930668 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20003ec4-94bc-4c75-af61-3952e0d14fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:50.931347 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20003ec4-94bc-4c75-af61-3952e0d14fbc admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:50.931628 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20003ec4-94bc-4c75-af61-3952e0d14fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:50.931902 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20003ec4-94bc-4c75-af61-3952e0d14fbc admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:50.932640 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20003ec4-94bc-4c75-af61-3952e0d14fbc admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:50.932945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20003ec4-94bc-4c75-af61-3952e0d14fbc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:50.934596 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20003ec4-94bc-4c75-af61-3952e0d14fbc admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:50.940156 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 437/868] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:51:50 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:50.945847 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bfc15-9bd8-4630-9086-d8cb4a72f739 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:50.955769 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bfc15-9bd8-4630-9086-d8cb4a72f739 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:50.960297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602893c7-38b6-432d-8b3f-c10f00ce1e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:50.960942 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602893c7-38b6-432d-8b3f-c10f00ce1e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:50.961220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602893c7-38b6-432d-8b3f-c10f00ce1e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:50.961494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602893c7-38b6-432d-8b3f-c10f00ce1e5b admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:50.962249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602893c7-38b6-432d-8b3f-c10f00ce1e5b admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:50.962562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602893c7-38b6-432d-8b3f-c10f00ce1e5b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:50.964230 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602893c7-38b6-432d-8b3f-c10f00ce1e5b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:50.969622 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 432/869] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:51:50 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:51.331358 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e4227-29e8-4a30-bfa1-61da111c13e0 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:51.331729 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e4227-29e8-4a30-bfa1-61da111c13e0 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:51.331928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e4227-29e8-4a30-bfa1-61da111c13e0 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:51.334177 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 438/870] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:51.340080 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522c45c-d7a0-4b17-a63f-dfe8a6daa51e None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:51.340364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522c45c-d7a0-4b17-a63f-dfe8a6daa51e None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:51.340646 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522c45c-d7a0-4b17-a63f-dfe8a6daa51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:51.360490 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-3522c45c-d7a0-4b17-a63f-dfe8a6daa51e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:51.361690 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-3522c45c-d7a0-4b17-a63f-dfe8a6daa51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:51.374093 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 433/871] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:51 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:51:51.395037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e4227-29e8-4a30-bfa1-61da111c13e0 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:51.409227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e4227-29e8-4a30-bfa1-61da111c13e0 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:51.413612 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b9962-d3f8-495b-b332-4d59a125a82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:51.414437 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b9962-d3f8-495b-b332-4d59a125a82f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:51.414716 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b9962-d3f8-495b-b332-4d59a125a82f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:51.414990 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b9962-d3f8-495b-b332-4d59a125a82f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:51.425341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b9962-d3f8-495b-b332-4d59a125a82f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:51.432749 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-9d6b9962-d3f8-495b-b332-4d59a125a82f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 02:51:51.439773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 439/872] 10.222.0.18 () {56 vars in 1141 bytes} [Wed Dec 15 02:51:51 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:51.441093 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522c45c-d7a0-4b17-a63f-dfe8a6daa51e None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:51.450200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522c45c-d7a0-4b17-a63f-dfe8a6daa51e None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:51.455246 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098340e-7f28-4263-b7fb-6eafaf25a160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:51.455894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098340e-7f28-4263-b7fb-6eafaf25a160 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:51.456174 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098340e-7f28-4263-b7fb-6eafaf25a160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:51.456444 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098340e-7f28-4263-b7fb-6eafaf25a160 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:51.457208 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098340e-7f28-4263-b7fb-6eafaf25a160 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:51.457510 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098340e-7f28-4263-b7fb-6eafaf25a160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:51.459198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098340e-7f28-4263-b7fb-6eafaf25a160 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:51.472888 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 434/873] 10.222.0.18 () {56 vars in 1136 bytes} [Wed Dec 15 02:51:51 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:51.474258 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b9962-d3f8-495b-b332-4d59a125a82f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:51.484540 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b9962-d3f8-495b-b332-4d59a125a82f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:51.489702 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1aa658-e023-420a-a196-8e0cce04a8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:51.490603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1aa658-e023-420a-a196-8e0cce04a8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:51.490883 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1aa658-e023-420a-a196-8e0cce04a8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:51.491159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1aa658-e023-420a-a196-8e0cce04a8c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:51.503873 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1aa658-e023-420a-a196-8e0cce04a8c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:51.506590 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1aa658-e023-420a-a196-8e0cce04a8c5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:51.527076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-7a1aa658-e023-420a-a196-8e0cce04a8c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:51.532280 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 440/874] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:51.535718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098340e-7f28-4263-b7fb-6eafaf25a160 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:51.545865 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098340e-7f28-4263-b7fb-6eafaf25a160 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:51.550508 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd72754-0e90-407f-a0d3-ff3090b2f3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:51.551152 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd72754-0e90-407f-a0d3-ff3090b2f3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:51.551436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd72754-0e90-407f-a0d3-ff3090b2f3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:51.551761 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd72754-0e90-407f-a0d3-ff3090b2f3e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:51.552486 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd72754-0e90-407f-a0d3-ff3090b2f3e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:51.552840 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd72754-0e90-407f-a0d3-ff3090b2f3e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:51.554556 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd72754-0e90-407f-a0d3-ff3090b2f3e4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:51.570074 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 435/875] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:51.574253 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1aa658-e023-420a-a196-8e0cce04a8c5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:51.584997 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1aa658-e023-420a-a196-8e0cce04a8c5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:51.589604 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174201d-473b-4700-b892-0ef5c2551a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:51.590537 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174201d-473b-4700-b892-0ef5c2551a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:51.590819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174201d-473b-4700-b892-0ef5c2551a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:51.591093 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174201d-473b-4700-b892-0ef5c2551a88 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:51.599010 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174201d-473b-4700-b892-0ef5c2551a88 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:51.601126 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174201d-473b-4700-b892-0ef5c2551a88 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:51.615736 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-1174201d-473b-4700-b892-0ef5c2551a88 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 02:51:51.617192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 441/876] 10.222.0.18 () {56 vars in 1138 bytes} [Wed Dec 15 02:51:51 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:51.627041 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd72754-0e90-407f-a0d3-ff3090b2f3e4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:51.637475 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd72754-0e90-407f-a0d3-ff3090b2f3e4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:51.642667 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ef1f8-b054-4614-b879-74908d302c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:51.643372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ef1f8-b054-4614-b879-74908d302c0d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:51.643654 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ef1f8-b054-4614-b879-74908d302c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:51.643928 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ef1f8-b054-4614-b879-74908d302c0d admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:51.644820 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ef1f8-b054-4614-b879-74908d302c0d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:51.645122 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ef1f8-b054-4614-b879-74908d302c0d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:51.647028 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ef1f8-b054-4614-b879-74908d302c0d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:51.670117 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 436/877] 10.222.0.18 () {56 vars in 1170 bytes} [Wed Dec 15 02:51:51 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:51.672668 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174201d-473b-4700-b892-0ef5c2551a88 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:51.682781 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174201d-473b-4700-b892-0ef5c2551a88 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:51.688039 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6ad8d-2506-442a-8300-c2da56633b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:51.688736 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6ad8d-2506-442a-8300-c2da56633b1c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:51.689017 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6ad8d-2506-442a-8300-c2da56633b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:51.689291 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6ad8d-2506-442a-8300-c2da56633b1c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:51.697570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6ad8d-2506-442a-8300-c2da56633b1c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:51.699399 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6ad8d-2506-442a-8300-c2da56633b1c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:51.714171 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 442/878] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:51 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:51:51.715694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ef1f8-b054-4614-b879-74908d302c0d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:51.725661 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ef1f8-b054-4614-b879-74908d302c0d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:51.730290 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357761f-2eb2-4431-a7b1-d75acc02b7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:51.731107 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357761f-2eb2-4431-a7b1-d75acc02b7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:51.731383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357761f-2eb2-4431-a7b1-d75acc02b7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:51.731698 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357761f-2eb2-4431-a7b1-d75acc02b7d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:51.742514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357761f-2eb2-4431-a7b1-d75acc02b7d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:51.744443 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357761f-2eb2-4431-a7b1-d75acc02b7d6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:51.762074 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-b357761f-2eb2-4431-a7b1-d75acc02b7d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:51.769056 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 437/879] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:51.770418 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6ad8d-2506-442a-8300-c2da56633b1c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:51.779434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6ad8d-2506-442a-8300-c2da56633b1c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:51.784083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d759a4-6f52-44c0-8b9e-727978146cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:51.784783 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d759a4-6f52-44c0-8b9e-727978146cac admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:51.785064 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d759a4-6f52-44c0-8b9e-727978146cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:51.785334 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d759a4-6f52-44c0-8b9e-727978146cac admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:51.786137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d759a4-6f52-44c0-8b9e-727978146cac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:51.786442 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d759a4-6f52-44c0-8b9e-727978146cac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:51.788006 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d759a4-6f52-44c0-8b9e-727978146cac admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:51.804768 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 443/880] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:51.806162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357761f-2eb2-4431-a7b1-d75acc02b7d6 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:51.816826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357761f-2eb2-4431-a7b1-d75acc02b7d6 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:51.821390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a1054-f03e-4989-b6a1-d56675221516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:51.822196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a1054-f03e-4989-b6a1-d56675221516 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:51.822529 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a1054-f03e-4989-b6a1-d56675221516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:51.822803 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a1054-f03e-4989-b6a1-d56675221516 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:51.830768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a1054-f03e-4989-b6a1-d56675221516 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:51.832995 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a1054-f03e-4989-b6a1-d56675221516 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:51.846216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-725a1054-f03e-4989-b6a1-d56675221516 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:51.852633 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 438/881] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:51.854019 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d759a4-6f52-44c0-8b9e-727978146cac admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:51.864484 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d759a4-6f52-44c0-8b9e-727978146cac admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:51.869401 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5f69-bbcf-46b5-8995-470e6eda5cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:51.870086 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5f69-bbcf-46b5-8995-470e6eda5cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:51.870412 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5f69-bbcf-46b5-8995-470e6eda5cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:51.870687 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5f69-bbcf-46b5-8995-470e6eda5cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:51.871531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b5f69-bbcf-46b5-8995-470e6eda5cf4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:51.871834 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b5f69-bbcf-46b5-8995-470e6eda5cf4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:51.874347 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b5f69-bbcf-46b5-8995-470e6eda5cf4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:51.892882 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 444/882] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:51.894269 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a1054-f03e-4989-b6a1-d56675221516 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:51.905084 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a1054-f03e-4989-b6a1-d56675221516 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:51.909926 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec88e1-c62e-4134-b6a6-37e7af94fe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:51.910590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec88e1-c62e-4134-b6a6-37e7af94fe65 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:51.910921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec88e1-c62e-4134-b6a6-37e7af94fe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:51.911199 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec88e1-c62e-4134-b6a6-37e7af94fe65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:51.912126 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec88e1-c62e-4134-b6a6-37e7af94fe65 admin admin] RBAC: Adding query filter params (role.id=d846ce53fbf24866ad1005504008a71d, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=39cddc4e2ea943cd882b6a1addd98e8c) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:51.912431 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec88e1-c62e-4134-b6a6-37e7af94fe65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:51.914401 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec88e1-c62e-4134-b6a6-37e7af94fe65 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:51.925088 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 439/883] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:51 2021] GET /identity/v3/role_assignments?user.id=39cddc4e2ea943cd882b6a1addd98e8c&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=d846ce53fbf24866ad1005504008a71d => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:51.926824 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b14ef-6c8f-4fc2-bd98-b43016e7285a None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:51.927110 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b14ef-6c8f-4fc2-bd98-b43016e7285a None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:51.927383 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b14ef-6c8f-4fc2-bd98-b43016e7285a None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:51.929500 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 445/884] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:51.938368 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d551b9-48a9-4618-a0f1-4ceccd586533 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:51.938368 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d551b9-48a9-4618-a0f1-4ceccd586533 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:51.938368 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d551b9-48a9-4618-a0f1-4ceccd586533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:51.955915 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-69d551b9-48a9-4618-a0f1-4ceccd586533 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:51.957412 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-69d551b9-48a9-4618-a0f1-4ceccd586533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:51.965871 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 440/885] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:51 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:51.992030 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b14ef-6c8f-4fc2-bd98-b43016e7285a None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:52.005572 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b14ef-6c8f-4fc2-bd98-b43016e7285a None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:52.010876 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813b4f4-da69-4c1c-9d19-c48cc9285bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:52.011820 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b4f4-da69-4c1c-9d19-c48cc9285bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:52.012259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b4f4-da69-4c1c-9d19-c48cc9285bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:52.012666 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b4f4-da69-4c1c-9d19-c48cc9285bb5 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:52.013621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813b4f4-da69-4c1c-9d19-c48cc9285bb5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:52.014905 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-8813b4f4-da69-4c1c-9d19-c48cc9285bb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:51:52.014905 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:51:52.014905 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:51:52.016049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813b4f4-da69-4c1c-9d19-c48cc9285bb5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:52.042311 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 446/886] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Dec 15 02:51:51 2021] POST /identity/v3/services => generated 269 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:51:52.623435 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee13cb-1de2-4af3-ab11-8ea652eb3ee3 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:52.623848 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee13cb-1de2-4af3-ab11-8ea652eb3ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:52.624043 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee13cb-1de2-4af3-ab11-8ea652eb3ee3 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:52.625910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 441/887] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:52.631870 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e03a-84fa-4362-a6f5-6f102366564a None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:52.632381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e03a-84fa-4362-a6f5-6f102366564a None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:52.632878 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e03a-84fa-4362-a6f5-6f102366564a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:52.651454 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-7524e03a-84fa-4362-a6f5-6f102366564a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:52.652949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7524e03a-84fa-4362-a6f5-6f102366564a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:52.669742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 447/888] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:52 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:52.692515 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee13cb-1de2-4af3-ab11-8ea652eb3ee3 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:52.705337 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee13cb-1de2-4af3-ab11-8ea652eb3ee3 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:52.709856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ea8fa-322b-4886-a776-5a10fcdf0bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:52.710896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ea8fa-322b-4886-a776-5a10fcdf0bea admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:52.711391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ea8fa-322b-4886-a776-5a10fcdf0bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:52.711861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ea8fa-322b-4886-a776-5a10fcdf0bea admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:52.712749 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ea8fa-322b-4886-a776-5a10fcdf0bea admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:52.714546 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ea8fa-322b-4886-a776-5a10fcdf0bea admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:52.726457 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-b80ea8fa-322b-4886-a776-5a10fcdf0bea admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 02:51:52.728082 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 442/889] 10.222.0.18 () {56 vars in 1147 bytes} [Wed Dec 15 02:51:52 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:52.734614 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524e03a-84fa-4362-a6f5-6f102366564a None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:52.743901 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524e03a-84fa-4362-a6f5-6f102366564a None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:52.748815 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df78ac-6413-4d9c-98d7-8f093881c117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:52.749688 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df78ac-6413-4d9c-98d7-8f093881c117 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:52.750263 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df78ac-6413-4d9c-98d7-8f093881c117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:52.750739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df78ac-6413-4d9c-98d7-8f093881c117 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:52.751670 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df78ac-6413-4d9c-98d7-8f093881c117 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:52.752175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df78ac-6413-4d9c-98d7-8f093881c117 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:52.754039 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df78ac-6413-4d9c-98d7-8f093881c117 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:52.759512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 448/890] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Dec 15 02:51:52 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:52.766303 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ea8fa-322b-4886-a776-5a10fcdf0bea admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:52.776570 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ea8fa-322b-4886-a776-5a10fcdf0bea admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:52.782410 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811755a-81f9-4c14-b1ea-5f626bd4ed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:52.783377 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811755a-81f9-4c14-b1ea-5f626bd4ed9a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:52.783872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811755a-81f9-4c14-b1ea-5f626bd4ed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:52.784390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811755a-81f9-4c14-b1ea-5f626bd4ed9a admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:52.785315 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811755a-81f9-4c14-b1ea-5f626bd4ed9a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:52.785844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811755a-81f9-4c14-b1ea-5f626bd4ed9a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:52.787727 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811755a-81f9-4c14-b1ea-5f626bd4ed9a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:52.793252 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 443/891] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Dec 15 02:51:52 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:53.378239 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15d1a7-1ee8-479c-9e33-f578d2410fcb None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:53.378748 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15d1a7-1ee8-479c-9e33-f578d2410fcb None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:53.378822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15d1a7-1ee8-479c-9e33-f578d2410fcb None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:53.380809 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 449/892] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:53.386975 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b77e51-73d3-4dcc-ba2e-a6f431c21b4a None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:53.387818 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b77e51-73d3-4dcc-ba2e-a6f431c21b4a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:53.388337 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b77e51-73d3-4dcc-ba2e-a6f431c21b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:53.406366 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-32b77e51-73d3-4dcc-ba2e-a6f431c21b4a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:53.407844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-32b77e51-73d3-4dcc-ba2e-a6f431c21b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:53.421999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 444/893] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:53 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:53.440474 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15d1a7-1ee8-479c-9e33-f578d2410fcb None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:53.452810 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15d1a7-1ee8-479c-9e33-f578d2410fcb None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:53.457437 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eda0ac-47e6-41d5-acb1-14b91788bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:53.458366 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eda0ac-47e6-41d5-acb1-14b91788bae2 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:53.458855 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eda0ac-47e6-41d5-acb1-14b91788bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:53.459352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eda0ac-47e6-41d5-acb1-14b91788bae2 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:53.460281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eda0ac-47e6-41d5-acb1-14b91788bae2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:53.462085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eda0ac-47e6-41d5-acb1-14b91788bae2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:53.482558 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 450/894] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Dec 15 02:51:53 2021] POST /identity/v3/services => generated 251 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:51:54.314573 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83cafa-14d2-44e8-9a02-4f329f81cce5 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.314858 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83cafa-14d2-44e8-9a02-4f329f81cce5 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.315310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83cafa-14d2-44e8-9a02-4f329f81cce5 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.317478 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 445/895] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:54.323399 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f91eb-7fc5-4d29-a69c-47b570cb0f7c None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.323928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f91eb-7fc5-4d29-a69c-47b570cb0f7c None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.324439 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f91eb-7fc5-4d29-a69c-47b570cb0f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.344088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-d48f91eb-7fc5-4d29-a69c-47b570cb0f7c None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:54.345602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d48f91eb-7fc5-4d29-a69c-47b570cb0f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:54.363125 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 451/896] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:54 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:54.387243 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83cafa-14d2-44e8-9a02-4f329f81cce5 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:54.400544 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83cafa-14d2-44e8-9a02-4f329f81cce5 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:54.405809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3448bc-564d-4e19-9b3b-a4a3fc17124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:54.406874 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3448bc-564d-4e19-9b3b-a4a3fc17124a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.407369 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3448bc-564d-4e19-9b3b-a4a3fc17124a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.407868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3448bc-564d-4e19-9b3b-a4a3fc17124a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.418446 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3448bc-564d-4e19-9b3b-a4a3fc17124a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:54.426514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-dc3448bc-564d-4e19-9b3b-a4a3fc17124a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 02:51:54.428204 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 446/897] 10.222.0.18 () {56 vars in 1141 bytes} [Wed Dec 15 02:51:54 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:54.434628 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f91eb-7fc5-4d29-a69c-47b570cb0f7c None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:54.444748 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f91eb-7fc5-4d29-a69c-47b570cb0f7c None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:54.449651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86410122-46fd-4d4d-a36e-6b9671cd414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:54.450585 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86410122-46fd-4d4d-a36e-6b9671cd414f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.451117 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86410122-46fd-4d4d-a36e-6b9671cd414f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.451602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86410122-46fd-4d4d-a36e-6b9671cd414f admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.452586 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86410122-46fd-4d4d-a36e-6b9671cd414f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:54.453110 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86410122-46fd-4d4d-a36e-6b9671cd414f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:54.455001 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86410122-46fd-4d4d-a36e-6b9671cd414f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:54.464779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 452/898] 10.222.0.18 () {56 vars in 1136 bytes} [Wed Dec 15 02:51:54 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:54.471486 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3448bc-564d-4e19-9b3b-a4a3fc17124a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:54.481259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3448bc-564d-4e19-9b3b-a4a3fc17124a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:54.486690 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eef9d-2d37-4f3d-9c06-1f7b99c9c3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:54.487697 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eef9d-2d37-4f3d-9c06-1f7b99c9c3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.488187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eef9d-2d37-4f3d-9c06-1f7b99c9c3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.488668 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eef9d-2d37-4f3d-9c06-1f7b99c9c3b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.499631 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eef9d-2d37-4f3d-9c06-1f7b99c9c3b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:54.501686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eef9d-2d37-4f3d-9c06-1f7b99c9c3b6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:54.504343 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403b342-f863-4d34-9931-8fde513328da None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.504640 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403b342-f863-4d34-9931-8fde513328da None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.504922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403b342-f863-4d34-9931-8fde513328da None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.506975 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 453/899] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:51:54.512592 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d59c2-89f3-468b-b7a1-9688ea279e75 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.512883 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d59c2-89f3-468b-b7a1-9688ea279e75 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.513198 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d59c2-89f3-468b-b7a1-9688ea279e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.520199 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-b36eef9d-2d37-4f3d-9c06-1f7b99c9c3b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:54.521654 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 447/900] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:54.527589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eef9d-2d37-4f3d-9c06-1f7b99c9c3b6 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:54.531932 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-0f2d59c2-89f3-468b-b7a1-9688ea279e75 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:54.533753 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-0f2d59c2-89f3-468b-b7a1-9688ea279e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:54.537567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eef9d-2d37-4f3d-9c06-1f7b99c9c3b6 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:54.542196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d841fb-95ab-41c5-b964-65143c113eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:54.550181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d841fb-95ab-41c5-b964-65143c113eab admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.550181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d841fb-95ab-41c5-b964-65143c113eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.550181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d841fb-95ab-41c5-b964-65143c113eab admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.550181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d841fb-95ab-41c5-b964-65143c113eab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:54.550181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d841fb-95ab-41c5-b964-65143c113eab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:54.550181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d841fb-95ab-41c5-b964-65143c113eab admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:54.551015 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 454/901] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:54 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:51:54.558822 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 448/902] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:54.564772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d59c2-89f3-468b-b7a1-9688ea279e75 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:54.569484 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d841fb-95ab-41c5-b964-65143c113eab admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:54.575384 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d59c2-89f3-468b-b7a1-9688ea279e75 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:54.579950 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d841fb-95ab-41c5-b964-65143c113eab admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:54.580286 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b7537-ff84-4dda-b04d-1c57008d03d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:54.581090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b7537-ff84-4dda-b04d-1c57008d03d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.581374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b7537-ff84-4dda-b04d-1c57008d03d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.581708 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b7537-ff84-4dda-b04d-1c57008d03d5 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.586497 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76409e8-0fec-4190-a161-d699460e3d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:54.587527 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76409e8-0fec-4190-a161-d699460e3d98 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.588015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76409e8-0fec-4190-a161-d699460e3d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.588675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76409e8-0fec-4190-a161-d699460e3d98 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.589656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b7537-ff84-4dda-b04d-1c57008d03d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:54.589776 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76409e8-0fec-4190-a161-d699460e3d98 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:54.592174 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76409e8-0fec-4190-a161-d699460e3d98 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:54.592282 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b7537-ff84-4dda-b04d-1c57008d03d5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:54.605060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-a76409e8-0fec-4190-a161-d699460e3d98 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 02:51:54.612471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-283b7537-ff84-4dda-b04d-1c57008d03d5 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 02:51:54.612471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 455/904] 10.222.0.18 () {56 vars in 1138 bytes} [Wed Dec 15 02:51:54 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:54.612867 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 449/904] 10.222.0.18 () {56 vars in 1153 bytes} [Wed Dec 15 02:51:54 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:54.615156 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b7537-ff84-4dda-b04d-1c57008d03d5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:54.615606 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76409e8-0fec-4190-a161-d699460e3d98 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:54.626115 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b7537-ff84-4dda-b04d-1c57008d03d5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:54.626814 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76409e8-0fec-4190-a161-d699460e3d98 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:54.630856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42fcfe-9549-48ac-a0ac-2562de94c0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:54.631549 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42fcfe-9549-48ac-a0ac-2562de94c0ba admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.631837 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42fcfe-9549-48ac-a0ac-2562de94c0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.632111 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42fcfe-9549-48ac-a0ac-2562de94c0ba admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.632803 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32b480-4744-4aef-b007-23e55caea69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:54.632920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42fcfe-9549-48ac-a0ac-2562de94c0ba admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:54.633188 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42fcfe-9549-48ac-a0ac-2562de94c0ba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:54.634300 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b480-4744-4aef-b007-23e55caea69d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.634787 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b480-4744-4aef-b007-23e55caea69d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.635179 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42fcfe-9549-48ac-a0ac-2562de94c0ba admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:54.635476 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b480-4744-4aef-b007-23e55caea69d admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.636725 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32b480-4744-4aef-b007-23e55caea69d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:54.637542 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32b480-4744-4aef-b007-23e55caea69d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:54.639936 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32b480-4744-4aef-b007-23e55caea69d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:54.645219 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 456/905] 10.222.0.18 () {56 vars in 1147 bytes} [Wed Dec 15 02:51:54 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:54.646556 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42fcfe-9549-48ac-a0ac-2562de94c0ba admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:54.660698 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 450/906] 10.222.0.18 () {56 vars in 1170 bytes} [Wed Dec 15 02:51:54 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:54.662597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42fcfe-9549-48ac-a0ac-2562de94c0ba admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:54.666622 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32b480-4744-4aef-b007-23e55caea69d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:54.668193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800b5f2-8b77-4d1d-aff1-768796cfc46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:54.669222 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800b5f2-8b77-4d1d-aff1-768796cfc46d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.670345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800b5f2-8b77-4d1d-aff1-768796cfc46d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.670858 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800b5f2-8b77-4d1d-aff1-768796cfc46d admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.671865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800b5f2-8b77-4d1d-aff1-768796cfc46d admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:54.672694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800b5f2-8b77-4d1d-aff1-768796cfc46d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:54.675807 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800b5f2-8b77-4d1d-aff1-768796cfc46d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:54.677350 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32b480-4744-4aef-b007-23e55caea69d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:54.682536 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14166983-28ea-4448-aff4-0cd28fd0513e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:54.688383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14166983-28ea-4448-aff4-0cd28fd0513e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.688383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14166983-28ea-4448-aff4-0cd28fd0513e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.688383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14166983-28ea-4448-aff4-0cd28fd0513e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.688638 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 457/907] 10.222.0.18 () {56 vars in 1147 bytes} [Wed Dec 15 02:51:54 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:54.689481 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800b5f2-8b77-4d1d-aff1-768796cfc46d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:54.699105 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14166983-28ea-4448-aff4-0cd28fd0513e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:54.702153 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14166983-28ea-4448-aff4-0cd28fd0513e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:54.703687 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800b5f2-8b77-4d1d-aff1-768796cfc46d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:54.708582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269698a-6a69-4740-9a36-737551a60c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:54.709287 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269698a-6a69-4740-9a36-737551a60c84 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.709570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269698a-6a69-4740-9a36-737551a60c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.709849 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269698a-6a69-4740-9a36-737551a60c84 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.710729 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269698a-6a69-4740-9a36-737551a60c84 admin admin] RBAC: Adding query filter params (interface=public, service_id=cc006f772008431ea7cd4e4df923286d, region_id=RegionOne) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:54.711043 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269698a-6a69-4740-9a36-737551a60c84 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:54.712737 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269698a-6a69-4740-9a36-737551a60c84 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:54.723648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 458/908] 10.222.0.18 () {56 vars in 1272 bytes} [Wed Dec 15 02:51:54 2021] GET /identity/v3/endpoints?service_id=cc006f772008431ea7cd4e4df923286d&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:54.724764 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269698a-6a69-4740-9a36-737551a60c84 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:54.727546 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-14166983-28ea-4448-aff4-0cd28fd0513e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:54.729060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 451/909] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:54.735551 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14166983-28ea-4448-aff4-0cd28fd0513e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:54.736205 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269698a-6a69-4740-9a36-737551a60c84 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:54.741110 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28001e0c-caf5-419c-b9f7-647cada24897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:54.742535 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28001e0c-caf5-419c-b9f7-647cada24897 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.743072 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28001e0c-caf5-419c-b9f7-647cada24897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.743768 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28001e0c-caf5-419c-b9f7-647cada24897 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.744617 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28001e0c-caf5-419c-b9f7-647cada24897 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:54.745778 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14166983-28ea-4448-aff4-0cd28fd0513e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:54.746626 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28001e0c-caf5-419c-b9f7-647cada24897 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:54.751014 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a19213-dd61-45c4-b303-5cd5908955a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:54.751828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a19213-dd61-45c4-b303-5cd5908955a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.752214 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a19213-dd61-45c4-b303-5cd5908955a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.752672 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a19213-dd61-45c4-b303-5cd5908955a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.753565 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a19213-dd61-45c4-b303-5cd5908955a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:54.753990 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a19213-dd61-45c4-b303-5cd5908955a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:54.760770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 459/910] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Dec 15 02:51:54 2021] GET /identity/v3/services => generated 1268 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 02:51:54.760983 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a19213-dd61-45c4-b303-5cd5908955a7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:54.774104 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 452/911] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:54.781321 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28001e0c-caf5-419c-b9f7-647cada24897 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:54.792272 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28001e0c-caf5-419c-b9f7-647cada24897 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:54.797819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25e949-ee7f-4b58-9c74-b7534413326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:54.798712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e949-ee7f-4b58-9c74-b7534413326e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.799050 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e949-ee7f-4b58-9c74-b7534413326e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.799329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e949-ee7f-4b58-9c74-b7534413326e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.807273 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25e949-ee7f-4b58-9c74-b7534413326e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:54.809310 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25e949-ee7f-4b58-9c74-b7534413326e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:54.824062 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-9a25e949-ee7f-4b58-9c74-b7534413326e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:54.826200 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 460/912] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:54.832752 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a19213-dd61-45c4-b303-5cd5908955a7 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:54.843741 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a19213-dd61-45c4-b303-5cd5908955a7 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:54.848575 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9a31f-adaa-45d1-8a35-a298bc6155fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:54.849292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9a31f-adaa-45d1-8a35-a298bc6155fc admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.849579 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9a31f-adaa-45d1-8a35-a298bc6155fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.849856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9a31f-adaa-45d1-8a35-a298bc6155fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.850758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9a31f-adaa-45d1-8a35-a298bc6155fc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:54.851068 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9a31f-adaa-45d1-8a35-a298bc6155fc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:54.852995 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9a31f-adaa-45d1-8a35-a298bc6155fc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:54.867151 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 453/913] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:54.873720 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25e949-ee7f-4b58-9c74-b7534413326e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:54.884412 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25e949-ee7f-4b58-9c74-b7534413326e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:54.889836 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0e812-ee17-46f5-8100-ae847a2d3f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:54.890867 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0e812-ee17-46f5-8100-ae847a2d3f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:54.891147 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0e812-ee17-46f5-8100-ae847a2d3f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:54.891478 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0e812-ee17-46f5-8100-ae847a2d3f0a admin admin] PATH_INFO: `/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/39cddc4e2ea943cd882b6a1addd98e8c/roles/d846ce53fbf24866ad1005504008a71d` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:54.893856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0e812-ee17-46f5-8100-ae847a2d3f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user_id=39cddc4e2ea943cd882b6a1addd98e8c, role_id=d846ce53fbf24866ad1005504008a71d)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:54.896674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0e812-ee17-46f5-8100-ae847a2d3f0a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:54.917131 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 461/914] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:51:54 2021] PUT /identity/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/39cddc4e2ea943cd882b6a1addd98e8c/roles/d846ce53fbf24866ad1005504008a71d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:51:55.179222 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71785b70-75e6-4847-a735-7975d0fa3759 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:55.179622 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71785b70-75e6-4847-a735-7975d0fa3759 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:55.179825 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71785b70-75e6-4847-a735-7975d0fa3759 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:55.181770 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 454/915] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:55.188145 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c093-9507-4d56-9fa5-de9dff636e84 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:55.188427 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c093-9507-4d56-9fa5-de9dff636e84 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:55.188705 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c093-9507-4d56-9fa5-de9dff636e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:55.215031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-e6f9c093-9507-4d56-9fa5-de9dff636e84 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:55.216233 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e6f9c093-9507-4d56-9fa5-de9dff636e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:55.273000 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 462/916] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:55 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:55.296349 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71785b70-75e6-4847-a735-7975d0fa3759 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:55.308418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71785b70-75e6-4847-a735-7975d0fa3759 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:55.313337 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca246b-691c-4a13-8a9a-aceca5ff9a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:55.314057 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca246b-691c-4a13-8a9a-aceca5ff9a63 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:55.314339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca246b-691c-4a13-8a9a-aceca5ff9a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:55.314608 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca246b-691c-4a13-8a9a-aceca5ff9a63 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:55.315403 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca246b-691c-4a13-8a9a-aceca5ff9a63 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:55.317032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca246b-691c-4a13-8a9a-aceca5ff9a63 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:55.333344 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 455/917] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Dec 15 02:51:55 2021] POST /identity/v3/services => generated 241 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:51:55.909724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95b294-f96d-4eae-b9a7-a98a4b711c9e None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:55.910603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95b294-f96d-4eae-b9a7-a98a4b711c9e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:55.911055 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95b294-f96d-4eae-b9a7-a98a4b711c9e None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:55.913217 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 463/918] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:55.919416 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39080293-3e62-49e4-9702-d3ef43938b33 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:55.920277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39080293-3e62-49e4-9702-d3ef43938b33 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:55.920756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39080293-3e62-49e4-9702-d3ef43938b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:55.939272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-39080293-3e62-49e4-9702-d3ef43938b33 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:55.940770 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-39080293-3e62-49e4-9702-d3ef43938b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:55.961075 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 456/919] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:55 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:55.981780 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95b294-f96d-4eae-b9a7-a98a4b711c9e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:55.995075 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95b294-f96d-4eae-b9a7-a98a4b711c9e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:56.000669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94d776-5572-42cb-8ad5-c9a744ce4436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:56.001795 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94d776-5572-42cb-8ad5-c9a744ce4436 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:56.002308 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94d776-5572-42cb-8ad5-c9a744ce4436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:56.002787 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94d776-5572-42cb-8ad5-c9a744ce4436 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:56.003653 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94d776-5572-42cb-8ad5-c9a744ce4436 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:56.005553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94d776-5572-42cb-8ad5-c9a744ce4436 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:56.018246 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-0c94d776-5572-42cb-8ad5-c9a744ce4436 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 02:51:56.024305 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 464/920] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:51:55 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:56.026738 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39080293-3e62-49e4-9702-d3ef43938b33 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:56.036182 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39080293-3e62-49e4-9702-d3ef43938b33 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:56.041024 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3134c3-0e27-4373-88ba-89b9b344c99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:56.041940 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3134c3-0e27-4373-88ba-89b9b344c99d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:56.042462 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3134c3-0e27-4373-88ba-89b9b344c99d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:56.042938 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3134c3-0e27-4373-88ba-89b9b344c99d admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:56.043856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3134c3-0e27-4373-88ba-89b9b344c99d admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:56.044436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3134c3-0e27-4373-88ba-89b9b344c99d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:56.046344 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3134c3-0e27-4373-88ba-89b9b344c99d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:56.056707 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 457/921] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:51:56 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:56.058348 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94d776-5572-42cb-8ad5-c9a744ce4436 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:56.069079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94d776-5572-42cb-8ad5-c9a744ce4436 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:56.074248 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d598d-d257-449d-a706-1ae665a94860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:56.075195 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d598d-d257-449d-a706-1ae665a94860 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:56.076432 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d598d-d257-449d-a706-1ae665a94860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:56.076914 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d598d-d257-449d-a706-1ae665a94860 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:56.077862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d598d-d257-449d-a706-1ae665a94860 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:56.078451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d598d-d257-449d-a706-1ae665a94860 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:56.080367 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d598d-d257-449d-a706-1ae665a94860 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:56.090100 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 465/922] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:51:56 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:56.092863 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3134c3-0e27-4373-88ba-89b9b344c99d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:56.103618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3134c3-0e27-4373-88ba-89b9b344c99d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:56.109086 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621a521-d6e9-42f3-b7c3-ba98c3ad82ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:56.110117 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a521-d6e9-42f3-b7c3-ba98c3ad82ae admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:56.110627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a521-d6e9-42f3-b7c3-ba98c3ad82ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:56.111151 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a521-d6e9-42f3-b7c3-ba98c3ad82ae admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:56.112171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621a521-d6e9-42f3-b7c3-ba98c3ad82ae admin admin] RBAC: Adding query filter params (interface=public, service_id=e83dc0a38e414c9b8d76bcb133755588, region_id=RegionOne) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:56.112723 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621a521-d6e9-42f3-b7c3-ba98c3ad82ae admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:56.114627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621a521-d6e9-42f3-b7c3-ba98c3ad82ae admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:56.125346 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 458/923] 10.222.0.18 () {56 vars in 1272 bytes} [Wed Dec 15 02:51:56 2021] GET /identity/v3/endpoints?service_id=e83dc0a38e414c9b8d76bcb133755588&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:56.127850 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d598d-d257-449d-a706-1ae665a94860 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:56.139166 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d598d-d257-449d-a706-1ae665a94860 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:56.144233 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93576ea8-9a05-45e8-b3dc-0759613e7a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:56.145198 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93576ea8-9a05-45e8-b3dc-0759613e7a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:56.145806 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93576ea8-9a05-45e8-b3dc-0759613e7a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:56.146316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93576ea8-9a05-45e8-b3dc-0759613e7a6b admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:56.147258 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93576ea8-9a05-45e8-b3dc-0759613e7a6b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:56.149122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93576ea8-9a05-45e8-b3dc-0759613e7a6b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:56.162223 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 466/924] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Dec 15 02:51:56 2021] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 02:51:57.251235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487a7cf-7a0b-4ad9-b3d2-c0ad7d874caa None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.251801 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487a7cf-7a0b-4ad9-b3d2-c0ad7d874caa None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.252059 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487a7cf-7a0b-4ad9-b3d2-c0ad7d874caa None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.254266 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 459/925] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:57.260287 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb63caf-bf72-4c1d-8d4b-851afb828b27 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.261088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb63caf-bf72-4c1d-8d4b-851afb828b27 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.261568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb63caf-bf72-4c1d-8d4b-851afb828b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.281050 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-cbb63caf-bf72-4c1d-8d4b-851afb828b27 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:57.282273 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-cbb63caf-bf72-4c1d-8d4b-851afb828b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:57.290364 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 467/926] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:57 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:51:57.314502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487a7cf-7a0b-4ad9-b3d2-c0ad7d874caa None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.328544 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487a7cf-7a0b-4ad9-b3d2-c0ad7d874caa None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.333620 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad665e-674f-4357-89bb-2fdf39088c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.334931 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad665e-674f-4357-89bb-2fdf39088c62 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.335416 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad665e-674f-4357-89bb-2fdf39088c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.335882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad665e-674f-4357-89bb-2fdf39088c62 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.336747 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad665e-674f-4357-89bb-2fdf39088c62 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.338687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad665e-674f-4357-89bb-2fdf39088c62 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.344562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5663da-aa79-47f1-823d-f9fffcff3586 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.344842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5663da-aa79-47f1-823d-f9fffcff3586 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.345122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5663da-aa79-47f1-823d-f9fffcff3586 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.347320 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 468/927] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:51:57.353142 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-eaad665e-674f-4357-89bb-2fdf39088c62 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 02:51:57.353425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577f88-b339-453d-83e4-9ea7a99adc14 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.353713 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577f88-b339-453d-83e4-9ea7a99adc14 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.354011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577f88-b339-453d-83e4-9ea7a99adc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.355656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 460/928] 10.222.0.18 () {56 vars in 1153 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:57.362433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad665e-674f-4357-89bb-2fdf39088c62 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.372188 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad665e-674f-4357-89bb-2fdf39088c62 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.377038 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07269f-b3f1-49a4-91b6-1ba2e6d611f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.377182 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-9b577f88-b339-453d-83e4-9ea7a99adc14 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:57.378041 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07269f-b3f1-49a4-91b6-1ba2e6d611f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.378495 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-9b577f88-b339-453d-83e4-9ea7a99adc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:57.378724 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07269f-b3f1-49a4-91b6-1ba2e6d611f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.379184 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07269f-b3f1-49a4-91b6-1ba2e6d611f3 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.380179 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07269f-b3f1-49a4-91b6-1ba2e6d611f3 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:57.380839 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07269f-b3f1-49a4-91b6-1ba2e6d611f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.383057 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07269f-b3f1-49a4-91b6-1ba2e6d611f3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.386999 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 469/929] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:57 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:51:57.389777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 461/930] 10.222.0.18 () {56 vars in 1147 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:57.395885 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577f88-b339-453d-83e4-9ea7a99adc14 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.409368 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577f88-b339-453d-83e4-9ea7a99adc14 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.414427 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07269f-b3f1-49a4-91b6-1ba2e6d611f3 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.414566 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7dc29e-7f26-41d1-b62b-2ea3a959ab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.415224 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dc29e-7f26-41d1-b62b-2ea3a959ab75 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.415579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dc29e-7f26-41d1-b62b-2ea3a959ab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.415919 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dc29e-7f26-41d1-b62b-2ea3a959ab75 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.416717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7dc29e-7f26-41d1-b62b-2ea3a959ab75 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:57.417117 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7dc29e-7f26-41d1-b62b-2ea3a959ab75 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.418809 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7dc29e-7f26-41d1-b62b-2ea3a959ab75 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.426022 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 470/931] 10.222.0.18 () {56 vars in 1147 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:57.427557 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07269f-b3f1-49a4-91b6-1ba2e6d611f3 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.430465 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7dc29e-7f26-41d1-b62b-2ea3a959ab75 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.433788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e61f1-e1d9-4419-b026-4cb7f7ff6e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.434865 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e61f1-e1d9-4419-b026-4cb7f7ff6e94 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.435899 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e61f1-e1d9-4419-b026-4cb7f7ff6e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.436390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e61f1-e1d9-4419-b026-4cb7f7ff6e94 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.441277 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7dc29e-7f26-41d1-b62b-2ea3a959ab75 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.445898 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5151c-7016-45ec-a4f0-345ab1b2bee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.446597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5151c-7016-45ec-a4f0-345ab1b2bee5 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.446881 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5151c-7016-45ec-a4f0-345ab1b2bee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.447160 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5151c-7016-45ec-a4f0-345ab1b2bee5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.447914 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5151c-7016-45ec-a4f0-345ab1b2bee5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.449029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e61f1-e1d9-4419-b026-4cb7f7ff6e94 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:51:57.449495 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5151c-7016-45ec-a4f0-345ab1b2bee5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.457520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-de7e61f1-e1d9-4419-b026-4cb7f7ff6e94 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 02:51:57.459325 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 462/932] 10.222.0.18 () {56 vars in 1141 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:57.465762 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e61f1-e1d9-4419-b026-4cb7f7ff6e94 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.472519 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 471/933] 10.222.0.18 () {60 vars in 1165 bytes} [Wed Dec 15 02:51:57 2021] POST /identity/v3/endpoints => generated 347 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 02:51:57.477701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e61f1-e1d9-4419-b026-4cb7f7ff6e94 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.494402 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d494d-1580-408c-bc70-16492fb7b931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.495549 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d494d-1580-408c-bc70-16492fb7b931 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.496099 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d494d-1580-408c-bc70-16492fb7b931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.496592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d494d-1580-408c-bc70-16492fb7b931 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.498204 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d494d-1580-408c-bc70-16492fb7b931 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:57.498754 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d494d-1580-408c-bc70-16492fb7b931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.500742 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d494d-1580-408c-bc70-16492fb7b931 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.511172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 463/934] 10.222.0.18 () {56 vars in 1136 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:57.518084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5151c-7016-45ec-a4f0-345ab1b2bee5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.532146 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5151c-7016-45ec-a4f0-345ab1b2bee5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.537044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d759fc3-c659-401e-b53a-c4ba2345c5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.537924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d759fc3-c659-401e-b53a-c4ba2345c5da admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.538234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d759fc3-c659-401e-b53a-c4ba2345c5da admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.538557 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d759fc3-c659-401e-b53a-c4ba2345c5da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.550492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d759fc3-c659-401e-b53a-c4ba2345c5da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.552436 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d759fc3-c659-401e-b53a-c4ba2345c5da admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.574591 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-8d759fc3-c659-401e-b53a-c4ba2345c5da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:57.577128 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 472/935] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:57.583358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d494d-1580-408c-bc70-16492fb7b931 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.593754 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d494d-1580-408c-bc70-16492fb7b931 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.598468 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdc00d-dd45-420c-8c4d-6212549143ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.599130 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdc00d-dd45-420c-8c4d-6212549143ad admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.599412 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdc00d-dd45-420c-8c4d-6212549143ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.599687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdc00d-dd45-420c-8c4d-6212549143ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.600433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bdc00d-dd45-420c-8c4d-6212549143ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:57.600813 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bdc00d-dd45-420c-8c4d-6212549143ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.602462 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bdc00d-dd45-420c-8c4d-6212549143ad admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.616918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 464/936] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:57.627304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d759fc3-c659-401e-b53a-c4ba2345c5da admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.639141 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d759fc3-c659-401e-b53a-c4ba2345c5da admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.644215 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dca391-4e4b-44a6-b428-78fef1b092b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.645342 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dca391-4e4b-44a6-b428-78fef1b092b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.645819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dca391-4e4b-44a6-b428-78fef1b092b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.646339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dca391-4e4b-44a6-b428-78fef1b092b5 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.654834 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dca391-4e4b-44a6-b428-78fef1b092b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.657251 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dca391-4e4b-44a6-b428-78fef1b092b5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.673494 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-21dca391-4e4b-44a6-b428-78fef1b092b5 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 02:51:57.675381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 473/937] 10.222.0.18 () {56 vars in 1138 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:57.681892 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdc00d-dd45-420c-8c4d-6212549143ad admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.693118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdc00d-dd45-420c-8c4d-6212549143ad admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.698200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa6d5f-4bb4-4583-87c4-524e4595b374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.699191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa6d5f-4bb4-4583-87c4-524e4595b374 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.699709 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa6d5f-4bb4-4583-87c4-524e4595b374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.700179 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa6d5f-4bb4-4583-87c4-524e4595b374 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.702000 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa6d5f-4bb4-4583-87c4-524e4595b374 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:57.702552 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa6d5f-4bb4-4583-87c4-524e4595b374 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.704750 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa6d5f-4bb4-4583-87c4-524e4595b374 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.724846 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 465/938] 10.222.0.18 () {56 vars in 1170 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:57.731234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dca391-4e4b-44a6-b428-78fef1b092b5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.741313 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dca391-4e4b-44a6-b428-78fef1b092b5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.746175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac5b84-59b9-48b1-95a4-21c4c09b5f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.747074 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac5b84-59b9-48b1-95a4-21c4c09b5f0d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.748095 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac5b84-59b9-48b1-95a4-21c4c09b5f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.748589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac5b84-59b9-48b1-95a4-21c4c09b5f0d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.757079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac5b84-59b9-48b1-95a4-21c4c09b5f0d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.759386 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac5b84-59b9-48b1-95a4-21c4c09b5f0d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.762324 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7c76f-5775-4c8e-be5e-6c450f8aef6a None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.762615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7c76f-5775-4c8e-be5e-6c450f8aef6a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.762893 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7c76f-5775-4c8e-be5e-6c450f8aef6a None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.765324 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 466/939] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:51:57.770050 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 474/940] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:51:57.772032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df7815-45e2-4e72-99d3-c29e304af48a None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.772425 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df7815-45e2-4e72-99d3-c29e304af48a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.772809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df7815-45e2-4e72-99d3-c29e304af48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.776330 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac5b84-59b9-48b1-95a4-21c4c09b5f0d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.784839 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac5b84-59b9-48b1-95a4-21c4c09b5f0d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.789401 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc421d-1d57-48fa-879c-730be56646d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.790336 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc421d-1d57-48fa-879c-730be56646d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.790620 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc421d-1d57-48fa-879c-730be56646d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.790894 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc421d-1d57-48fa-879c-730be56646d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.792258 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-d4df7815-45e2-4e72-99d3-c29e304af48a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:57.793667 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d4df7815-45e2-4e72-99d3-c29e304af48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:57.801140 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc421d-1d57-48fa-879c-730be56646d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.802296 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 467/941] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:57 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:51:57.803265 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc421d-1d57-48fa-879c-730be56646d0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.820770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-94dc421d-1d57-48fa-879c-730be56646d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:51:57.826259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 475/942] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:57.830015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df7815-45e2-4e72-99d3-c29e304af48a None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.830143 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc421d-1d57-48fa-879c-730be56646d0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.839018 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc421d-1d57-48fa-879c-730be56646d0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.839890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df7815-45e2-4e72-99d3-c29e304af48a None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.843986 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62bd2f-dbe9-470e-abbf-7e0d72eb6179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.844686 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62bd2f-dbe9-470e-abbf-7e0d72eb6179 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.844966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62bd2f-dbe9-470e-abbf-7e0d72eb6179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.845243 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62bd2f-dbe9-470e-abbf-7e0d72eb6179 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.845357 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd0250-7aeb-4593-833f-70fa743f2c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.846059 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62bd2f-dbe9-470e-abbf-7e0d72eb6179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:57.846369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62bd2f-dbe9-470e-abbf-7e0d72eb6179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.846611 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd0250-7aeb-4593-833f-70fa743f2c61 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.847028 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd0250-7aeb-4593-833f-70fa743f2c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.847444 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd0250-7aeb-4593-833f-70fa743f2c61 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.847998 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62bd2f-dbe9-470e-abbf-7e0d72eb6179 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.848448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd0250-7aeb-4593-833f-70fa743f2c61 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.850911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd0250-7aeb-4593-833f-70fa743f2c61 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.860398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 476/943] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:57.864377 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-a6dd0250-7aeb-4593-833f-70fa743f2c61 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 02:51:57.870996 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 468/944] 10.222.0.18 () {56 vars in 1147 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:57.871144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62bd2f-dbe9-470e-abbf-7e0d72eb6179 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.872325 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd0250-7aeb-4593-833f-70fa743f2c61 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.877106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62bd2f-dbe9-470e-abbf-7e0d72eb6179 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.881868 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27219a75-0483-40df-9fd8-9d732203afc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.882744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27219a75-0483-40df-9fd8-9d732203afc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.883116 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27219a75-0483-40df-9fd8-9d732203afc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.883393 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27219a75-0483-40df-9fd8-9d732203afc8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.884968 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd0250-7aeb-4593-833f-70fa743f2c61 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.890329 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41052fd7-b95f-4fa5-b3e2-18c770f6ee76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.890840 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27219a75-0483-40df-9fd8-9d732203afc8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.891296 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41052fd7-b95f-4fa5-b3e2-18c770f6ee76 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.891712 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41052fd7-b95f-4fa5-b3e2-18c770f6ee76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.892121 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41052fd7-b95f-4fa5-b3e2-18c770f6ee76 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.892934 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27219a75-0483-40df-9fd8-9d732203afc8 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.893126 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41052fd7-b95f-4fa5-b3e2-18c770f6ee76 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:57.893697 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41052fd7-b95f-4fa5-b3e2-18c770f6ee76 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.896216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41052fd7-b95f-4fa5-b3e2-18c770f6ee76 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.901442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 469/945] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:57.907598 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41052fd7-b95f-4fa5-b3e2-18c770f6ee76 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.907742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-27219a75-0483-40df-9fd8-9d732203afc8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:51:57.908814 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 477/946] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:51:57.914899 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27219a75-0483-40df-9fd8-9d732203afc8 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.917482 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41052fd7-b95f-4fa5-b3e2-18c770f6ee76 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.923583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992d3f0-9dae-4fdb-abd0-facc9bc8bba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.924411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992d3f0-9dae-4fdb-abd0-facc9bc8bba9 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.924834 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992d3f0-9dae-4fdb-abd0-facc9bc8bba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.925238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992d3f0-9dae-4fdb-abd0-facc9bc8bba9 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.925639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27219a75-0483-40df-9fd8-9d732203afc8 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.926303 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992d3f0-9dae-4fdb-abd0-facc9bc8bba9 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:57.926762 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992d3f0-9dae-4fdb-abd0-facc9bc8bba9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.928760 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992d3f0-9dae-4fdb-abd0-facc9bc8bba9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.930618 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64ec01-6419-4025-ae4a-92b56ff8abd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.931265 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64ec01-6419-4025-ae4a-92b56ff8abd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.931552 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64ec01-6419-4025-ae4a-92b56ff8abd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.931859 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64ec01-6419-4025-ae4a-92b56ff8abd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.932723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64ec01-6419-4025-ae4a-92b56ff8abd3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:57.933057 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64ec01-6419-4025-ae4a-92b56ff8abd3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.934972 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64ec01-6419-4025-ae4a-92b56ff8abd3 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.945058 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 470/947] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:57.946217 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992d3f0-9dae-4fdb-abd0-facc9bc8bba9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.951626 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 478/948] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:57.957617 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64ec01-6419-4025-ae4a-92b56ff8abd3 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:57.962035 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992d3f0-9dae-4fdb-abd0-facc9bc8bba9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.967909 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64ec01-6419-4025-ae4a-92b56ff8abd3 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:57.968275 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6dadb-a41c-4920-8007-9aa0b21ebe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.969458 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6dadb-a41c-4920-8007-9aa0b21ebe99 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.969947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6dadb-a41c-4920-8007-9aa0b21ebe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.970507 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6dadb-a41c-4920-8007-9aa0b21ebe99 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.971778 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6dadb-a41c-4920-8007-9aa0b21ebe99 admin admin] RBAC: Adding query filter params (interface=public, service_id=ee292537d39b48cfa9e21bd77d78c109, region_id=RegionOne) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:57.972309 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6dadb-a41c-4920-8007-9aa0b21ebe99 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.972428 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83044207-4b8f-42c3-b0e4-d83d30c6ceb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:57.973068 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83044207-4b8f-42c3-b0e4-d83d30c6ceb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:57.973348 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83044207-4b8f-42c3-b0e4-d83d30c6ceb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:57.973623 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83044207-4b8f-42c3-b0e4-d83d30c6ceb5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:57.974503 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83044207-4b8f-42c3-b0e4-d83d30c6ceb5 admin admin] RBAC: Adding query filter params (role.id=d846ce53fbf24866ad1005504008a71d, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=39cddc4e2ea943cd882b6a1addd98e8c) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:57.974816 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83044207-4b8f-42c3-b0e4-d83d30c6ceb5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:57.975637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6dadb-a41c-4920-8007-9aa0b21ebe99 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.976626 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83044207-4b8f-42c3-b0e4-d83d30c6ceb5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:57.982860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 471/949] 10.222.0.18 () {56 vars in 1272 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/endpoints?service_id=ee292537d39b48cfa9e21bd77d78c109&interface=public®ion_id=RegionOne => generated 194 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:57.984262 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 479/950] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/role_assignments?user.id=39cddc4e2ea943cd882b6a1addd98e8c&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=d846ce53fbf24866ad1005504008a71d => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:51:57.992150 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6dadb-a41c-4920-8007-9aa0b21ebe99 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:58.002429 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6dadb-a41c-4920-8007-9aa0b21ebe99 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:58.007435 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad7388-8116-415d-aace-005a1b05b746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:58.008156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad7388-8116-415d-aace-005a1b05b746 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:58.008437 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad7388-8116-415d-aace-005a1b05b746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:58.008710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad7388-8116-415d-aace-005a1b05b746 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:58.009723 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad7388-8116-415d-aace-005a1b05b746 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:58.011452 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad7388-8116-415d-aace-005a1b05b746 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:58.018744 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 472/951] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Dec 15 02:51:57 2021] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 02:51:58.589672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23dc74-3e80-4a63-9639-e6de6d2f2537 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:58.590218 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23dc74-3e80-4a63-9639-e6de6d2f2537 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:58.590319 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23dc74-3e80-4a63-9639-e6de6d2f2537 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:58.592835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 480/952] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:58.598663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052a4ba-ead1-46dc-abb9-029f1213d715 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:58.599070 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052a4ba-ead1-46dc-abb9-029f1213d715 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:58.599300 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052a4ba-ead1-46dc-abb9-029f1213d715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:58.616830 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-1052a4ba-ead1-46dc-abb9-029f1213d715 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:58.618028 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1052a4ba-ead1-46dc-abb9-029f1213d715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:58.629679 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 473/953] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:58 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:51:58.653553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23dc74-3e80-4a63-9639-e6de6d2f2537 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:58.666443 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23dc74-3e80-4a63-9639-e6de6d2f2537 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:58.670741 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830849ca-7c9f-40ae-bb93-30e3fc06102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:58.671519 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830849ca-7c9f-40ae-bb93-30e3fc06102c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:58.671798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830849ca-7c9f-40ae-bb93-30e3fc06102c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:58.672071 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830849ca-7c9f-40ae-bb93-30e3fc06102c admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:58.672785 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830849ca-7c9f-40ae-bb93-30e3fc06102c admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:58.674398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830849ca-7c9f-40ae-bb93-30e3fc06102c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:58.685220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-830849ca-7c9f-40ae-bb93-30e3fc06102c admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 02:51:58.686643 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 481/954] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:51:58 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:51:58.692916 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052a4ba-ead1-46dc-abb9-029f1213d715 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:58.702242 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052a4ba-ead1-46dc-abb9-029f1213d715 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:58.706681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f1a4f-664f-4877-bd62-9cc3b8756f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:58.707330 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1a4f-664f-4877-bd62-9cc3b8756f5a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:58.707607 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1a4f-664f-4877-bd62-9cc3b8756f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:58.707876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1a4f-664f-4877-bd62-9cc3b8756f5a admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:58.708599 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f1a4f-664f-4877-bd62-9cc3b8756f5a admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:58.708903 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f1a4f-664f-4877-bd62-9cc3b8756f5a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:58.710565 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f1a4f-664f-4877-bd62-9cc3b8756f5a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:58.716827 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 474/955] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:51:58 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:58.723064 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830849ca-7c9f-40ae-bb93-30e3fc06102c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:58.732913 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830849ca-7c9f-40ae-bb93-30e3fc06102c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:58.737408 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0907409-f7e2-4fa1-8ec0-7d2b1d146040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:58.738090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0907409-f7e2-4fa1-8ec0-7d2b1d146040 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:58.738369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0907409-f7e2-4fa1-8ec0-7d2b1d146040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:58.738641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0907409-f7e2-4fa1-8ec0-7d2b1d146040 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:58.739354 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0907409-f7e2-4fa1-8ec0-7d2b1d146040 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:51:58.739652 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0907409-f7e2-4fa1-8ec0-7d2b1d146040 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:58.741224 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0907409-f7e2-4fa1-8ec0-7d2b1d146040 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:58.746618 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 482/956] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Dec 15 02:51:58 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:51:58.752744 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f1a4f-664f-4877-bd62-9cc3b8756f5a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:51:58.762643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f1a4f-664f-4877-bd62-9cc3b8756f5a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:51:58.767718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe212f9-3d4c-49d6-a4c0-0752035d320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:51:58.768361 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe212f9-3d4c-49d6-a4c0-0752035d320e admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:58.768636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe212f9-3d4c-49d6-a4c0-0752035d320e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:58.768958 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe212f9-3d4c-49d6-a4c0-0752035d320e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:58.769713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe212f9-3d4c-49d6-a4c0-0752035d320e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:51:58.771416 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe212f9-3d4c-49d6-a4c0-0752035d320e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:51:58.793758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 475/957] 10.222.0.18 () {60 vars in 1165 bytes} [Wed Dec 15 02:51:58 2021] POST /identity/v3/endpoints => generated 346 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 02:51:59.942026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c5c21-115f-44e2-9ef9-d1fbb876c307 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:59.942567 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c5c21-115f-44e2-9ef9-d1fbb876c307 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:59.942567 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c5c21-115f-44e2-9ef9-d1fbb876c307 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:59.944624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 483/958] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:51:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:51:59.952616 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb560a-ccc4-4441-ae28-b625d7beb027 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:51:59.952616 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb560a-ccc4-4441-ae28-b625d7beb027 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:51:59.952616 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb560a-ccc4-4441-ae28-b625d7beb027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:51:59.971166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-a6fb560a-ccc4-4441-ae28-b625d7beb027 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:51:59.972769 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-a6fb560a-ccc4-4441-ae28-b625d7beb027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:51:59.991137 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 476/959] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:51:59 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:00.014843 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c5c21-115f-44e2-9ef9-d1fbb876c307 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:00.027665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c5c21-115f-44e2-9ef9-d1fbb876c307 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:00.032949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bccbbf-d12b-40ff-88a7-a57d0f7ab37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:00.033760 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bccbbf-d12b-40ff-88a7-a57d0f7ab37d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:00.034090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bccbbf-d12b-40ff-88a7-a57d0f7ab37d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:00.034364 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bccbbf-d12b-40ff-88a7-a57d0f7ab37d admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:00.035050 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bccbbf-d12b-40ff-88a7-a57d0f7ab37d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:00.036725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bccbbf-d12b-40ff-88a7-a57d0f7ab37d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:00.049306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-00bccbbf-d12b-40ff-88a7-a57d0f7ab37d admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 02:52:00.056294 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 484/960] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:52:00 2021] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:00.057817 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb560a-ccc4-4441-ae28-b625d7beb027 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:00.067288 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb560a-ccc4-4441-ae28-b625d7beb027 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:00.072054 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d26a4-e165-47dc-9688-2286cf887aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:00.072720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d26a4-e165-47dc-9688-2286cf887aba admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:00.073000 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d26a4-e165-47dc-9688-2286cf887aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:00.073273 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d26a4-e165-47dc-9688-2286cf887aba admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:00.074020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d26a4-e165-47dc-9688-2286cf887aba admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:00.074347 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d26a4-e165-47dc-9688-2286cf887aba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:00.076556 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d26a4-e165-47dc-9688-2286cf887aba admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:00.082143 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 477/961] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Dec 15 02:52:00 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:00.088144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bccbbf-d12b-40ff-88a7-a57d0f7ab37d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:00.099865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bccbbf-d12b-40ff-88a7-a57d0f7ab37d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:00.104660 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2fe84-8034-4c03-b316-8b5d5564f084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:00.105559 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2fe84-8034-4c03-b316-8b5d5564f084 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:00.106076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2fe84-8034-4c03-b316-8b5d5564f084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:00.106576 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2fe84-8034-4c03-b316-8b5d5564f084 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:00.107521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2fe84-8034-4c03-b316-8b5d5564f084 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:00.108026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2fe84-8034-4c03-b316-8b5d5564f084 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:00.109827 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2fe84-8034-4c03-b316-8b5d5564f084 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:00.122133 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 485/962] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Dec 15 02:52:00 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:00.433557 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e94218-c06f-4d79-b79e-df11a248289d None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:00.433877 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e94218-c06f-4d79-b79e-df11a248289d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:00.434148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e94218-c06f-4d79-b79e-df11a248289d None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:00.436669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 478/963] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:00.444274 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4f1c8-c5b3-4982-8757-6671a9206971 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:00.444865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4f1c8-c5b3-4982-8757-6671a9206971 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:00.445342 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4f1c8-c5b3-4982-8757-6671a9206971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:00.472150 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1078d19-94fc-465a-a425-73789e88a3d5 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:00.472332 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1078d19-94fc-465a-a425-73789e88a3d5 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:00.472611 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1078d19-94fc-465a-a425-73789e88a3d5 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:00.474321 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-daa4f1c8-c5b3-4982-8757-6671a9206971 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:00.474638 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 479/964] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:00.476247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-daa4f1c8-c5b3-4982-8757-6671a9206971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:00.481577 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120f4e-564a-4132-985c-03837e277c75 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:00.481905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120f4e-564a-4132-985c-03837e277c75 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:00.482205 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120f4e-564a-4132-985c-03837e277c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:00.485628 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 486/965] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:00 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:00.508589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4f1c8-c5b3-4982-8757-6671a9206971 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:00.534004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-b8120f4e-564a-4132-985c-03837e277c75 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:00.534004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b8120f4e-564a-4132-985c-03837e277c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:00.534279 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4f1c8-c5b3-4982-8757-6671a9206971 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:00.534570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262b908-8da6-4cb0-a3ea-c33234ad2896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:00.535233 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262b908-8da6-4cb0-a3ea-c33234ad2896 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:00.535511 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 480/966] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:00 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:00.536592 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262b908-8da6-4cb0-a3ea-c33234ad2896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:00.536874 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262b908-8da6-4cb0-a3ea-c33234ad2896 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:00.537541 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262b908-8da6-4cb0-a3ea-c33234ad2896 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:00.545154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262b908-8da6-4cb0-a3ea-c33234ad2896 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:00.560796 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-2262b908-8da6-4cb0-a3ea-c33234ad2896 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 02:52:00.562053 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8120f4e-564a-4132-985c-03837e277c75 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:00.562343 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 487/967] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Dec 15 02:52:00 2021] GET /identity/v3/services/image => generated 86 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:52:00.568697 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262b908-8da6-4cb0-a3ea-c33234ad2896 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:00.572240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8120f4e-564a-4132-985c-03837e277c75 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:00.579126 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262b908-8da6-4cb0-a3ea-c33234ad2896 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:00.584047 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc298f-0219-4424-bce9-4fb5ac9a99f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:00.585577 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc298f-0219-4424-bce9-4fb5ac9a99f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:00.586919 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc298f-0219-4424-bce9-4fb5ac9a99f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:00.587985 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc298f-0219-4424-bce9-4fb5ac9a99f7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:00.588744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6bc3e-9540-4cd5-9e68-9bfa8ce887ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:00.589650 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc298f-0219-4424-bce9-4fb5ac9a99f7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:00.591656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6bc3e-9540-4cd5-9e68-9bfa8ce887ce admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:00.592162 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6bc3e-9540-4cd5-9e68-9bfa8ce887ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:00.592642 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6bc3e-9540-4cd5-9e68-9bfa8ce887ce admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:00.593463 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc298f-0219-4424-bce9-4fb5ac9a99f7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:00.594436 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6bc3e-9540-4cd5-9e68-9bfa8ce887ce admin admin] RBAC: Adding query filter params (name=image) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:00.595355 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6bc3e-9540-4cd5-9e68-9bfa8ce887ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:00.599137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6bc3e-9540-4cd5-9e68-9bfa8ce887ce admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:00.604992 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 488/968] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:00 2021] GET /identity/v3/services?name=image => generated 122 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:00.614062 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-4dcc298f-0219-4424-bce9-4fb5ac9a99f7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 02:52:00.614062 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 481/969] 10.222.0.18 () {56 vars in 1147 bytes} [Wed Dec 15 02:52:00 2021] GET /identity/v3/services/object-store => generated 93 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:00.615689 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6bc3e-9540-4cd5-9e68-9bfa8ce887ce admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:00.621891 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc298f-0219-4424-bce9-4fb5ac9a99f7 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:00.630987 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6bc3e-9540-4cd5-9e68-9bfa8ce887ce admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:00.635902 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc298f-0219-4424-bce9-4fb5ac9a99f7 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:00.637016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5580a10-9eba-43b5-86f5-51e4db757947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:00.637856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5580a10-9eba-43b5-86f5-51e4db757947 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:00.639000 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5580a10-9eba-43b5-86f5-51e4db757947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:00.639462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5580a10-9eba-43b5-86f5-51e4db757947 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:00.640432 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5580a10-9eba-43b5-86f5-51e4db757947 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:00.640920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5580a10-9eba-43b5-86f5-51e4db757947 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:00.641574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6afe3-8754-41d6-b749-9145fcb4ce4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:00.642327 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6afe3-8754-41d6-b749-9145fcb4ce4b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:00.642663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6afe3-8754-41d6-b749-9145fcb4ce4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:00.643007 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6afe3-8754-41d6-b749-9145fcb4ce4b admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:00.643636 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5580a10-9eba-43b5-86f5-51e4db757947 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:00.643786 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6afe3-8754-41d6-b749-9145fcb4ce4b admin admin] RBAC: Adding query filter params (type=image) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:00.644200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6afe3-8754-41d6-b749-9145fcb4ce4b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:00.646480 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6afe3-8754-41d6-b749-9145fcb4ce4b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:00.654676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 482/971] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:00 2021] GET /identity/v3/services?type=image => generated 122 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:00.654841 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 489/971] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Dec 15 02:52:00 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:00.659270 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6afe3-8754-41d6-b749-9145fcb4ce4b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:00.679529 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6afe3-8754-41d6-b749-9145fcb4ce4b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:00.691519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a78df-9201-41bd-aba6-fcf5e9b50669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:00.692587 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a78df-9201-41bd-aba6-fcf5e9b50669 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:00.693088 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a78df-9201-41bd-aba6-fcf5e9b50669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:00.693611 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a78df-9201-41bd-aba6-fcf5e9b50669 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:00.694582 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a78df-9201-41bd-aba6-fcf5e9b50669 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:00.695144 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a78df-9201-41bd-aba6-fcf5e9b50669 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:00.696998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a78df-9201-41bd-aba6-fcf5e9b50669 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:00.711045 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 483/972] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Dec 15 02:52:00 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:00.721692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5580a10-9eba-43b5-86f5-51e4db757947 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:00.740354 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5580a10-9eba-43b5-86f5-51e4db757947 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:00.745477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b61d5c-1dc3-48fb-aaec-67e67ca5bf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:00.746153 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b61d5c-1dc3-48fb-aaec-67e67ca5bf4b admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:00.746436 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b61d5c-1dc3-48fb-aaec-67e67ca5bf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:00.746714 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b61d5c-1dc3-48fb-aaec-67e67ca5bf4b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:00.748012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b61d5c-1dc3-48fb-aaec-67e67ca5bf4b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:00.749589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b61d5c-1dc3-48fb-aaec-67e67ca5bf4b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:00.809534 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 490/973] 10.222.0.18 () {60 vars in 1165 bytes} [Wed Dec 15 02:52:00 2021] POST /identity/v3/endpoints => generated 349 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:52:01.274502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260418eb-54cd-41df-a36b-e0725f159db7 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:01.275019 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260418eb-54cd-41df-a36b-e0725f159db7 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:01.275266 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260418eb-54cd-41df-a36b-e0725f159db7 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:01.277152 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 484/974] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:01.283472 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2a7bb-bd2c-47b6-884c-18e90b0b43d8 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:01.283867 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2a7bb-bd2c-47b6-884c-18e90b0b43d8 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:01.284087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2a7bb-bd2c-47b6-884c-18e90b0b43d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:01.302338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-e6e2a7bb-bd2c-47b6-884c-18e90b0b43d8 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:01.303507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e6e2a7bb-bd2c-47b6-884c-18e90b0b43d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:01.320222 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 491/975] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:01 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:52:01.344979 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260418eb-54cd-41df-a36b-e0725f159db7 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:01.357833 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260418eb-54cd-41df-a36b-e0725f159db7 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:01.362220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c2f37-732c-40e4-8ad1-c572c227cd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:01.362826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c2f37-732c-40e4-8ad1-c572c227cd49 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:01.363105 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c2f37-732c-40e4-8ad1-c572c227cd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:01.363381 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c2f37-732c-40e4-8ad1-c572c227cd49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:01.364087 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c2f37-732c-40e4-8ad1-c572c227cd49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:01.365915 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c2f37-732c-40e4-8ad1-c572c227cd49 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:01.367272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.common [None req-5f5c2f37-732c-40e4-8ad1-c572c227cd49 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 15 02:52:01.388463 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.sql.core [None req-5f5c2f37-732c-40e4-8ad1-c572c227cd49 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Dec 15 02:52:01.388463 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 15 02:52:01.388463 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [parameters: {'id': 'c32f215dcdb94872846a1fad158af796', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 15 02:52:01.388463 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79172) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 02:52:01.404814 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-5f5c2f37-732c-40e4-8ad1-c572c227cd49 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c32f215dcdb94872846a1fad158af796.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c32f215dcdb94872846a1fad158af796. Dec 15 02:52:01.406213 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 485/976] 10.222.0.18 () {60 vars in 1161 bytes} [Wed Dec 15 02:52:01 2021] POST /identity/v3/projects => generated 262 bytes in 62 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:01.412831 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2a7bb-bd2c-47b6-884c-18e90b0b43d8 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:01.422536 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2a7bb-bd2c-47b6-884c-18e90b0b43d8 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:01.427091 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24df9b-bb3b-499b-aa69-f1f1364d06dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:01.427860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24df9b-bb3b-499b-aa69-f1f1364d06dc admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:01.428138 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24df9b-bb3b-499b-aa69-f1f1364d06dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:01.428408 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24df9b-bb3b-499b-aa69-f1f1364d06dc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:01.435435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24df9b-bb3b-499b-aa69-f1f1364d06dc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:01.437352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24df9b-bb3b-499b-aa69-f1f1364d06dc admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:01.450341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-0e24df9b-bb3b-499b-aa69-f1f1364d06dc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:52:01.451865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 492/977] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:52:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:01.458256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c2f37-732c-40e4-8ad1-c572c227cd49 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:01.468884 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c2f37-732c-40e4-8ad1-c572c227cd49 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:01.473351 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab577b45-de76-4172-802e-3d6a8f655929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:01.473990 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab577b45-de76-4172-802e-3d6a8f655929 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:01.474280 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab577b45-de76-4172-802e-3d6a8f655929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:01.474551 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab577b45-de76-4172-802e-3d6a8f655929 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:01.475315 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab577b45-de76-4172-802e-3d6a8f655929 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:01.475618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab577b45-de76-4172-802e-3d6a8f655929 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:01.477682 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab577b45-de76-4172-802e-3d6a8f655929 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:01.501426 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 486/978] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Dec 15 02:52:01 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:02.599420 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304ed74-74b7-4300-8709-414d3d37859d None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:02.599977 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304ed74-74b7-4300-8709-414d3d37859d None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:02.599977 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304ed74-74b7-4300-8709-414d3d37859d None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:02.602016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 493/979] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:02.608102 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dacd23-73cf-43ae-9839-91322c981c28 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:02.608540 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dacd23-73cf-43ae-9839-91322c981c28 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:02.608756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dacd23-73cf-43ae-9839-91322c981c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:02.627018 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c5dacd23-73cf-43ae-9839-91322c981c28 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:02.628524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c5dacd23-73cf-43ae-9839-91322c981c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:02.636632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 487/980] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:02 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:02.661522 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304ed74-74b7-4300-8709-414d3d37859d None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:02.674524 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304ed74-74b7-4300-8709-414d3d37859d None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:02.678942 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba3641-425b-401a-b595-13a99a3ff943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:02.679583 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba3641-425b-401a-b595-13a99a3ff943 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:02.679861 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba3641-425b-401a-b595-13a99a3ff943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:02.680134 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba3641-425b-401a-b595-13a99a3ff943 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:02.680867 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba3641-425b-401a-b595-13a99a3ff943 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:02.682478 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba3641-425b-401a-b595-13a99a3ff943 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:02.706175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 494/981] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Dec 15 02:52:02 2021] POST /identity/v3/services => generated 242 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:52:03.190145 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e88dc-1ee1-426c-8964-f7de76bf6be9 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:03.190552 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e88dc-1ee1-426c-8964-f7de76bf6be9 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:03.190751 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e88dc-1ee1-426c-8964-f7de76bf6be9 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:03.192740 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 488/982] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:03.208304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66d482-b5de-44fd-ae2a-5ea3f57e84ab None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:03.208823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66d482-b5de-44fd-ae2a-5ea3f57e84ab None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:03.209326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66d482-b5de-44fd-ae2a-5ea3f57e84ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:03.213416 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8c6eb-0877-489a-8482-3626f1c1f82a None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:03.213699 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8c6eb-0877-489a-8482-3626f1c1f82a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:03.213970 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8c6eb-0877-489a-8482-3626f1c1f82a None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:03.216020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 489/983] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:52:03.221281 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad151da1-2b78-4243-a44d-2a523e56b8c0 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:03.221587 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad151da1-2b78-4243-a44d-2a523e56b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:03.221827 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad151da1-2b78-4243-a44d-2a523e56b8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:03.230116 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-0a66d482-b5de-44fd-ae2a-5ea3f57e84ab None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:03.231533 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-0a66d482-b5de-44fd-ae2a-5ea3f57e84ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:03.239826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-ad151da1-2b78-4243-a44d-2a523e56b8c0 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:03.240962 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-ad151da1-2b78-4243-a44d-2a523e56b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:03.249545 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 495/984] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:03 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:03.258350 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 490/985] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:03 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:52:03.273467 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66d482-b5de-44fd-ae2a-5ea3f57e84ab None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:03.282374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad151da1-2b78-4243-a44d-2a523e56b8c0 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:03.282984 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66d482-b5de-44fd-ae2a-5ea3f57e84ab None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:03.287712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3caec-f50c-42d4-8ffe-fba422b4ca5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:03.288576 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3caec-f50c-42d4-8ffe-fba422b4ca5d admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:03.289046 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3caec-f50c-42d4-8ffe-fba422b4ca5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:03.289500 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3caec-f50c-42d4-8ffe-fba422b4ca5d admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:03.290462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3caec-f50c-42d4-8ffe-fba422b4ca5d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:03.291907 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad151da1-2b78-4243-a44d-2a523e56b8c0 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:03.292412 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3caec-f50c-42d4-8ffe-fba422b4ca5d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:03.297029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb881f89-70b4-4b5c-a1f3-3a8142cd1892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:03.298086 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb881f89-70b4-4b5c-a1f3-3a8142cd1892 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:03.298472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb881f89-70b4-4b5c-a1f3-3a8142cd1892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:03.298566 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb881f89-70b4-4b5c-a1f3-3a8142cd1892 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:03.299256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb881f89-70b4-4b5c-a1f3-3a8142cd1892 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:03.300944 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb881f89-70b4-4b5c-a1f3-3a8142cd1892 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:03.309077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 496/986] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Dec 15 02:52:03 2021] POST /identity/v3/services => generated 242 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:52:03.313396 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-cb881f89-70b4-4b5c-a1f3-3a8142cd1892 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 02:52:03.315027 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 491/987] 10.222.0.18 () {56 vars in 1147 bytes} [Wed Dec 15 02:52:03 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:52:03.321785 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3caec-f50c-42d4-8ffe-fba422b4ca5d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:03.351512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3caec-f50c-42d4-8ffe-fba422b4ca5d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:03.357223 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9ce5a-6755-4c6d-afd4-20e9520621df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:03.358386 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9ce5a-6755-4c6d-afd4-20e9520621df admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:03.358868 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9ce5a-6755-4c6d-afd4-20e9520621df admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:03.359338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9ce5a-6755-4c6d-afd4-20e9520621df admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:03.360284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9ce5a-6755-4c6d-afd4-20e9520621df admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:03.360842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9ce5a-6755-4c6d-afd4-20e9520621df admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:03.362768 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9ce5a-6755-4c6d-afd4-20e9520621df admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:03.368957 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 497/988] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Dec 15 02:52:03 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:03.376526 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb881f89-70b4-4b5c-a1f3-3a8142cd1892 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:03.387909 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb881f89-70b4-4b5c-a1f3-3a8142cd1892 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:03.393519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541c048-9103-4e4e-af6d-691b5b2cd917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:03.394705 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541c048-9103-4e4e-af6d-691b5b2cd917 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:03.395215 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541c048-9103-4e4e-af6d-691b5b2cd917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:03.395697 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541c048-9103-4e4e-af6d-691b5b2cd917 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:03.396619 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541c048-9103-4e4e-af6d-691b5b2cd917 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:03.397171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541c048-9103-4e4e-af6d-691b5b2cd917 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:03.399147 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541c048-9103-4e4e-af6d-691b5b2cd917 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:03.405723 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 492/989] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Dec 15 02:52:03 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:03.412717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9ce5a-6755-4c6d-afd4-20e9520621df admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:03.424391 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9ce5a-6755-4c6d-afd4-20e9520621df admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:03.429581 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ca8d3-e52d-4f5f-a12a-cbbcb21faec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:03.430654 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ca8d3-e52d-4f5f-a12a-cbbcb21faec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:03.431133 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ca8d3-e52d-4f5f-a12a-cbbcb21faec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:03.431636 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ca8d3-e52d-4f5f-a12a-cbbcb21faec9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:03.432729 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ca8d3-e52d-4f5f-a12a-cbbcb21faec9 admin admin] RBAC: Adding query filter params (interface=admin, service_id=ee292537d39b48cfa9e21bd77d78c109, region_id=RegionOne) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:03.433259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ca8d3-e52d-4f5f-a12a-cbbcb21faec9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:03.435729 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ca8d3-e52d-4f5f-a12a-cbbcb21faec9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:03.442639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 498/990] 10.222.0.18 () {56 vars in 1270 bytes} [Wed Dec 15 02:52:03 2021] GET /identity/v3/endpoints?service_id=ee292537d39b48cfa9e21bd77d78c109&interface=admin®ion_id=RegionOne => generated 193 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:03.449214 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541c048-9103-4e4e-af6d-691b5b2cd917 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:03.460150 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541c048-9103-4e4e-af6d-691b5b2cd917 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:03.465545 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464882f-b5a3-4546-b25a-b09921b005a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:03.467367 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464882f-b5a3-4546-b25a-b09921b005a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:03.467847 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464882f-b5a3-4546-b25a-b09921b005a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:03.468362 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464882f-b5a3-4546-b25a-b09921b005a6 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:03.469273 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464882f-b5a3-4546-b25a-b09921b005a6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:03.471282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464882f-b5a3-4546-b25a-b09921b005a6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:03.479333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 493/991] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Dec 15 02:52:03 2021] GET /identity/v3/services => generated 1957 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 02:52:03.974158 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c47ceb-9347-4a5e-84ca-e1cf81fa8038 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:03.975172 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c47ceb-9347-4a5e-84ca-e1cf81fa8038 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:03.975656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c47ceb-9347-4a5e-84ca-e1cf81fa8038 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:03.977865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 499/992] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:03.983317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5efe7-626b-4349-ae1c-ed24e0a93a2a None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:03.983716 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5efe7-626b-4349-ae1c-ed24e0a93a2a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:03.983904 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5efe7-626b-4349-ae1c-ed24e0a93a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:04.001456 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-67f5efe7-626b-4349-ae1c-ed24e0a93a2a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:04.002686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-67f5efe7-626b-4349-ae1c-ed24e0a93a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:04.010675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 494/993] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:03 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:52:04.036884 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c47ceb-9347-4a5e-84ca-e1cf81fa8038 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:04.049045 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c47ceb-9347-4a5e-84ca-e1cf81fa8038 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:04.053365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0ce0-7f5a-49aa-a68b-e330451882f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:04.054045 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0ce0-7f5a-49aa-a68b-e330451882f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:04.054327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0ce0-7f5a-49aa-a68b-e330451882f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:04.054599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0ce0-7f5a-49aa-a68b-e330451882f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:04.055316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0ce0-7f5a-49aa-a68b-e330451882f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:04.057122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0ce0-7f5a-49aa-a68b-e330451882f1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:04.058430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.common [None req-a21e0ce0-7f5a-49aa-a68b-e330451882f1 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 15 02:52:04.071782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.sql.core [None req-a21e0ce0-7f5a-49aa-a68b-e330451882f1 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Dec 15 02:52:04.071782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Dec 15 02:52:04.071782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [parameters: {'user_id': '4cacb923459f417b851615546244e61e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Dec 15 02:52:04.071782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79173) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 02:52:04.078371 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-a21e0ce0-7f5a-49aa-a68b-e330451882f1 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Dec 15 02:52:04.079896 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 500/994] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 02:52:04 2021] POST /identity/v3/users => generated 160 bytes in 43 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:04.086432 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5efe7-626b-4349-ae1c-ed24e0a93a2a None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:04.096152 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5efe7-626b-4349-ae1c-ed24e0a93a2a None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:04.100797 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bd36e-6587-472b-bd28-fc6201b44a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:04.101567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bd36e-6587-472b-bd28-fc6201b44a4f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:04.101884 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bd36e-6587-472b-bd28-fc6201b44a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:04.102180 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bd36e-6587-472b-bd28-fc6201b44a4f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:04.109890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883bd36e-6587-472b-bd28-fc6201b44a4f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:04.111983 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883bd36e-6587-472b-bd28-fc6201b44a4f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:04.126405 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-883bd36e-6587-472b-bd28-fc6201b44a4f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 02:52:04.127887 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 495/995] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:52:04 2021] GET /identity/v3/users/cinder => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:04.134816 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0ce0-7f5a-49aa-a68b-e330451882f1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:04.146294 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0ce0-7f5a-49aa-a68b-e330451882f1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:04.150994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3b322-4ab5-4fe2-9670-69d1e2673468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:04.151684 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3b322-4ab5-4fe2-9670-69d1e2673468 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:04.151963 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3b322-4ab5-4fe2-9670-69d1e2673468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:04.152237 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3b322-4ab5-4fe2-9670-69d1e2673468 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:04.153042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3b322-4ab5-4fe2-9670-69d1e2673468 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:04.154051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3b322-4ab5-4fe2-9670-69d1e2673468 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:04.156157 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3b322-4ab5-4fe2-9670-69d1e2673468 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:04.196947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 501/996] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Dec 15 02:52:04 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:05.112837 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6c06a-1e3d-4b09-811f-a63816db7ef9 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.113389 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6c06a-1e3d-4b09-811f-a63816db7ef9 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.113389 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6c06a-1e3d-4b09-811f-a63816db7ef9 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.115300 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 496/997] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:05.120828 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeed68-772c-4887-aa07-3c2e56c45209 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.121302 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeed68-772c-4887-aa07-3c2e56c45209 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.121455 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeed68-772c-4887-aa07-3c2e56c45209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.140238 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-3beeed68-772c-4887-aa07-3c2e56c45209 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:05.141723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3beeed68-772c-4887-aa07-3c2e56c45209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:05.149316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 502/998] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:05 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:05.173205 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6c06a-1e3d-4b09-811f-a63816db7ef9 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:05.185157 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6c06a-1e3d-4b09-811f-a63816db7ef9 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:05.189427 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b715b4b-969a-4337-9c0e-88fbd874f854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:05.190298 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b715b4b-969a-4337-9c0e-88fbd874f854 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.190577 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b715b4b-969a-4337-9c0e-88fbd874f854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.190847 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b715b4b-969a-4337-9c0e-88fbd874f854 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.191522 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b715b4b-969a-4337-9c0e-88fbd874f854 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:05.193106 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b715b4b-969a-4337-9c0e-88fbd874f854 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:05.203844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-8b715b4b-969a-4337-9c0e-88fbd874f854 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 02:52:05.210052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 497/999] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:52:05 2021] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:05.211284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeed68-772c-4887-aa07-3c2e56c45209 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:05.220694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeed68-772c-4887-aa07-3c2e56c45209 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:05.225164 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b47da-5934-451c-b60c-8820814a52cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:05.225812 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b47da-5934-451c-b60c-8820814a52cf admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.226131 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b47da-5934-451c-b60c-8820814a52cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.226411 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b47da-5934-451c-b60c-8820814a52cf admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.227129 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b47da-5934-451c-b60c-8820814a52cf admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:05.227434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b47da-5934-451c-b60c-8820814a52cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:05.229031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b47da-5934-451c-b60c-8820814a52cf admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:05.234589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 503/1000] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Dec 15 02:52:05 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:05.240292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b715b4b-969a-4337-9c0e-88fbd874f854 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:05.249727 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b715b4b-969a-4337-9c0e-88fbd874f854 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:05.254183 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098d1c8-fc26-44dc-a981-9035cc1f931a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:05.254819 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098d1c8-fc26-44dc-a981-9035cc1f931a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.255094 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098d1c8-fc26-44dc-a981-9035cc1f931a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.255362 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098d1c8-fc26-44dc-a981-9035cc1f931a admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.256063 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098d1c8-fc26-44dc-a981-9035cc1f931a admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:05.256361 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098d1c8-fc26-44dc-a981-9035cc1f931a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:05.257921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098d1c8-fc26-44dc-a981-9035cc1f931a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:05.263159 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 498/1001] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Dec 15 02:52:05 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:05.269218 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b47da-5934-451c-b60c-8820814a52cf admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:05.279122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b47da-5934-451c-b60c-8820814a52cf admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:05.283434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1101ba-fe0e-43d5-937d-6cbdcc675c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:05.284063 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1101ba-fe0e-43d5-937d-6cbdcc675c57 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.284334 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1101ba-fe0e-43d5-937d-6cbdcc675c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.284600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1101ba-fe0e-43d5-937d-6cbdcc675c57 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.285386 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1101ba-fe0e-43d5-937d-6cbdcc675c57 admin admin] RBAC: Adding query filter params (interface=public, service_id=a9aa143007a94b2b92d2dfd762f8f8bb, region_id=RegionOne) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:05.285688 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1101ba-fe0e-43d5-937d-6cbdcc675c57 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:05.287281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1101ba-fe0e-43d5-937d-6cbdcc675c57 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:05.292431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 504/1002] 10.222.0.18 () {56 vars in 1272 bytes} [Wed Dec 15 02:52:05 2021] GET /identity/v3/endpoints?service_id=a9aa143007a94b2b92d2dfd762f8f8bb&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:05.298790 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098d1c8-fc26-44dc-a981-9035cc1f931a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:05.308330 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098d1c8-fc26-44dc-a981-9035cc1f931a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:05.312913 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5f632-b3f8-40f2-8124-fd62b5497969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:05.313558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5f632-b3f8-40f2-8124-fd62b5497969 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.313935 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5f632-b3f8-40f2-8124-fd62b5497969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.314259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5f632-b3f8-40f2-8124-fd62b5497969 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.314952 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5f632-b3f8-40f2-8124-fd62b5497969 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:05.316532 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5f632-b3f8-40f2-8124-fd62b5497969 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:05.323460 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 499/1003] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Dec 15 02:52:05 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 02:52:05.737712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dd518-994f-4ca9-b95e-d9f605a0c26c None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.738111 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dd518-994f-4ca9-b95e-d9f605a0c26c None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.738307 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dd518-994f-4ca9-b95e-d9f605a0c26c None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.740063 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 505/1004] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:05.745840 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84db9e-10e5-4cc7-ad9a-42652fdc06cd None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.746196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84db9e-10e5-4cc7-ad9a-42652fdc06cd None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.746479 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84db9e-10e5-4cc7-ad9a-42652fdc06cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.767350 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-2a84db9e-10e5-4cc7-ad9a-42652fdc06cd None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:05.768539 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-2a84db9e-10e5-4cc7-ad9a-42652fdc06cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:05.776232 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 500/1005] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:05 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:52:05.799588 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dd518-994f-4ca9-b95e-d9f605a0c26c None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:05.811909 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dd518-994f-4ca9-b95e-d9f605a0c26c None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:05.816213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191dd20-c362-456a-8353-f8fe54c58533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:05.816976 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191dd20-c362-456a-8353-f8fe54c58533 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.817254 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191dd20-c362-456a-8353-f8fe54c58533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.817523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191dd20-c362-456a-8353-f8fe54c58533 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.818213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191dd20-c362-456a-8353-f8fe54c58533 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:05.819798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191dd20-c362-456a-8353-f8fe54c58533 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:05.831016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-0191dd20-c362-456a-8353-f8fe54c58533 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 02:52:05.832304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 506/1006] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Dec 15 02:52:05 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:05.838480 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84db9e-10e5-4cc7-ad9a-42652fdc06cd None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:05.847315 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84db9e-10e5-4cc7-ad9a-42652fdc06cd None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:05.851707 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947218c-4cb0-4c03-8a99-8485f8a1cf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:05.852343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947218c-4cb0-4c03-8a99-8485f8a1cf1e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.852620 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947218c-4cb0-4c03-8a99-8485f8a1cf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.852888 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947218c-4cb0-4c03-8a99-8485f8a1cf1e admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.853597 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947218c-4cb0-4c03-8a99-8485f8a1cf1e admin admin] RBAC: Adding query filter params (name=image) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:05.853897 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947218c-4cb0-4c03-8a99-8485f8a1cf1e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:05.855493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947218c-4cb0-4c03-8a99-8485f8a1cf1e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:05.860343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 501/1007] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:05 2021] GET /identity/v3/services?name=image => generated 122 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:05.866046 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191dd20-c362-456a-8353-f8fe54c58533 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:05.875940 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191dd20-c362-456a-8353-f8fe54c58533 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:05.880387 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8cd06-5f03-4f63-b338-4e6ebaeb61d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:05.881027 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8cd06-5f03-4f63-b338-4e6ebaeb61d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.881305 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8cd06-5f03-4f63-b338-4e6ebaeb61d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.881578 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8cd06-5f03-4f63-b338-4e6ebaeb61d9 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.882340 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8cd06-5f03-4f63-b338-4e6ebaeb61d9 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:05.882641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8cd06-5f03-4f63-b338-4e6ebaeb61d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:05.884466 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8cd06-5f03-4f63-b338-4e6ebaeb61d9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:05.889875 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 507/1008] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:05 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:05.895798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947218c-4cb0-4c03-8a99-8485f8a1cf1e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:05.900371 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b23554-f52b-4a14-a279-8313daf59729 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.900845 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b23554-f52b-4a14-a279-8313daf59729 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.901347 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b23554-f52b-4a14-a279-8313daf59729 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.903545 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 508/1009] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:52:05.905283 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947218c-4cb0-4c03-8a99-8485f8a1cf1e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:05.909083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfafdd-e09f-422b-b0ef-440a4eb7c5ee None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.909573 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfafdd-e09f-422b-b0ef-440a4eb7c5ee None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.909842 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3fa55-4579-4b27-9710-197a12c45ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:05.910291 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfafdd-e09f-422b-b0ef-440a4eb7c5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.910497 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3fa55-4579-4b27-9710-197a12c45ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.910781 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3fa55-4579-4b27-9710-197a12c45ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.911055 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3fa55-4579-4b27-9710-197a12c45ca8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.911846 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3fa55-4579-4b27-9710-197a12c45ca8 admin admin] RBAC: Adding query filter params (interface=public, service_id=2f59043a2da44223846f1dd86df081b6, region_id=RegionOne) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:05.912157 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3fa55-4579-4b27-9710-197a12c45ca8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:05.913713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3fa55-4579-4b27-9710-197a12c45ca8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:05.919179 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 502/1010] 10.222.0.18 () {56 vars in 1272 bytes} [Wed Dec 15 02:52:05 2021] GET /identity/v3/endpoints?service_id=2f59043a2da44223846f1dd86df081b6&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:05.925080 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3fa55-4579-4b27-9710-197a12c45ca8 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:05.929625 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-51dfafdd-e09f-422b-b0ef-440a4eb7c5ee None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:05.930808 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-51dfafdd-e09f-422b-b0ef-440a4eb7c5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:05.934413 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3fa55-4579-4b27-9710-197a12c45ca8 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:05.939114 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 509/1011] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:05 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:05.939360 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d8b56-01bd-4c33-856e-c53833864c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:05.939983 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d8b56-01bd-4c33-856e-c53833864c96 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.940369 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d8b56-01bd-4c33-856e-c53833864c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.940636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d8b56-01bd-4c33-856e-c53833864c96 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.941311 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d8b56-01bd-4c33-856e-c53833864c96 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:05.942887 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d8b56-01bd-4c33-856e-c53833864c96 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:05.954328 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 503/1012] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Dec 15 02:52:05 2021] GET /identity/v3/services => generated 1957 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 02:52:05.965123 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfafdd-e09f-422b-b0ef-440a4eb7c5ee None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:05.974640 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfafdd-e09f-422b-b0ef-440a4eb7c5ee None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:05.979415 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49372fa-453e-4617-aab6-402722d28385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:05.980269 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49372fa-453e-4617-aab6-402722d28385 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:05.980547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49372fa-453e-4617-aab6-402722d28385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:05.980819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49372fa-453e-4617-aab6-402722d28385 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:05.981532 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49372fa-453e-4617-aab6-402722d28385 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:05.983189 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49372fa-453e-4617-aab6-402722d28385 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:05.995385 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-c49372fa-453e-4617-aab6-402722d28385 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 02:52:05.996879 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 510/1013] 10.222.0.18 () {56 vars in 1147 bytes} [Wed Dec 15 02:52:05 2021] GET /identity/v3/services/object-store => generated 93 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:06.007631 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d8b56-01bd-4c33-856e-c53833864c96 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:06.018658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d8b56-01bd-4c33-856e-c53833864c96 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:06.023116 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6081e-9712-4b9c-8421-6880a70fbbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:06.023807 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6081e-9712-4b9c-8421-6880a70fbbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:06.024050 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6081e-9712-4b9c-8421-6880a70fbbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:06.024317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6081e-9712-4b9c-8421-6880a70fbbb6 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:06.025084 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6081e-9712-4b9c-8421-6880a70fbbb6 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:06.025383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6081e-9712-4b9c-8421-6880a70fbbb6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:06.027024 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6081e-9712-4b9c-8421-6880a70fbbb6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:06.032678 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 504/1014] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Dec 15 02:52:06 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:06.039075 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49372fa-453e-4617-aab6-402722d28385 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:06.049042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49372fa-453e-4617-aab6-402722d28385 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:06.053510 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee139313-f155-4991-a689-bd40dd4d032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:06.054210 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee139313-f155-4991-a689-bd40dd4d032f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:06.054489 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee139313-f155-4991-a689-bd40dd4d032f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:06.054762 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee139313-f155-4991-a689-bd40dd4d032f admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:06.055485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee139313-f155-4991-a689-bd40dd4d032f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:06.055788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee139313-f155-4991-a689-bd40dd4d032f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:06.057394 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee139313-f155-4991-a689-bd40dd4d032f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:06.063592 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 511/1015] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Dec 15 02:52:06 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:06.069898 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6081e-9712-4b9c-8421-6880a70fbbb6 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:06.080527 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6081e-9712-4b9c-8421-6880a70fbbb6 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:06.085089 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87ee94-0da0-45e2-9e97-c09b27f88619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:06.085762 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87ee94-0da0-45e2-9e97-c09b27f88619 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:06.086044 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87ee94-0da0-45e2-9e97-c09b27f88619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:06.086313 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87ee94-0da0-45e2-9e97-c09b27f88619 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:06.087070 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87ee94-0da0-45e2-9e97-c09b27f88619 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:06.088652 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87ee94-0da0-45e2-9e97-c09b27f88619 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:06.104963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 505/1016] 10.222.0.18 () {60 vars in 1165 bytes} [Wed Dec 15 02:52:06 2021] POST /identity/v3/endpoints => generated 325 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:52:07.691127 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bc8b4-9345-48c2-b597-fceb0e2c33cb None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:07.691648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bc8b4-9345-48c2-b597-fceb0e2c33cb None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:07.691724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bc8b4-9345-48c2-b597-fceb0e2c33cb None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:07.693603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 512/1017] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:07.699177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba92ab9-f45b-4d2e-a780-a26c6456e63a None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:07.699578 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba92ab9-f45b-4d2e-a780-a26c6456e63a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:07.699740 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba92ab9-f45b-4d2e-a780-a26c6456e63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:07.717397 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-eba92ab9-f45b-4d2e-a780-a26c6456e63a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:07.718587 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-eba92ab9-f45b-4d2e-a780-a26c6456e63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:07.735831 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 506/1018] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:07 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:07.759989 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bc8b4-9345-48c2-b597-fceb0e2c33cb None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:07.772825 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bc8b4-9345-48c2-b597-fceb0e2c33cb None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:07.777211 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94980b18-7041-48f5-95e7-f9ceed9894e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:07.778005 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94980b18-7041-48f5-95e7-f9ceed9894e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:07.778330 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94980b18-7041-48f5-95e7-f9ceed9894e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:07.778635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94980b18-7041-48f5-95e7-f9ceed9894e4 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:07.779295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94980b18-7041-48f5-95e7-f9ceed9894e4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:07.780909 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94980b18-7041-48f5-95e7-f9ceed9894e4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:07.791842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-94980b18-7041-48f5-95e7-f9ceed9894e4 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 02:52:07.793174 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 513/1019] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:52:07 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:07.799843 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba92ab9-f45b-4d2e-a780-a26c6456e63a None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:07.808864 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba92ab9-f45b-4d2e-a780-a26c6456e63a None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:07.813444 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab8713-609c-47f9-93f5-f47f29f22ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:07.814116 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab8713-609c-47f9-93f5-f47f29f22ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:07.814399 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab8713-609c-47f9-93f5-f47f29f22ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:07.814674 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab8713-609c-47f9-93f5-f47f29f22ae2 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:07.815391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab8713-609c-47f9-93f5-f47f29f22ae2 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:07.815694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab8713-609c-47f9-93f5-f47f29f22ae2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:07.817312 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab8713-609c-47f9-93f5-f47f29f22ae2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:07.822508 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 507/1020] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Dec 15 02:52:07 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:07.828812 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94980b18-7041-48f5-95e7-f9ceed9894e4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:07.839127 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94980b18-7041-48f5-95e7-f9ceed9894e4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:07.843697 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b5305-8a07-408b-a31f-feb391119aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:07.844341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b5305-8a07-408b-a31f-feb391119aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:07.844623 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b5305-8a07-408b-a31f-feb391119aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:07.844898 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b5305-8a07-408b-a31f-feb391119aa2 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:07.845619 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b5305-8a07-408b-a31f-feb391119aa2 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:07.845910 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b5305-8a07-408b-a31f-feb391119aa2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:07.847523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b5305-8a07-408b-a31f-feb391119aa2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:07.852777 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 514/1021] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Dec 15 02:52:07 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:07.859291 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab8713-609c-47f9-93f5-f47f29f22ae2 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:07.869034 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab8713-609c-47f9-93f5-f47f29f22ae2 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:07.874176 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbefebb-37bb-4f28-84f0-4be19b1b190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:07.874814 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbefebb-37bb-4f28-84f0-4be19b1b190a admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:07.875091 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbefebb-37bb-4f28-84f0-4be19b1b190a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:07.875361 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbefebb-37bb-4f28-84f0-4be19b1b190a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:07.876117 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbefebb-37bb-4f28-84f0-4be19b1b190a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:07.877687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbefebb-37bb-4f28-84f0-4be19b1b190a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:07.897029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 508/1022] 10.222.0.18 () {60 vars in 1165 bytes} [Wed Dec 15 02:52:07 2021] POST /identity/v3/endpoints => generated 334 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:52:08.335451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af55c53-375a-47a5-9277-7ee82d395e0d None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:08.335830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af55c53-375a-47a5-9277-7ee82d395e0d None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:08.336023 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af55c53-375a-47a5-9277-7ee82d395e0d None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:08.337946 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 515/1023] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:08.344912 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff04e31-c794-4076-95cb-0157339205cf None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:08.345353 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff04e31-c794-4076-95cb-0157339205cf None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:08.345689 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff04e31-c794-4076-95cb-0157339205cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:08.364023 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-dff04e31-c794-4076-95cb-0157339205cf None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:08.365208 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-dff04e31-c794-4076-95cb-0157339205cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:08.386020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 509/1024] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:08 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:52:08.406037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af55c53-375a-47a5-9277-7ee82d395e0d None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:08.417849 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af55c53-375a-47a5-9277-7ee82d395e0d None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:08.422685 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38838c8a-87b2-4757-8601-1b5359df8307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:08.423452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38838c8a-87b2-4757-8601-1b5359df8307 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:08.423733 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38838c8a-87b2-4757-8601-1b5359df8307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:08.424008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38838c8a-87b2-4757-8601-1b5359df8307 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:08.424662 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38838c8a-87b2-4757-8601-1b5359df8307 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:08.426281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38838c8a-87b2-4757-8601-1b5359df8307 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:08.438546 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-38838c8a-87b2-4757-8601-1b5359df8307 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 02:52:08.439837 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 516/1025] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Dec 15 02:52:08 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:52:08.446305 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff04e31-c794-4076-95cb-0157339205cf None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:08.455149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff04e31-c794-4076-95cb-0157339205cf None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:08.459629 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8247f90-a722-4a80-8166-1a87435e7a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:08.460275 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8247f90-a722-4a80-8166-1a87435e7a18 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:08.460641 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8247f90-a722-4a80-8166-1a87435e7a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:08.460979 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8247f90-a722-4a80-8166-1a87435e7a18 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:08.461843 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8247f90-a722-4a80-8166-1a87435e7a18 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:08.462261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8247f90-a722-4a80-8166-1a87435e7a18 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:08.463894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8247f90-a722-4a80-8166-1a87435e7a18 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:08.473721 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 510/1026] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:08 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:08.475165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38838c8a-87b2-4757-8601-1b5359df8307 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:08.485156 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38838c8a-87b2-4757-8601-1b5359df8307 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:08.489636 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd6be0-95cf-4303-85da-1b326a7d28a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:08.490313 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd6be0-95cf-4303-85da-1b326a7d28a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:08.490614 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd6be0-95cf-4303-85da-1b326a7d28a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:08.490868 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd6be0-95cf-4303-85da-1b326a7d28a2 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:08.491588 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd6be0-95cf-4303-85da-1b326a7d28a2 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:08.491957 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd6be0-95cf-4303-85da-1b326a7d28a2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:08.493573 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd6be0-95cf-4303-85da-1b326a7d28a2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:08.496374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab007d-7545-435a-b001-a67422682637 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:08.496809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab007d-7545-435a-b001-a67422682637 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:08.497752 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab007d-7545-435a-b001-a67422682637 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:08.503722 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 517/1027] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:08 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:08.503861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 511/1028] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:52:08.505013 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a258e6-c057-4430-8d89-2622f33bc02d None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:08.505297 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a258e6-c057-4430-8d89-2622f33bc02d None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:08.505572 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a258e6-c057-4430-8d89-2622f33bc02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:08.506031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab007d-7545-435a-b001-a67422682637 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:08.518726 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab007d-7545-435a-b001-a67422682637 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:08.522824 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-85a258e6-c057-4430-8d89-2622f33bc02d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:08.523077 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c71578-5838-444a-bdb7-913900433091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:08.523697 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c71578-5838-444a-bdb7-913900433091 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:08.523972 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-85a258e6-c057-4430-8d89-2622f33bc02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:08.524086 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c71578-5838-444a-bdb7-913900433091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:08.524240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c71578-5838-444a-bdb7-913900433091 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:08.524982 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c71578-5838-444a-bdb7-913900433091 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:08.526591 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c71578-5838-444a-bdb7-913900433091 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:08.531701 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 518/1029] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:08 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:08.554294 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 512/1030] 10.222.0.18 () {60 vars in 1165 bytes} [Wed Dec 15 02:52:08 2021] POST /identity/v3/endpoints => generated 327 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 02:52:08.557357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a258e6-c057-4430-8d89-2622f33bc02d None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:08.567569 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a258e6-c057-4430-8d89-2622f33bc02d None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:08.585378 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680ac9c-9ffa-48f1-9a5a-657ba02ca0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:08.586258 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ac9c-9ffa-48f1-9a5a-657ba02ca0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:08.586534 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ac9c-9ffa-48f1-9a5a-657ba02ca0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:08.586827 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ac9c-9ffa-48f1-9a5a-657ba02ca0d0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:08.588090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680ac9c-9ffa-48f1-9a5a-657ba02ca0d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:08.589787 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680ac9c-9ffa-48f1-9a5a-657ba02ca0d0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:08.592994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 519/1031] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:08.597956 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c71578-5838-444a-bdb7-913900433091 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:08.609346 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c71578-5838-444a-bdb7-913900433091 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:08.614008 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c577b-dc72-4e2e-9ea8-798b67716efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:08.614682 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c577b-dc72-4e2e-9ea8-798b67716efc admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:08.614982 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c577b-dc72-4e2e-9ea8-798b67716efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:08.615257 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c577b-dc72-4e2e-9ea8-798b67716efc admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:08.615981 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c577b-dc72-4e2e-9ea8-798b67716efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:08.617940 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c577b-dc72-4e2e-9ea8-798b67716efc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:08.654018 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 513/1032] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Dec 15 02:52:08 2021] POST /identity/v3/projects => generated 311 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 02:52:10.331621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65dcfe-c8a8-46a8-8cff-c435cf8c34c1 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:10.332155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65dcfe-c8a8-46a8-8cff-c435cf8c34c1 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:10.332155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65dcfe-c8a8-46a8-8cff-c435cf8c34c1 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:10.334056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 520/1033] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:10.339810 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd02a5e-e429-4a09-876a-d777190ef9f4 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:10.340275 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd02a5e-e429-4a09-876a-d777190ef9f4 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:10.340354 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd02a5e-e429-4a09-876a-d777190ef9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:10.358335 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-cdd02a5e-e429-4a09-876a-d777190ef9f4 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:10.359488 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-cdd02a5e-e429-4a09-876a-d777190ef9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:10.413493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 514/1034] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:10 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:10.438959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65dcfe-c8a8-46a8-8cff-c435cf8c34c1 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:10.450928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65dcfe-c8a8-46a8-8cff-c435cf8c34c1 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:10.455260 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d0c60-f9f1-42de-89e6-3581db742c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:10.456176 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d0c60-f9f1-42de-89e6-3581db742c10 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:10.456469 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d0c60-f9f1-42de-89e6-3581db742c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:10.456810 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d0c60-f9f1-42de-89e6-3581db742c10 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:10.467562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d0c60-f9f1-42de-89e6-3581db742c10 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:52:10.475020 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-d53d0c60-f9f1-42de-89e6-3581db742c10 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 02:52:10.476369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 521/1035] 10.222.0.18 () {56 vars in 1141 bytes} [Wed Dec 15 02:52:10 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:52:10.483194 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd02a5e-e429-4a09-876a-d777190ef9f4 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:10.492076 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd02a5e-e429-4a09-876a-d777190ef9f4 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:10.496565 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd75b6-64bf-4a4b-841c-8a65606f1530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:10.497305 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd75b6-64bf-4a4b-841c-8a65606f1530 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:10.497646 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd75b6-64bf-4a4b-841c-8a65606f1530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:10.498007 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd75b6-64bf-4a4b-841c-8a65606f1530 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:10.498824 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd75b6-64bf-4a4b-841c-8a65606f1530 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:10.499189 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd75b6-64bf-4a4b-841c-8a65606f1530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:10.500763 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd75b6-64bf-4a4b-841c-8a65606f1530 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:10.509132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 515/1036] 10.222.0.18 () {56 vars in 1136 bytes} [Wed Dec 15 02:52:10 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:10.515455 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d0c60-f9f1-42de-89e6-3581db742c10 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:10.525897 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d0c60-f9f1-42de-89e6-3581db742c10 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:10.531177 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb369da-9ed7-4825-9db1-7697314a4317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:10.531990 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb369da-9ed7-4825-9db1-7697314a4317 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:10.532434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb369da-9ed7-4825-9db1-7697314a4317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:10.532711 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb369da-9ed7-4825-9db1-7697314a4317 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:10.544810 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb369da-9ed7-4825-9db1-7697314a4317 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:10.546675 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb369da-9ed7-4825-9db1-7697314a4317 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:10.564290 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-cbb369da-9ed7-4825-9db1-7697314a4317 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:52:10.565629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 522/1037] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:52:10.571640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd75b6-64bf-4a4b-841c-8a65606f1530 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:10.581576 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd75b6-64bf-4a4b-841c-8a65606f1530 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:10.586131 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048e452-ba31-441e-aa38-624715f60ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:10.586775 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048e452-ba31-441e-aa38-624715f60ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:10.587053 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048e452-ba31-441e-aa38-624715f60ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:10.587325 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048e452-ba31-441e-aa38-624715f60ea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:10.588047 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048e452-ba31-441e-aa38-624715f60ea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:10.588345 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048e452-ba31-441e-aa38-624715f60ea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:10.589930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048e452-ba31-441e-aa38-624715f60ea0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:10.603539 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 516/1038] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:52:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:10.609364 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb369da-9ed7-4825-9db1-7697314a4317 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:10.618776 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb369da-9ed7-4825-9db1-7697314a4317 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:10.623102 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fe4c2-1cc6-44d8-a09a-1b14ccbacac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:10.624046 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fe4c2-1cc6-44d8-a09a-1b14ccbacac0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:10.624326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fe4c2-1cc6-44d8-a09a-1b14ccbacac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:10.624595 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fe4c2-1cc6-44d8-a09a-1b14ccbacac0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:10.631826 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fe4c2-1cc6-44d8-a09a-1b14ccbacac0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:10.634156 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fe4c2-1cc6-44d8-a09a-1b14ccbacac0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:10.648546 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-426fe4c2-1cc6-44d8-a09a-1b14ccbacac0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 02:52:10.650020 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 523/1039] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Dec 15 02:52:10 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:10.657033 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048e452-ba31-441e-aa38-624715f60ea0 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:10.667117 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048e452-ba31-441e-aa38-624715f60ea0 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:10.672526 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79abd28-6e95-48de-9e66-72126fa1e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:10.673302 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79abd28-6e95-48de-9e66-72126fa1e564 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:10.673645 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79abd28-6e95-48de-9e66-72126fa1e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:10.674000 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79abd28-6e95-48de-9e66-72126fa1e564 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:10.674935 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79abd28-6e95-48de-9e66-72126fa1e564 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:10.675300 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79abd28-6e95-48de-9e66-72126fa1e564 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:10.677207 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79abd28-6e95-48de-9e66-72126fa1e564 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:10.695429 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 517/1040] 10.222.0.18 () {56 vars in 1154 bytes} [Wed Dec 15 02:52:10 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:10.701687 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fe4c2-1cc6-44d8-a09a-1b14ccbacac0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:10.711295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fe4c2-1cc6-44d8-a09a-1b14ccbacac0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:10.715601 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a620095-0e13-469f-a74b-aaa5e0376f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:10.716262 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a620095-0e13-469f-a74b-aaa5e0376f75 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:10.716536 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a620095-0e13-469f-a74b-aaa5e0376f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:10.716804 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a620095-0e13-469f-a74b-aaa5e0376f75 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:10.724360 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a620095-0e13-469f-a74b-aaa5e0376f75 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:10.726131 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a620095-0e13-469f-a74b-aaa5e0376f75 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:10.735382 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 524/1041] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:52:10 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:52:10.741301 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79abd28-6e95-48de-9e66-72126fa1e564 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:10.751266 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79abd28-6e95-48de-9e66-72126fa1e564 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:10.755658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e750b-2c3b-4f79-846e-894419d807f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:10.756426 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e750b-2c3b-4f79-846e-894419d807f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:10.756701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e750b-2c3b-4f79-846e-894419d807f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:10.756970 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e750b-2c3b-4f79-846e-894419d807f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:10.767364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e750b-2c3b-4f79-846e-894419d807f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:10.769166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e750b-2c3b-4f79-846e-894419d807f0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:10.785512 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-b37e750b-2c3b-4f79-846e-894419d807f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:52:10.786855 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 518/1042] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:10.792818 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a620095-0e13-469f-a74b-aaa5e0376f75 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:10.802330 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a620095-0e13-469f-a74b-aaa5e0376f75 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:10.806883 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4955cf-7442-4a5e-8287-838de7b52e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:10.807602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4955cf-7442-4a5e-8287-838de7b52e9b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:10.807954 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4955cf-7442-4a5e-8287-838de7b52e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:10.808300 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4955cf-7442-4a5e-8287-838de7b52e9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:10.809093 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4955cf-7442-4a5e-8287-838de7b52e9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:10.809462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4955cf-7442-4a5e-8287-838de7b52e9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:10.811642 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4955cf-7442-4a5e-8287-838de7b52e9b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:10.823207 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 525/1043] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:52:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:10.829381 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e750b-2c3b-4f79-846e-894419d807f0 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:10.839153 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e750b-2c3b-4f79-846e-894419d807f0 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:10.843626 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faa7a5-d07f-4860-92cd-493f6b008138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:10.844394 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faa7a5-d07f-4860-92cd-493f6b008138 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:10.844675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faa7a5-d07f-4860-92cd-493f6b008138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:10.844946 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faa7a5-d07f-4860-92cd-493f6b008138 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:10.851634 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faa7a5-d07f-4860-92cd-493f6b008138 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:10.853569 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faa7a5-d07f-4860-92cd-493f6b008138 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:10.866765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-a7faa7a5-d07f-4860-92cd-493f6b008138 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:52:10.868055 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 519/1044] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:52:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:10.874779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4955cf-7442-4a5e-8287-838de7b52e9b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:10.884588 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4955cf-7442-4a5e-8287-838de7b52e9b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:10.889087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741569e-efbe-4ed9-b196-c3a8bf58a711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:10.889797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741569e-efbe-4ed9-b196-c3a8bf58a711 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:10.890174 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741569e-efbe-4ed9-b196-c3a8bf58a711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:10.890516 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741569e-efbe-4ed9-b196-c3a8bf58a711 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:10.891396 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741569e-efbe-4ed9-b196-c3a8bf58a711 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:10.891765 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741569e-efbe-4ed9-b196-c3a8bf58a711 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:10.893678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741569e-efbe-4ed9-b196-c3a8bf58a711 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:10.905811 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 526/1045] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:52:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:10.912332 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faa7a5-d07f-4860-92cd-493f6b008138 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:10.923085 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faa7a5-d07f-4860-92cd-493f6b008138 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:10.927531 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84626a0-6bcc-4f81-9dfc-4f47f7b9ea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:10.928164 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84626a0-6bcc-4f81-9dfc-4f47f7b9ea4f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:10.928440 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84626a0-6bcc-4f81-9dfc-4f47f7b9ea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:10.928714 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84626a0-6bcc-4f81-9dfc-4f47f7b9ea4f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:10.929540 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84626a0-6bcc-4f81-9dfc-4f47f7b9ea4f admin admin] RBAC: Adding query filter params (role.id=d846ce53fbf24866ad1005504008a71d, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=fcd50adcd390465ea6fc8582e1524909) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:10.929843 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84626a0-6bcc-4f81-9dfc-4f47f7b9ea4f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:10.931714 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84626a0-6bcc-4f81-9dfc-4f47f7b9ea4f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:10.937895 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14205b8-4253-4569-b7a1-ac6e561fe3a4 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:10.938327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14205b8-4253-4569-b7a1-ac6e561fe3a4 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:10.938705 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14205b8-4253-4569-b7a1-ac6e561fe3a4 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:10.940710 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 527/1046] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:52:10.945376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 520/1047] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:52:10 2021] GET /identity/v3/role_assignments?user.id=fcd50adcd390465ea6fc8582e1524909&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=d846ce53fbf24866ad1005504008a71d => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:10.947038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27659064-380e-4613-96cb-77d878ff1faf None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:10.947443 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27659064-380e-4613-96cb-77d878ff1faf None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:10.947851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27659064-380e-4613-96cb-77d878ff1faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:10.967182 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-27659064-380e-4613-96cb-77d878ff1faf None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:10.968460 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-27659064-380e-4613-96cb-77d878ff1faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:10.976663 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 528/1048] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:10 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:11.001109 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84626a0-6bcc-4f81-9dfc-4f47f7b9ea4f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:11.011497 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84626a0-6bcc-4f81-9dfc-4f47f7b9ea4f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:11.016289 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cff55-0ecc-43d3-b429-e4b6283be834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:11.016959 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cff55-0ecc-43d3-b429-e4b6283be834 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:11.017242 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cff55-0ecc-43d3-b429-e4b6283be834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:11.017517 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cff55-0ecc-43d3-b429-e4b6283be834 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:11.026239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cff55-0ecc-43d3-b429-e4b6283be834 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:11.028014 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cff55-0ecc-43d3-b429-e4b6283be834 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:11.038732 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 521/1049] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:52:11 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:52:11.045659 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27659064-380e-4613-96cb-77d878ff1faf None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:11.055159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27659064-380e-4613-96cb-77d878ff1faf None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:11.059916 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97817f-72da-4cf5-9cee-1d063153e88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:11.060726 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97817f-72da-4cf5-9cee-1d063153e88e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:11.061008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97817f-72da-4cf5-9cee-1d063153e88e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:11.061310 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97817f-72da-4cf5-9cee-1d063153e88e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:11.062551 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97817f-72da-4cf5-9cee-1d063153e88e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:11.064372 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97817f-72da-4cf5-9cee-1d063153e88e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:11.064807 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9eb107-241f-4b62-8685-e7b599f565fe None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:11.065099 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9eb107-241f-4b62-8685-e7b599f565fe None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:11.065383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9eb107-241f-4b62-8685-e7b599f565fe None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:11.066269 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 529/1050] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:11.067504 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 522/1051] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:11.074376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b4b1-0064-47e7-804f-724c63b24114 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:11.074688 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b4b1-0064-47e7-804f-724c63b24114 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:11.075132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b4b1-0064-47e7-804f-724c63b24114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:11.094878 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-5897b4b1-0064-47e7-804f-724c63b24114 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:11.096142 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5897b4b1-0064-47e7-804f-724c63b24114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:11.104579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 530/1052] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:11.131734 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9eb107-241f-4b62-8685-e7b599f565fe None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:11.145440 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9eb107-241f-4b62-8685-e7b599f565fe None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:11.150275 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777f07f-6681-49c5-8314-2c53d5a4f138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:11.151202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777f07f-6681-49c5-8314-2c53d5a4f138 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:11.151486 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777f07f-6681-49c5-8314-2c53d5a4f138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:11.151754 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777f07f-6681-49c5-8314-2c53d5a4f138 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:11.153049 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777f07f-6681-49c5-8314-2c53d5a4f138 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:11.155342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777f07f-6681-49c5-8314-2c53d5a4f138 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:11.157309 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 523/1053] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:11.163728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897b4b1-0064-47e7-804f-724c63b24114 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:11.174924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897b4b1-0064-47e7-804f-724c63b24114 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:11.179900 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2fa27-0789-40d1-b66f-b0022a678fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:11.180582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2fa27-0789-40d1-b66f-b0022a678fbc admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:11.180862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2fa27-0789-40d1-b66f-b0022a678fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:11.181137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2fa27-0789-40d1-b66f-b0022a678fbc admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:11.181891 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2fa27-0789-40d1-b66f-b0022a678fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:11.183904 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2fa27-0789-40d1-b66f-b0022a678fbc admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:11.210701 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 531/1054] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:52:11 2021] POST /identity/v3/users => generated 285 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:52:13.285582 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a024c19-cae2-4aa3-9adf-d8afad2c2ca6 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.286135 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a024c19-cae2-4aa3-9adf-d8afad2c2ca6 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.286240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a024c19-cae2-4aa3-9adf-d8afad2c2ca6 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.287916 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 524/1055] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:13.293573 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06aa57-5c07-4637-be26-c9832afe7fa2 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.294040 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06aa57-5c07-4637-be26-c9832afe7fa2 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.294134 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06aa57-5c07-4637-be26-c9832afe7fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.311844 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-fa06aa57-5c07-4637-be26-c9832afe7fa2 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:13.313020 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-fa06aa57-5c07-4637-be26-c9832afe7fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:13.320719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 532/1056] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:13 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:52:13.345072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a024c19-cae2-4aa3-9adf-d8afad2c2ca6 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.356942 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a024c19-cae2-4aa3-9adf-d8afad2c2ca6 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.361148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59f782-6fd2-476a-aa5c-e983cd38e73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.361920 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59f782-6fd2-476a-aa5c-e983cd38e73e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.362221 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59f782-6fd2-476a-aa5c-e983cd38e73e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.362490 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59f782-6fd2-476a-aa5c-e983cd38e73e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.372574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59f782-6fd2-476a-aa5c-e983cd38e73e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:52:13.379704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-ef59f782-6fd2-476a-aa5c-e983cd38e73e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 02:52:13.380849 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 525/1057] 10.222.0.18 () {56 vars in 1141 bytes} [Wed Dec 15 02:52:13 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:13.387300 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06aa57-5c07-4637-be26-c9832afe7fa2 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.396600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06aa57-5c07-4637-be26-c9832afe7fa2 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.400932 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b3fc6-3ef3-42d4-ad4b-b02eaa44497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.401570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b3fc6-3ef3-42d4-ad4b-b02eaa44497b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.401845 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b3fc6-3ef3-42d4-ad4b-b02eaa44497b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.402161 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b3fc6-3ef3-42d4-ad4b-b02eaa44497b admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.402906 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b3fc6-3ef3-42d4-ad4b-b02eaa44497b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:13.403234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b3fc6-3ef3-42d4-ad4b-b02eaa44497b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:13.404796 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b3fc6-3ef3-42d4-ad4b-b02eaa44497b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:13.412786 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 533/1058] 10.222.0.18 () {56 vars in 1136 bytes} [Wed Dec 15 02:52:13 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:13.418617 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59f782-6fd2-476a-aa5c-e983cd38e73e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.428385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59f782-6fd2-476a-aa5c-e983cd38e73e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.432775 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb24502-6e3c-4dc5-9348-06d237191af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.433517 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb24502-6e3c-4dc5-9348-06d237191af6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.433794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb24502-6e3c-4dc5-9348-06d237191af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.434084 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb24502-6e3c-4dc5-9348-06d237191af6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.444306 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb24502-6e3c-4dc5-9348-06d237191af6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:13.446130 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb24502-6e3c-4dc5-9348-06d237191af6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:13.462583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-4fb24502-6e3c-4dc5-9348-06d237191af6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:52:13.463628 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 526/1059] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:13.469864 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b3fc6-3ef3-42d4-ad4b-b02eaa44497b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.479395 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b3fc6-3ef3-42d4-ad4b-b02eaa44497b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.483769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc169093-71ef-4c46-9e10-d6ebf850ccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.484409 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc169093-71ef-4c46-9e10-d6ebf850ccf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.484690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc169093-71ef-4c46-9e10-d6ebf850ccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.484965 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc169093-71ef-4c46-9e10-d6ebf850ccf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.485688 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc169093-71ef-4c46-9e10-d6ebf850ccf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:13.486010 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc169093-71ef-4c46-9e10-d6ebf850ccf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:13.487593 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc169093-71ef-4c46-9e10-d6ebf850ccf8 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:13.499546 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 534/1060] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:52:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:13.505559 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb24502-6e3c-4dc5-9348-06d237191af6 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.515743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb24502-6e3c-4dc5-9348-06d237191af6 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.520088 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91501f-a52d-4503-9828-cb1373ed515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.520843 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91501f-a52d-4503-9828-cb1373ed515a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.521121 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91501f-a52d-4503-9828-cb1373ed515a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.521391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91501f-a52d-4503-9828-cb1373ed515a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.528497 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91501f-a52d-4503-9828-cb1373ed515a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:13.530518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91501f-a52d-4503-9828-cb1373ed515a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:13.543794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-6a91501f-a52d-4503-9828-cb1373ed515a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 02:52:13.544898 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 527/1061] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Dec 15 02:52:13 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:13.551021 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc169093-71ef-4c46-9e10-d6ebf850ccf8 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.560926 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc169093-71ef-4c46-9e10-d6ebf850ccf8 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.565330 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee637ab1-e7cc-48ba-96f2-4664300d4ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.565973 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee637ab1-e7cc-48ba-96f2-4664300d4ffc admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.566284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee637ab1-e7cc-48ba-96f2-4664300d4ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.566556 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee637ab1-e7cc-48ba-96f2-4664300d4ffc admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.567394 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee637ab1-e7cc-48ba-96f2-4664300d4ffc admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:13.567695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee637ab1-e7cc-48ba-96f2-4664300d4ffc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:13.569531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee637ab1-e7cc-48ba-96f2-4664300d4ffc admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:13.587336 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 535/1062] 10.222.0.18 () {56 vars in 1154 bytes} [Wed Dec 15 02:52:13 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:13.593405 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91501f-a52d-4503-9828-cb1373ed515a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.602868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91501f-a52d-4503-9828-cb1373ed515a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.604430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b8045-26fc-4560-89f3-94f395c3b601 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.604722 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b8045-26fc-4560-89f3-94f395c3b601 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.604999 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b8045-26fc-4560-89f3-94f395c3b601 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.607299 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 536/1063] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:52:13.607800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167451ba-d951-43fc-85b8-b35c29bd80f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.608616 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167451ba-d951-43fc-85b8-b35c29bd80f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.608893 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167451ba-d951-43fc-85b8-b35c29bd80f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.609159 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167451ba-d951-43fc-85b8-b35c29bd80f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.612706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c910d1-7144-4934-b2a2-7bc6f1d1de9e None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.612989 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c910d1-7144-4934-b2a2-7bc6f1d1de9e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.613265 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c910d1-7144-4934-b2a2-7bc6f1d1de9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.619326 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167451ba-d951-43fc-85b8-b35c29bd80f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:13.621131 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167451ba-d951-43fc-85b8-b35c29bd80f4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:13.630800 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-89c910d1-7144-4934-b2a2-7bc6f1d1de9e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:13.631974 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-89c910d1-7144-4934-b2a2-7bc6f1d1de9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:13.639426 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-167451ba-d951-43fc-85b8-b35c29bd80f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:52:13.639854 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 537/1064] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:13 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:52:13.645464 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 528/1065] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:13.646485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c910d1-7144-4934-b2a2-7bc6f1d1de9e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.655380 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c910d1-7144-4934-b2a2-7bc6f1d1de9e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.659758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24d25e-5070-4604-b91a-6fdd0c08cbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.660370 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24d25e-5070-4604-b91a-6fdd0c08cbda admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.660649 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24d25e-5070-4604-b91a-6fdd0c08cbda admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.660923 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24d25e-5070-4604-b91a-6fdd0c08cbda admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.661631 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24d25e-5070-4604-b91a-6fdd0c08cbda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:13.661932 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24d25e-5070-4604-b91a-6fdd0c08cbda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:13.663519 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24d25e-5070-4604-b91a-6fdd0c08cbda admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:13.663704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167451ba-d951-43fc-85b8-b35c29bd80f4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.673480 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167451ba-d951-43fc-85b8-b35c29bd80f4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.675011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 538/1066] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:52:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:13.677910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448fab1-7062-4473-a0a7-9cb236a3026c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.678692 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448fab1-7062-4473-a0a7-9cb236a3026c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.678972 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448fab1-7062-4473-a0a7-9cb236a3026c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.679251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448fab1-7062-4473-a0a7-9cb236a3026c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.680731 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24d25e-5070-4604-b91a-6fdd0c08cbda admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.689802 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448fab1-7062-4473-a0a7-9cb236a3026c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:52:13.690219 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24d25e-5070-4604-b91a-6fdd0c08cbda admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.694548 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e20ec8-fc80-45f5-af1e-f03f1202c65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.695269 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e20ec8-fc80-45f5-af1e-f03f1202c65b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.695547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e20ec8-fc80-45f5-af1e-f03f1202c65b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.695817 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e20ec8-fc80-45f5-af1e-f03f1202c65b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.696594 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-5448fab1-7062-4473-a0a7-9cb236a3026c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:52:13.697711 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 529/1067] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:52:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:52:13.702404 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e20ec8-fc80-45f5-af1e-f03f1202c65b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:13.703973 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448fab1-7062-4473-a0a7-9cb236a3026c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.704306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e20ec8-fc80-45f5-af1e-f03f1202c65b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:13.712917 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448fab1-7062-4473-a0a7-9cb236a3026c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.717293 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbd681-1d5e-4f5b-b430-7469ab91bc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.717420 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-70e20ec8-fc80-45f5-af1e-f03f1202c65b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:52:13.717891 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbd681-1d5e-4f5b-b430-7469ab91bc19 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.718197 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbd681-1d5e-4f5b-b430-7469ab91bc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.718466 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbd681-1d5e-4f5b-b430-7469ab91bc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.718562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 539/1068] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:52:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:52:13.719196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbd681-1d5e-4f5b-b430-7469ab91bc19 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:13.719494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbd681-1d5e-4f5b-b430-7469ab91bc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:13.721043 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbd681-1d5e-4f5b-b430-7469ab91bc19 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:13.724302 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e20ec8-fc80-45f5-af1e-f03f1202c65b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.729944 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 530/1069] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:52:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:13.733773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e20ec8-fc80-45f5-af1e-f03f1202c65b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.736312 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbd681-1d5e-4f5b-b430-7469ab91bc19 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.738275 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e840a0-85b0-453f-95f6-9e8c198e7309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.738875 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e840a0-85b0-453f-95f6-9e8c198e7309 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.739151 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e840a0-85b0-453f-95f6-9e8c198e7309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.739421 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e840a0-85b0-453f-95f6-9e8c198e7309 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.740186 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e840a0-85b0-453f-95f6-9e8c198e7309 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:13.740487 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e840a0-85b0-453f-95f6-9e8c198e7309 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:13.742288 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e840a0-85b0-453f-95f6-9e8c198e7309 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:13.745111 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbd681-1d5e-4f5b-b430-7469ab91bc19 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.749993 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f14ac-3697-41bb-a567-5d91d40e3480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.750805 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f14ac-3697-41bb-a567-5d91d40e3480 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.751086 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f14ac-3697-41bb-a567-5d91d40e3480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.751357 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f14ac-3697-41bb-a567-5d91d40e3480 admin admin] PATH_INFO: `/v3/users/8b70e3d47a2946bda0936b5453f751a7` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.758906 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 540/1070] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:52:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:13.760273 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e840a0-85b0-453f-95f6-9e8c198e7309 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.764627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f14ac-3697-41bb-a567-5d91d40e3480 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b70e3d47a2946bda0936b5453f751a7)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:13.766735 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f14ac-3697-41bb-a567-5d91d40e3480 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:13.768324 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 531/1071] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:52:13 2021] GET /identity/v3/users/8b70e3d47a2946bda0936b5453f751a7 => generated 285 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:13.769104 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e840a0-85b0-453f-95f6-9e8c198e7309 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.773396 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff48d3-9758-4450-a746-036aac9950a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.774278 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff48d3-9758-4450-a746-036aac9950a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.774422 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f14ac-3697-41bb-a567-5d91d40e3480 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.774553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff48d3-9758-4450-a746-036aac9950a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.774821 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff48d3-9758-4450-a746-036aac9950a4 admin admin] PATH_INFO: `/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/fcd50adcd390465ea6fc8582e1524909/roles/d846ce53fbf24866ad1005504008a71d` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.776944 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff48d3-9758-4450-a746-036aac9950a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user_id=fcd50adcd390465ea6fc8582e1524909, role_id=d846ce53fbf24866ad1005504008a71d)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:13.779746 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff48d3-9758-4450-a746-036aac9950a4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:13.783265 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f14ac-3697-41bb-a567-5d91d40e3480 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.788459 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6fef3-9ce3-4337-8a59-f24a2e27de72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.789148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6fef3-9ce3-4337-8a59-f24a2e27de72 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.789433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6fef3-9ce3-4337-8a59-f24a2e27de72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.789706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6fef3-9ce3-4337-8a59-f24a2e27de72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.792633 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 541/1072] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:52:13 2021] PUT /identity/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/fcd50adcd390465ea6fc8582e1524909/roles/d846ce53fbf24866ad1005504008a71d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 02:52:13.798276 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6fef3-9ce3-4337-8a59-f24a2e27de72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:13.800053 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6fef3-9ce3-4337-8a59-f24a2e27de72 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:13.810518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 532/1073] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:52:13 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 02:52:13.817414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff48d3-9758-4450-a746-036aac9950a4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.879984 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff48d3-9758-4450-a746-036aac9950a4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.884841 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59ce01-73fb-4616-b993-9254cd3a4ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.885709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59ce01-73fb-4616-b993-9254cd3a4ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.885999 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59ce01-73fb-4616-b993-9254cd3a4ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.886403 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59ce01-73fb-4616-b993-9254cd3a4ba0 admin admin] PATH_INFO: `/v3/projects/b974732e42f1498a8f6e1547c31c9496` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.887659 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59ce01-73fb-4616-b993-9254cd3a4ba0 admin admin] RBAC: Authorizing `identity:get_project(project_id=b974732e42f1498a8f6e1547c31c9496)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:13.889713 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59ce01-73fb-4616-b993-9254cd3a4ba0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:13.891474 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 542/1074] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:52:13 2021] GET /identity/v3/projects/b974732e42f1498a8f6e1547c31c9496 => generated 311 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:13.898210 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6fef3-9ce3-4337-8a59-f24a2e27de72 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:13.907402 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6fef3-9ce3-4337-8a59-f24a2e27de72 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:13.912001 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278c1f1-12c5-4f63-bf79-98f2239fbf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:13.912659 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278c1f1-12c5-4f63-bf79-98f2239fbf2e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:13.912940 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278c1f1-12c5-4f63-bf79-98f2239fbf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:13.913216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278c1f1-12c5-4f63-bf79-98f2239fbf2e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:13.914096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278c1f1-12c5-4f63-bf79-98f2239fbf2e admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=b974732e42f1498a8f6e1547c31c9496, user.id=8b70e3d47a2946bda0936b5453f751a7) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:13.914407 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278c1f1-12c5-4f63-bf79-98f2239fbf2e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:13.916281 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278c1f1-12c5-4f63-bf79-98f2239fbf2e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:13.930025 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 533/1075] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:52:13 2021] GET /identity/v3/role_assignments?user.id=8b70e3d47a2946bda0936b5453f751a7&scope.project.id=b974732e42f1498a8f6e1547c31c9496&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:16.115406 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a27b7a-46f6-48c7-9d66-a84493742036 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.115979 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a27b7a-46f6-48c7-9d66-a84493742036 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.115979 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a27b7a-46f6-48c7-9d66-a84493742036 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.117724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 543/1076] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:16.123424 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125d0f3-beed-442b-b469-7b2dee9fef60 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.123838 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125d0f3-beed-442b-b469-7b2dee9fef60 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.123969 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125d0f3-beed-442b-b469-7b2dee9fef60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.141781 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-6125d0f3-beed-442b-b469-7b2dee9fef60 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:16.142978 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6125d0f3-beed-442b-b469-7b2dee9fef60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:16.150515 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 534/1077] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:16.175066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a27b7a-46f6-48c7-9d66-a84493742036 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.187430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a27b7a-46f6-48c7-9d66-a84493742036 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.191768 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0debd24-ad39-4b79-a998-dc18b28d4c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.192552 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0debd24-ad39-4b79-a998-dc18b28d4c5e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.192833 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0debd24-ad39-4b79-a998-dc18b28d4c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.193108 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0debd24-ad39-4b79-a998-dc18b28d4c5e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.206831 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0debd24-ad39-4b79-a998-dc18b28d4c5e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:52:16.213109 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1d049-1009-4173-90b3-f589cee17e9d None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.213392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1d049-1009-4173-90b3-f589cee17e9d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.213667 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1d049-1009-4173-90b3-f589cee17e9d None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.214121 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-e0debd24-ad39-4b79-a998-dc18b28d4c5e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 02:52:16.215327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 544/1078] 10.222.0.18 () {56 vars in 1141 bytes} [Wed Dec 15 02:52:16 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:16.215722 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 535/1079] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:52:16.220948 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9c270-8c68-4e55-a9e6-ade2e6ca5c9d None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.221239 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9c270-8c68-4e55-a9e6-ade2e6ca5c9d None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.221339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1d049-1009-4173-90b3-f589cee17e9d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.221519 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9c270-8c68-4e55-a9e6-ade2e6ca5c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.232921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1d049-1009-4173-90b3-f589cee17e9d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.237227 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e52460-1703-42cb-8a71-85e539002485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.237837 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e52460-1703-42cb-8a71-85e539002485 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.238238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e52460-1703-42cb-8a71-85e539002485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.238518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e52460-1703-42cb-8a71-85e539002485 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.238983 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-2ea9c270-8c68-4e55-a9e6-ade2e6ca5c9d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:16.239256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e52460-1703-42cb-8a71-85e539002485 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:16.239554 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e52460-1703-42cb-8a71-85e539002485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:16.240146 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-2ea9c270-8c68-4e55-a9e6-ade2e6ca5c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:16.241110 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e52460-1703-42cb-8a71-85e539002485 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:16.248192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 545/1080] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:16.249385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 536/1081] 10.222.0.18 () {56 vars in 1136 bytes} [Wed Dec 15 02:52:16 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:16.255433 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9c270-8c68-4e55-a9e6-ade2e6ca5c9d None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.265050 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9c270-8c68-4e55-a9e6-ade2e6ca5c9d None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.269429 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ce646-e797-4e72-82f5-1df616ecc2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.270212 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ce646-e797-4e72-82f5-1df616ecc2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.270491 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ce646-e797-4e72-82f5-1df616ecc2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.270762 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ce646-e797-4e72-82f5-1df616ecc2e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.272290 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e52460-1703-42cb-8a71-85e539002485 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.280739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ce646-e797-4e72-82f5-1df616ecc2e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:16.281436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e52460-1703-42cb-8a71-85e539002485 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.282575 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ce646-e797-4e72-82f5-1df616ecc2e4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:16.286103 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cf86d-6705-4ef9-9934-447381a0d6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.286853 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cf86d-6705-4ef9-9934-447381a0d6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.287128 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cf86d-6705-4ef9-9934-447381a0d6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.287395 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cf86d-6705-4ef9-9934-447381a0d6f5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.297109 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50cf86d-6705-4ef9-9934-447381a0d6f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:52:16.298742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-2b6ce646-e797-4e72-82f5-1df616ecc2e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:52:16.299870 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 546/1082] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:16.305015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-a50cf86d-6705-4ef9-9934-447381a0d6f5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:52:16.305687 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ce646-e797-4e72-82f5-1df616ecc2e4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.311891 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 537/1083] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:52:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:52:16.312671 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cf86d-6705-4ef9-9934-447381a0d6f5 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.315256 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ce646-e797-4e72-82f5-1df616ecc2e4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.319858 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ed4ab-6e51-411b-8a33-451acbd7ab0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.320476 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ed4ab-6e51-411b-8a33-451acbd7ab0b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.320757 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ed4ab-6e51-411b-8a33-451acbd7ab0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.321031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ed4ab-6e51-411b-8a33-451acbd7ab0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.321758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ed4ab-6e51-411b-8a33-451acbd7ab0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:16.322087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ed4ab-6e51-411b-8a33-451acbd7ab0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:16.323638 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ed4ab-6e51-411b-8a33-451acbd7ab0b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:16.326868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cf86d-6705-4ef9-9934-447381a0d6f5 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.331453 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b2c09-a1ce-46db-8adb-d87b8671fe51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.332084 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b2c09-a1ce-46db-8adb-d87b8671fe51 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.332374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b2c09-a1ce-46db-8adb-d87b8671fe51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.332641 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b2c09-a1ce-46db-8adb-d87b8671fe51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.333393 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b2c09-a1ce-46db-8adb-d87b8671fe51 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:16.333765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b2c09-a1ce-46db-8adb-d87b8671fe51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:16.335663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b2c09-a1ce-46db-8adb-d87b8671fe51 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:16.335838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 547/1084] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:52:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:16.341430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ed4ab-6e51-411b-8a33-451acbd7ab0b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.348889 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 538/1085] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:52:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:16.349809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b2c09-a1ce-46db-8adb-d87b8671fe51 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.350443 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ed4ab-6e51-411b-8a33-451acbd7ab0b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.354779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8956c8-4ea2-445a-8ee2-480f36322ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.355530 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8956c8-4ea2-445a-8ee2-480f36322ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.355809 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8956c8-4ea2-445a-8ee2-480f36322ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.356083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8956c8-4ea2-445a-8ee2-480f36322ea5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.358703 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b2c09-a1ce-46db-8adb-d87b8671fe51 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.363043 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c07a6d-14a4-489a-b339-c2fd75b5e923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.363602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8956c8-4ea2-445a-8ee2-480f36322ea5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:16.363849 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c07a6d-14a4-489a-b339-c2fd75b5e923 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.364125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c07a6d-14a4-489a-b339-c2fd75b5e923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.364392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c07a6d-14a4-489a-b339-c2fd75b5e923 admin admin] PATH_INFO: `/v3/users/8b70e3d47a2946bda0936b5453f751a7` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.365609 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8956c8-4ea2-445a-8ee2-480f36322ea5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:16.365718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c07a6d-14a4-489a-b339-c2fd75b5e923 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b70e3d47a2946bda0936b5453f751a7)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:16.367618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c07a6d-14a4-489a-b339-c2fd75b5e923 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:16.374440 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 539/1086] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:52:16 2021] GET /identity/v3/users/8b70e3d47a2946bda0936b5453f751a7 => generated 285 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:16.375406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c07a6d-14a4-489a-b339-c2fd75b5e923 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.378841 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-af8956c8-4ea2-445a-8ee2-480f36322ea5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 02:52:16.385120 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 548/1087] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Dec 15 02:52:16 2021] GET /identity/v3/users/nova => generated 82 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:52:16.385239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c07a6d-14a4-489a-b339-c2fd75b5e923 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.385973 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8956c8-4ea2-445a-8ee2-480f36322ea5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.389562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef24db-edbf-4bf6-abc3-1d36f9ffbb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.390364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef24db-edbf-4bf6-abc3-1d36f9ffbb58 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.390637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef24db-edbf-4bf6-abc3-1d36f9ffbb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.390902 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef24db-edbf-4bf6-abc3-1d36f9ffbb58 admin admin] PATH_INFO: `/v3/projects/b974732e42f1498a8f6e1547c31c9496` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.392032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef24db-edbf-4bf6-abc3-1d36f9ffbb58 admin admin] RBAC: Authorizing `identity:get_project(project_id=b974732e42f1498a8f6e1547c31c9496)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:16.393992 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef24db-edbf-4bf6-abc3-1d36f9ffbb58 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:16.395509 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8956c8-4ea2-445a-8ee2-480f36322ea5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.395652 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 540/1088] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:52:16 2021] GET /identity/v3/projects/b974732e42f1498a8f6e1547c31c9496 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:16.399945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01449ea4-a61d-432a-808f-3cfba4640370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.400559 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01449ea4-a61d-432a-808f-3cfba4640370 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.400822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01449ea4-a61d-432a-808f-3cfba4640370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.401099 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01449ea4-a61d-432a-808f-3cfba4640370 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.401709 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef24db-edbf-4bf6-abc3-1d36f9ffbb58 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.401911 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01449ea4-a61d-432a-808f-3cfba4640370 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:16.402238 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01449ea4-a61d-432a-808f-3cfba4640370 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:16.403999 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01449ea4-a61d-432a-808f-3cfba4640370 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:16.410725 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef24db-edbf-4bf6-abc3-1d36f9ffbb58 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.415219 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64837cd5-3511-4b96-bcc6-6cd1863bd99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.416031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64837cd5-3511-4b96-bcc6-6cd1863bd99e admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.416310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64837cd5-3511-4b96-bcc6-6cd1863bd99e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.416581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64837cd5-3511-4b96-bcc6-6cd1863bd99e admin admin] PATH_INFO: `/v3/projects/b974732e42f1498a8f6e1547c31c9496/users/8b70e3d47a2946bda0936b5453f751a7/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.418522 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64837cd5-3511-4b96-bcc6-6cd1863bd99e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b974732e42f1498a8f6e1547c31c9496, user_id=8b70e3d47a2946bda0936b5453f751a7, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:16.420825 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 549/1089] 10.222.0.18 () {56 vars in 1154 bytes} [Wed Dec 15 02:52:16 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:16.421099 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64837cd5-3511-4b96-bcc6-6cd1863bd99e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:16.426656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01449ea4-a61d-432a-808f-3cfba4640370 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.433667 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 541/1090] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:52:16 2021] PUT /identity/v3/projects/b974732e42f1498a8f6e1547c31c9496/users/8b70e3d47a2946bda0936b5453f751a7/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:52:16.436078 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01449ea4-a61d-432a-808f-3cfba4640370 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.492648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66552c65-8b46-47c0-84fd-b3fc20e7e499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.493315 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66552c65-8b46-47c0-84fd-b3fc20e7e499 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.493595 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66552c65-8b46-47c0-84fd-b3fc20e7e499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.493879 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66552c65-8b46-47c0-84fd-b3fc20e7e499 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.503189 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66552c65-8b46-47c0-84fd-b3fc20e7e499 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:16.504987 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66552c65-8b46-47c0-84fd-b3fc20e7e499 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:16.515550 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 550/1091] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:52:16 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 02:52:16.521927 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64837cd5-3511-4b96-bcc6-6cd1863bd99e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.532177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64837cd5-3511-4b96-bcc6-6cd1863bd99e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.536755 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8e296-6809-48fb-b358-bbb3109e14c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.537537 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e296-6809-48fb-b358-bbb3109e14c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.537812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e296-6809-48fb-b358-bbb3109e14c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.538116 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e296-6809-48fb-b358-bbb3109e14c6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.549487 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8e296-6809-48fb-b358-bbb3109e14c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:16.551370 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8e296-6809-48fb-b358-bbb3109e14c6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:16.569079 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-f1b8e296-6809-48fb-b358-bbb3109e14c6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:52:16.570355 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 542/1092] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:16.577234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66552c65-8b46-47c0-84fd-b3fc20e7e499 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.586458 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66552c65-8b46-47c0-84fd-b3fc20e7e499 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.591243 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6697e7d-3b2b-4136-9fe1-a2c94fbbfd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.591915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6697e7d-3b2b-4136-9fe1-a2c94fbbfd4b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.592196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6697e7d-3b2b-4136-9fe1-a2c94fbbfd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.592471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6697e7d-3b2b-4136-9fe1-a2c94fbbfd4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.593209 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6697e7d-3b2b-4136-9fe1-a2c94fbbfd4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:16.593516 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6697e7d-3b2b-4136-9fe1-a2c94fbbfd4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:16.595145 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6697e7d-3b2b-4136-9fe1-a2c94fbbfd4b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:16.607834 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 551/1093] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:52:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:16.614064 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8e296-6809-48fb-b358-bbb3109e14c6 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.624660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8e296-6809-48fb-b358-bbb3109e14c6 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.629215 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a1a78-f4ae-47d0-aad7-46e4e5f9cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.630025 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a1a78-f4ae-47d0-aad7-46e4e5f9cc9a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.630309 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a1a78-f4ae-47d0-aad7-46e4e5f9cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.630585 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a1a78-f4ae-47d0-aad7-46e4e5f9cc9a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.640546 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a1a78-f4ae-47d0-aad7-46e4e5f9cc9a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:16.642562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a1a78-f4ae-47d0-aad7-46e4e5f9cc9a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:16.656575 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-a09a1a78-f4ae-47d0-aad7-46e4e5f9cc9a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:52:16.657728 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 543/1094] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:52:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:16.664115 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6697e7d-3b2b-4136-9fe1-a2c94fbbfd4b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.674202 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6697e7d-3b2b-4136-9fe1-a2c94fbbfd4b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.678640 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d0be7-27f5-40c2-84f2-92920d91535c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.679277 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d0be7-27f5-40c2-84f2-92920d91535c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.679560 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d0be7-27f5-40c2-84f2-92920d91535c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.679836 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d0be7-27f5-40c2-84f2-92920d91535c admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.680621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d0be7-27f5-40c2-84f2-92920d91535c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:16.680924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d0be7-27f5-40c2-84f2-92920d91535c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:16.682788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d0be7-27f5-40c2-84f2-92920d91535c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:16.700424 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 552/1095] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:52:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:16.701519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a1a78-f4ae-47d0-aad7-46e4e5f9cc9a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:16.710883 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a1a78-f4ae-47d0-aad7-46e4e5f9cc9a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:16.715212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3aebbc-69b2-4d1f-992c-424fa1e7f98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:16.715861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3aebbc-69b2-4d1f-992c-424fa1e7f98e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:16.716136 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3aebbc-69b2-4d1f-992c-424fa1e7f98e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:16.716403 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3aebbc-69b2-4d1f-992c-424fa1e7f98e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:16.717221 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3aebbc-69b2-4d1f-992c-424fa1e7f98e admin admin] RBAC: Adding query filter params (role.id=d846ce53fbf24866ad1005504008a71d, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=fcd50adcd390465ea6fc8582e1524909) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:16.717521 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3aebbc-69b2-4d1f-992c-424fa1e7f98e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:16.719366 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3aebbc-69b2-4d1f-992c-424fa1e7f98e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:16.724905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 544/1096] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:52:16 2021] GET /identity/v3/role_assignments?user.id=fcd50adcd390465ea6fc8582e1524909&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=d846ce53fbf24866ad1005504008a71d => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:18.767785 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44998fe2-a424-45b9-ae6b-4a0e21dd88d7 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:18.768353 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44998fe2-a424-45b9-ae6b-4a0e21dd88d7 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:18.768353 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44998fe2-a424-45b9-ae6b-4a0e21dd88d7 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:18.770130 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 553/1097] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:18.775779 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bf5c8-640b-49cb-84a1-6e4cf79f8074 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:18.776194 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bf5c8-640b-49cb-84a1-6e4cf79f8074 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:18.776332 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bf5c8-640b-49cb-84a1-6e4cf79f8074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:18.794738 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-e69bf5c8-640b-49cb-84a1-6e4cf79f8074 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:18.795896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e69bf5c8-640b-49cb-84a1-6e4cf79f8074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:18.803344 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 545/1098] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:18 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:18.827873 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44998fe2-a424-45b9-ae6b-4a0e21dd88d7 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:18.839491 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44998fe2-a424-45b9-ae6b-4a0e21dd88d7 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:18.844296 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b0cfd-5f34-4301-ad71-206733de0ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:18.845044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b0cfd-5f34-4301-ad71-206733de0ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:18.845318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b0cfd-5f34-4301-ad71-206733de0ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:18.845587 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b0cfd-5f34-4301-ad71-206733de0ab4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:18.855238 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b0cfd-5f34-4301-ad71-206733de0ab4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:52:18.862012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-d54b0cfd-5f34-4301-ad71-206733de0ab4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:52:18.863106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 554/1099] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:52:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:18.869030 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bf5c8-640b-49cb-84a1-6e4cf79f8074 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:18.877545 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bf5c8-640b-49cb-84a1-6e4cf79f8074 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:18.881935 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36d016-85c1-4855-828a-2768c7ae22df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:18.882594 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36d016-85c1-4855-828a-2768c7ae22df admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:18.882872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36d016-85c1-4855-828a-2768c7ae22df admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:18.883140 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36d016-85c1-4855-828a-2768c7ae22df admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:18.884178 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36d016-85c1-4855-828a-2768c7ae22df admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:18.884480 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36d016-85c1-4855-828a-2768c7ae22df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:18.886068 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36d016-85c1-4855-828a-2768c7ae22df admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:18.894423 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 546/1100] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:52:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:18.900138 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b0cfd-5f34-4301-ad71-206733de0ab4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:18.910297 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b0cfd-5f34-4301-ad71-206733de0ab4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:18.914605 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40bef9-6bf1-4090-baa2-13193611b5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:18.915395 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40bef9-6bf1-4090-baa2-13193611b5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:18.915668 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40bef9-6bf1-4090-baa2-13193611b5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:18.915936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40bef9-6bf1-4090-baa2-13193611b5f4 admin admin] PATH_INFO: `/v3/users/8b70e3d47a2946bda0936b5453f751a7` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:18.917088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40bef9-6bf1-4090-baa2-13193611b5f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b70e3d47a2946bda0936b5453f751a7)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:18.919193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40bef9-6bf1-4090-baa2-13193611b5f4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:18.920690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 555/1101] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:52:18 2021] GET /identity/v3/users/8b70e3d47a2946bda0936b5453f751a7 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:18.926216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36d016-85c1-4855-828a-2768c7ae22df admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:18.935091 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36d016-85c1-4855-828a-2768c7ae22df admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:18.939440 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301734f-edb6-43fe-91dd-005638a71d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:18.940032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301734f-edb6-43fe-91dd-005638a71d67 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:18.940311 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301734f-edb6-43fe-91dd-005638a71d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:18.940583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301734f-edb6-43fe-91dd-005638a71d67 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:18.947962 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301734f-edb6-43fe-91dd-005638a71d67 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:18.949623 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301734f-edb6-43fe-91dd-005638a71d67 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:18.958525 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 547/1102] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:52:18 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:52:18.964087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40bef9-6bf1-4090-baa2-13193611b5f4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:18.973525 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40bef9-6bf1-4090-baa2-13193611b5f4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:18.977833 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb244a-389b-4029-aafb-7a7b22e31443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:18.978758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb244a-389b-4029-aafb-7a7b22e31443 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:18.979036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb244a-389b-4029-aafb-7a7b22e31443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:18.979304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb244a-389b-4029-aafb-7a7b22e31443 admin admin] PATH_INFO: `/v3/projects/b974732e42f1498a8f6e1547c31c9496` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:18.980433 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb244a-389b-4029-aafb-7a7b22e31443 admin admin] RBAC: Authorizing `identity:get_project(project_id=b974732e42f1498a8f6e1547c31c9496)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:18.982426 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb244a-389b-4029-aafb-7a7b22e31443 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:18.983986 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 556/1103] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:52:18 2021] GET /identity/v3/projects/b974732e42f1498a8f6e1547c31c9496 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:18.989747 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301734f-edb6-43fe-91dd-005638a71d67 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:18.997903 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301734f-edb6-43fe-91dd-005638a71d67 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:19.002344 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fc6a4-0ff3-40c4-8c8d-cb2ba9f64246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:19.002933 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fc6a4-0ff3-40c4-8c8d-cb2ba9f64246 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:19.003212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fc6a4-0ff3-40c4-8c8d-cb2ba9f64246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:19.003484 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fc6a4-0ff3-40c4-8c8d-cb2ba9f64246 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:19.004285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fc6a4-0ff3-40c4-8c8d-cb2ba9f64246 admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=b974732e42f1498a8f6e1547c31c9496, user.id=8b70e3d47a2946bda0936b5453f751a7) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:19.004586 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fc6a4-0ff3-40c4-8c8d-cb2ba9f64246 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:19.006386 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fc6a4-0ff3-40c4-8c8d-cb2ba9f64246 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:19.012107 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 548/1104] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:52:18 2021] GET /identity/v3/role_assignments?user.id=8b70e3d47a2946bda0936b5453f751a7&scope.project.id=b974732e42f1498a8f6e1547c31c9496&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:21.324562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3ff40-6b63-4170-af81-7ffe3ff6f9e0 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:21.325562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3ff40-6b63-4170-af81-7ffe3ff6f9e0 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:21.325679 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3ff40-6b63-4170-af81-7ffe3ff6f9e0 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:21.327439 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 557/1105] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:21.333279 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faabcf9-beb8-48c5-a310-a2c6bdbbd751 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:21.333684 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faabcf9-beb8-48c5-a310-a2c6bdbbd751 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:21.333824 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faabcf9-beb8-48c5-a310-a2c6bdbbd751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:21.351416 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-0faabcf9-beb8-48c5-a310-a2c6bdbbd751 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:21.352568 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0faabcf9-beb8-48c5-a310-a2c6bdbbd751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:21.360173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 549/1106] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:21.385625 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3ff40-6b63-4170-af81-7ffe3ff6f9e0 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:21.397791 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3ff40-6b63-4170-af81-7ffe3ff6f9e0 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:21.402090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966f5e9-2480-4e69-86a1-6e5721582e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:21.403475 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966f5e9-2480-4e69-86a1-6e5721582e0d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:21.403770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966f5e9-2480-4e69-86a1-6e5721582e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:21.404042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966f5e9-2480-4e69-86a1-6e5721582e0d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:21.405197 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966f5e9-2480-4e69-86a1-6e5721582e0d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:21.406886 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966f5e9-2480-4e69-86a1-6e5721582e0d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:21.408418 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 558/1107] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:21.414031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faabcf9-beb8-48c5-a310-a2c6bdbbd751 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:21.422444 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faabcf9-beb8-48c5-a310-a2c6bdbbd751 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:21.426784 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e63dd6-1721-4155-a917-cc2d54dcbc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:21.427413 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e63dd6-1721-4155-a917-cc2d54dcbc9b admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:21.427687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e63dd6-1721-4155-a917-cc2d54dcbc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:21.427957 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e63dd6-1721-4155-a917-cc2d54dcbc9b admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:21.428653 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e63dd6-1721-4155-a917-cc2d54dcbc9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:21.430551 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e63dd6-1721-4155-a917-cc2d54dcbc9b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:21.450502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 550/1108] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:52:21 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:52:23.790152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca383fdf-a64e-41c1-9d78-b29807527eba None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:23.792024 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca383fdf-a64e-41c1-9d78-b29807527eba None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:23.792024 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca383fdf-a64e-41c1-9d78-b29807527eba None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:23.792577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 559/1109] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:23.799096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d6959-0b29-4f9a-88ed-b65e49b5b60b None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:23.799518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d6959-0b29-4f9a-88ed-b65e49b5b60b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:23.799648 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d6959-0b29-4f9a-88ed-b65e49b5b60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:23.816566 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c98d6959-0b29-4f9a-88ed-b65e49b5b60b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:23.817718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c98d6959-0b29-4f9a-88ed-b65e49b5b60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:23.825086 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 551/1110] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:23 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:52:23.849080 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca383fdf-a64e-41c1-9d78-b29807527eba None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:23.861466 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca383fdf-a64e-41c1-9d78-b29807527eba None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:23.865758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634a828-698c-4e7a-9995-e516b8c64f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:23.866605 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634a828-698c-4e7a-9995-e516b8c64f71 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:23.866886 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634a828-698c-4e7a-9995-e516b8c64f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:23.867163 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634a828-698c-4e7a-9995-e516b8c64f71 admin admin] PATH_INFO: `/v3/roles/bcbedb9e465844d2a8baa6af3760e916` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:23.868620 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634a828-698c-4e7a-9995-e516b8c64f71 admin admin] RBAC: Authorizing `identity:get_role(role_id=bcbedb9e465844d2a8baa6af3760e916)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:23.869624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-c634a828-698c-4e7a-9995-e516b8c64f71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:52:23.869624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:52:23.869624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:52:23.870522 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634a828-698c-4e7a-9995-e516b8c64f71 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:23.871808 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 560/1111] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:52:23 2021] GET /identity/v3/roles/bcbedb9e465844d2a8baa6af3760e916 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:23.877450 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d6959-0b29-4f9a-88ed-b65e49b5b60b None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:23.886132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d6959-0b29-4f9a-88ed-b65e49b5b60b None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:23.890494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3778c3-b290-4c30-a61f-f595a3afc0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:23.891343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3778c3-b290-4c30-a61f-f595a3afc0bb admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:23.891619 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3778c3-b290-4c30-a61f-f595a3afc0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:23.891891 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3778c3-b290-4c30-a61f-f595a3afc0bb admin admin] PATH_INFO: `/v3/users/f32290a5073643a0a35d03785aa9ed2f` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:23.904976 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3778c3-b290-4c30-a61f-f595a3afc0bb admin admin] RBAC: Authorizing `identity:get_user(user_id=f32290a5073643a0a35d03785aa9ed2f)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:23.907094 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3778c3-b290-4c30-a61f-f595a3afc0bb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:23.908636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 552/1112] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:52:23 2021] GET /identity/v3/users/f32290a5073643a0a35d03785aa9ed2f => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:23.914430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634a828-698c-4e7a-9995-e516b8c64f71 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:23.924108 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634a828-698c-4e7a-9995-e516b8c64f71 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:23.928513 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a777a-8ca4-47e7-aff7-4af345232cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:23.929113 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a777a-8ca4-47e7-aff7-4af345232cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:23.929395 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a777a-8ca4-47e7-aff7-4af345232cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:23.929672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a777a-8ca4-47e7-aff7-4af345232cf8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:23.937227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a777a-8ca4-47e7-aff7-4af345232cf8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:23.938948 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a777a-8ca4-47e7-aff7-4af345232cf8 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:23.947451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 561/1113] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:52:23 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:52:23.953092 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3778c3-b290-4c30-a61f-f595a3afc0bb admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:23.961911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3778c3-b290-4c30-a61f-f595a3afc0bb admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:23.966803 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb92c4f-43ea-400c-90ec-f9b7400b1848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:23.967585 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb92c4f-43ea-400c-90ec-f9b7400b1848 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:23.967860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb92c4f-43ea-400c-90ec-f9b7400b1848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:23.968127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb92c4f-43ea-400c-90ec-f9b7400b1848 admin admin] PATH_INFO: `/v3/projects/b974732e42f1498a8f6e1547c31c9496` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:23.969262 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb92c4f-43ea-400c-90ec-f9b7400b1848 admin admin] RBAC: Authorizing `identity:get_project(project_id=b974732e42f1498a8f6e1547c31c9496)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:23.971243 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb92c4f-43ea-400c-90ec-f9b7400b1848 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:23.972793 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 553/1114] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:52:23 2021] GET /identity/v3/projects/b974732e42f1498a8f6e1547c31c9496 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:23.978836 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a777a-8ca4-47e7-aff7-4af345232cf8 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:23.987644 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a777a-8ca4-47e7-aff7-4af345232cf8 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:23.992305 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c906c6-8ed2-41be-bc2b-9aa0c76186c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:23.992907 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c906c6-8ed2-41be-bc2b-9aa0c76186c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:23.993187 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c906c6-8ed2-41be-bc2b-9aa0c76186c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:23.993461 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c906c6-8ed2-41be-bc2b-9aa0c76186c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:23.994306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c906c6-8ed2-41be-bc2b-9aa0c76186c5 admin admin] RBAC: Adding query filter params (role.id=bcbedb9e465844d2a8baa6af3760e916, scope.project.id=b974732e42f1498a8f6e1547c31c9496, user.id=f32290a5073643a0a35d03785aa9ed2f) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:23.994640 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c906c6-8ed2-41be-bc2b-9aa0c76186c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:23.996392 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c906c6-8ed2-41be-bc2b-9aa0c76186c5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:24.001703 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 562/1115] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:52:23 2021] GET /identity/v3/role_assignments?user.id=f32290a5073643a0a35d03785aa9ed2f&scope.project.id=b974732e42f1498a8f6e1547c31c9496&role.id=bcbedb9e465844d2a8baa6af3760e916 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:26.269769 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3aeab-c636-49d2-badc-3672692c9348 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:26.270314 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3aeab-c636-49d2-badc-3672692c9348 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:26.270314 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3aeab-c636-49d2-badc-3672692c9348 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:26.272087 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 554/1116] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:26.278272 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f356b-f2c9-4443-bb0e-d6fa3b7f660e None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:26.278665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f356b-f2c9-4443-bb0e-d6fa3b7f660e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:26.278829 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f356b-f2c9-4443-bb0e-d6fa3b7f660e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:26.296500 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-799f356b-f2c9-4443-bb0e-d6fa3b7f660e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:26.297667 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-799f356b-f2c9-4443-bb0e-d6fa3b7f660e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:26.305122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 563/1117] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:26.328892 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3aeab-c636-49d2-badc-3672692c9348 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:26.341166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3aeab-c636-49d2-badc-3672692c9348 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:26.345411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c24a26-9f96-4ef9-a8d5-e8e6cda17295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:26.346270 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c24a26-9f96-4ef9-a8d5-e8e6cda17295 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:26.346548 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c24a26-9f96-4ef9-a8d5-e8e6cda17295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:26.346818 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c24a26-9f96-4ef9-a8d5-e8e6cda17295 admin admin] PATH_INFO: `/v3/roles/bcbedb9e465844d2a8baa6af3760e916` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:26.348273 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c24a26-9f96-4ef9-a8d5-e8e6cda17295 admin admin] RBAC: Authorizing `identity:get_role(role_id=bcbedb9e465844d2a8baa6af3760e916)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:26.349285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-72c24a26-9f96-4ef9-a8d5-e8e6cda17295 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:52:26.349285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:52:26.349285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:52:26.350182 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c24a26-9f96-4ef9-a8d5-e8e6cda17295 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:26.351468 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 555/1118] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:52:26 2021] GET /identity/v3/roles/bcbedb9e465844d2a8baa6af3760e916 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:26.357187 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f356b-f2c9-4443-bb0e-d6fa3b7f660e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:26.365712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f356b-f2c9-4443-bb0e-d6fa3b7f660e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:26.370101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9963f4-f2ed-4ed3-920a-2983e64719e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:26.370929 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9963f4-f2ed-4ed3-920a-2983e64719e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:26.371207 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9963f4-f2ed-4ed3-920a-2983e64719e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:26.371480 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9963f4-f2ed-4ed3-920a-2983e64719e1 admin admin] PATH_INFO: `/v3/users/f32290a5073643a0a35d03785aa9ed2f` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:26.372656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9963f4-f2ed-4ed3-920a-2983e64719e1 admin admin] RBAC: Authorizing `identity:get_user(user_id=f32290a5073643a0a35d03785aa9ed2f)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:26.374762 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9963f4-f2ed-4ed3-920a-2983e64719e1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:26.376404 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 564/1119] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:52:26 2021] GET /identity/v3/users/f32290a5073643a0a35d03785aa9ed2f => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:26.381963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c24a26-9f96-4ef9-a8d5-e8e6cda17295 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:26.392526 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c24a26-9f96-4ef9-a8d5-e8e6cda17295 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:26.396892 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc094a1-d8c6-412c-9c67-79ab0fe9b371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:26.397692 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc094a1-d8c6-412c-9c67-79ab0fe9b371 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:26.397965 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc094a1-d8c6-412c-9c67-79ab0fe9b371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:26.398262 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc094a1-d8c6-412c-9c67-79ab0fe9b371 admin admin] PATH_INFO: `/v3/projects/b974732e42f1498a8f6e1547c31c9496` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:26.399411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc094a1-d8c6-412c-9c67-79ab0fe9b371 admin admin] RBAC: Authorizing `identity:get_project(project_id=b974732e42f1498a8f6e1547c31c9496)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:26.401393 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc094a1-d8c6-412c-9c67-79ab0fe9b371 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:26.403580 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 556/1120] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:52:26 2021] GET /identity/v3/projects/b974732e42f1498a8f6e1547c31c9496 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:26.409505 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9963f4-f2ed-4ed3-920a-2983e64719e1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:26.418801 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9963f4-f2ed-4ed3-920a-2983e64719e1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:26.423198 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e96a91-b0b8-4d8a-b629-d9d170157abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:26.424037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e96a91-b0b8-4d8a-b629-d9d170157abe admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:26.424318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e96a91-b0b8-4d8a-b629-d9d170157abe admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:26.424595 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e96a91-b0b8-4d8a-b629-d9d170157abe admin admin] PATH_INFO: `/v3/projects/b974732e42f1498a8f6e1547c31c9496/users/f32290a5073643a0a35d03785aa9ed2f/roles/bcbedb9e465844d2a8baa6af3760e916` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:26.426819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e96a91-b0b8-4d8a-b629-d9d170157abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b974732e42f1498a8f6e1547c31c9496, user_id=f32290a5073643a0a35d03785aa9ed2f, role_id=bcbedb9e465844d2a8baa6af3760e916)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:26.429395 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e96a91-b0b8-4d8a-b629-d9d170157abe admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:26.441591 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 565/1121] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:52:26 2021] PUT /identity/v3/projects/b974732e42f1498a8f6e1547c31c9496/users/f32290a5073643a0a35d03785aa9ed2f/roles/bcbedb9e465844d2a8baa6af3760e916 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:52:28.738030 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807f23b-aa49-4a96-ad02-d400ffd10b9c None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:28.738615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807f23b-aa49-4a96-ad02-d400ffd10b9c None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:28.738615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807f23b-aa49-4a96-ad02-d400ffd10b9c None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:28.740329 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 557/1122] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:28.746078 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343a96f-e95a-44d6-a374-b430a294a28c None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:28.747129 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343a96f-e95a-44d6-a374-b430a294a28c None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:28.747240 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343a96f-e95a-44d6-a374-b430a294a28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:28.765242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a343a96f-e95a-44d6-a374-b430a294a28c None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:28.766455 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a343a96f-e95a-44d6-a374-b430a294a28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:28.820824 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 566/1123] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:28 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:28.844945 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807f23b-aa49-4a96-ad02-d400ffd10b9c None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:28.857239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807f23b-aa49-4a96-ad02-d400ffd10b9c None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:28.861556 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e32043-f0fc-4a13-b621-ddbab85b5d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:28.862417 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e32043-f0fc-4a13-b621-ddbab85b5d84 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:28.862701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e32043-f0fc-4a13-b621-ddbab85b5d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:28.863004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e32043-f0fc-4a13-b621-ddbab85b5d84 admin admin] PATH_INFO: `/v3/roles/bcbedb9e465844d2a8baa6af3760e916` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:28.864506 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e32043-f0fc-4a13-b621-ddbab85b5d84 admin admin] RBAC: Authorizing `identity:get_role(role_id=bcbedb9e465844d2a8baa6af3760e916)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:28.866125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e32043-f0fc-4a13-b621-ddbab85b5d84 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:28.867429 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 558/1124] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:52:28 2021] GET /identity/v3/roles/bcbedb9e465844d2a8baa6af3760e916 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:28.873782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343a96f-e95a-44d6-a374-b430a294a28c None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:28.882332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343a96f-e95a-44d6-a374-b430a294a28c None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:28.887013 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62422a9b-5a1b-403c-a820-6f9d90465e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:28.887847 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62422a9b-5a1b-403c-a820-6f9d90465e7c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:28.888128 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62422a9b-5a1b-403c-a820-6f9d90465e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:28.888403 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62422a9b-5a1b-403c-a820-6f9d90465e7c admin admin] PATH_INFO: `/v3/users/f32290a5073643a0a35d03785aa9ed2f` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:28.889599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62422a9b-5a1b-403c-a820-6f9d90465e7c admin admin] RBAC: Authorizing `identity:get_user(user_id=f32290a5073643a0a35d03785aa9ed2f)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:28.891728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62422a9b-5a1b-403c-a820-6f9d90465e7c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:28.893257 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 567/1125] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:52:28 2021] GET /identity/v3/users/f32290a5073643a0a35d03785aa9ed2f => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:28.899002 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e32043-f0fc-4a13-b621-ddbab85b5d84 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:28.907939 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e32043-f0fc-4a13-b621-ddbab85b5d84 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:28.912271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aeb53-2ad9-4bc6-a45b-2db40adcde46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:28.912857 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aeb53-2ad9-4bc6-a45b-2db40adcde46 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:28.913139 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aeb53-2ad9-4bc6-a45b-2db40adcde46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:28.913413 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aeb53-2ad9-4bc6-a45b-2db40adcde46 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:28.921343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aeb53-2ad9-4bc6-a45b-2db40adcde46 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:28.923033 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aeb53-2ad9-4bc6-a45b-2db40adcde46 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:28.931615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 559/1126] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:52:28 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:52:28.937845 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62422a9b-5a1b-403c-a820-6f9d90465e7c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:28.946836 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62422a9b-5a1b-403c-a820-6f9d90465e7c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:28.951244 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a05d70-1b22-419f-a728-81945ef5a114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:28.952012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a05d70-1b22-419f-a728-81945ef5a114 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:28.952291 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a05d70-1b22-419f-a728-81945ef5a114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:28.952564 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a05d70-1b22-419f-a728-81945ef5a114 admin admin] PATH_INFO: `/v3/projects/b974732e42f1498a8f6e1547c31c9496` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:28.953712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a05d70-1b22-419f-a728-81945ef5a114 admin admin] RBAC: Authorizing `identity:get_project(project_id=b974732e42f1498a8f6e1547c31c9496)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:28.955710 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a05d70-1b22-419f-a728-81945ef5a114 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:28.957277 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 568/1127] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:52:28 2021] GET /identity/v3/projects/b974732e42f1498a8f6e1547c31c9496 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:28.963339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aeb53-2ad9-4bc6-a45b-2db40adcde46 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:28.972021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aeb53-2ad9-4bc6-a45b-2db40adcde46 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:28.976423 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa5d87-c4d5-4d74-9c91-ec6438da3d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:28.977008 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa5d87-c4d5-4d74-9c91-ec6438da3d68 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:28.977290 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa5d87-c4d5-4d74-9c91-ec6438da3d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:28.977563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa5d87-c4d5-4d74-9c91-ec6438da3d68 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:28.978407 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa5d87-c4d5-4d74-9c91-ec6438da3d68 admin admin] RBAC: Adding query filter params (role.id=bcbedb9e465844d2a8baa6af3760e916, scope.project.id=b974732e42f1498a8f6e1547c31c9496, user.id=f32290a5073643a0a35d03785aa9ed2f) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:28.978721 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa5d87-c4d5-4d74-9c91-ec6438da3d68 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:28.980466 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa5d87-c4d5-4d74-9c91-ec6438da3d68 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:28.986720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 560/1128] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:52:28 2021] GET /identity/v3/role_assignments?user.id=f32290a5073643a0a35d03785aa9ed2f&scope.project.id=b974732e42f1498a8f6e1547c31c9496&role.id=bcbedb9e465844d2a8baa6af3760e916 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:31.324031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a89e0f-5800-423e-93b1-8289fec3f9e2 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:31.324574 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a89e0f-5800-423e-93b1-8289fec3f9e2 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:31.324574 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a89e0f-5800-423e-93b1-8289fec3f9e2 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:31.326384 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 569/1129] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:31.332136 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ea489-19c7-4c84-92d4-cf95a4594436 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:31.332512 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ea489-19c7-4c84-92d4-cf95a4594436 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:31.332698 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ea489-19c7-4c84-92d4-cf95a4594436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:31.350215 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-450ea489-19c7-4c84-92d4-cf95a4594436 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:31.351381 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-450ea489-19c7-4c84-92d4-cf95a4594436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:31.359470 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 561/1130] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:31 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:31.383602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a89e0f-5800-423e-93b1-8289fec3f9e2 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:31.395347 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a89e0f-5800-423e-93b1-8289fec3f9e2 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:31.399675 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c249e-8f05-4398-a7de-5c182f6c5e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:31.400429 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c249e-8f05-4398-a7de-5c182f6c5e3e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:31.400710 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c249e-8f05-4398-a7de-5c182f6c5e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:31.400986 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c249e-8f05-4398-a7de-5c182f6c5e3e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:31.402188 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c249e-8f05-4398-a7de-5c182f6c5e3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:31.404379 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c249e-8f05-4398-a7de-5c182f6c5e3e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:31.405908 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 570/1131] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:31.411641 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ea489-19c7-4c84-92d4-cf95a4594436 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:31.420674 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ea489-19c7-4c84-92d4-cf95a4594436 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:31.425088 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93640-21db-4360-8046-ca009faf2a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:31.425707 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93640-21db-4360-8046-ca009faf2a80 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:31.426002 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93640-21db-4360-8046-ca009faf2a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:31.426294 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93640-21db-4360-8046-ca009faf2a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:31.427004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa93640-21db-4360-8046-ca009faf2a80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:31.428858 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa93640-21db-4360-8046-ca009faf2a80 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:31.452850 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 562/1132] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Dec 15 02:52:31 2021] POST /identity/v3/projects => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:52:33.782784 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a0960-23c3-4b99-a55b-588a19eab028 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:33.783334 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a0960-23c3-4b99-a55b-588a19eab028 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:33.783334 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a0960-23c3-4b99-a55b-588a19eab028 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:33.785083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 571/1133] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:33.790760 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f99641-ab78-42b3-a247-11d11f928b7d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:33.791189 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f99641-ab78-42b3-a247-11d11f928b7d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:33.791313 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f99641-ab78-42b3-a247-11d11f928b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:33.809494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-28f99641-ab78-42b3-a247-11d11f928b7d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:33.810678 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-28f99641-ab78-42b3-a247-11d11f928b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:33.863665 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 563/1134] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:33.889418 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a0960-23c3-4b99-a55b-588a19eab028 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:33.901081 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a0960-23c3-4b99-a55b-588a19eab028 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:33.905910 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dc0a5-51b4-419c-8f1e-c2fb92dd728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:33.906692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dc0a5-51b4-419c-8f1e-c2fb92dd728f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:33.906972 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dc0a5-51b4-419c-8f1e-c2fb92dd728f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:33.907247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dc0a5-51b4-419c-8f1e-c2fb92dd728f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:33.908397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4dc0a5-51b4-419c-8f1e-c2fb92dd728f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:33.910081 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4dc0a5-51b4-419c-8f1e-c2fb92dd728f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:33.911602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 572/1135] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:52:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:33.917245 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f99641-ab78-42b3-a247-11d11f928b7d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:33.925711 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f99641-ab78-42b3-a247-11d11f928b7d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:33.930073 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bf350-e5e6-483b-9579-5eefcdb6277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:33.930700 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bf350-e5e6-483b-9579-5eefcdb6277a admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:33.930974 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bf350-e5e6-483b-9579-5eefcdb6277a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:33.931243 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bf350-e5e6-483b-9579-5eefcdb6277a admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:33.931953 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bf350-e5e6-483b-9579-5eefcdb6277a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:33.933823 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bf350-e5e6-483b-9579-5eefcdb6277a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:33.952764 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 564/1136] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:52:33 2021] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:52:36.300964 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab5bb-8cca-4834-a0ee-88ce30669b3a None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:36.301491 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab5bb-8cca-4834-a0ee-88ce30669b3a None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:36.301491 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab5bb-8cca-4834-a0ee-88ce30669b3a None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:36.303293 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 573/1137] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:36.308898 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a20d3c-6ba7-4dd3-976d-aff7ff6a34b4 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:36.309290 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a20d3c-6ba7-4dd3-976d-aff7ff6a34b4 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:36.309431 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a20d3c-6ba7-4dd3-976d-aff7ff6a34b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:36.326793 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-e8a20d3c-6ba7-4dd3-976d-aff7ff6a34b4 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:36.327942 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e8a20d3c-6ba7-4dd3-976d-aff7ff6a34b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:36.335492 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 565/1138] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:36.360006 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eab5bb-8cca-4834-a0ee-88ce30669b3a None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:36.371602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eab5bb-8cca-4834-a0ee-88ce30669b3a None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:36.375936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec48ab-6509-4088-971c-288713ebc2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:36.376690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec48ab-6509-4088-971c-288713ebc2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:36.376966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec48ab-6509-4088-971c-288713ebc2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:36.377236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec48ab-6509-4088-971c-288713ebc2c8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:36.387730 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec48ab-6509-4088-971c-288713ebc2c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:52:36.394414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-33ec48ab-6509-4088-971c-288713ebc2c8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:52:36.395514 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 574/1139] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:52:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:36.401553 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a20d3c-6ba7-4dd3-976d-aff7ff6a34b4 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:36.410838 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a20d3c-6ba7-4dd3-976d-aff7ff6a34b4 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:36.415259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d52aea-6a33-4119-b4a1-74848ca50877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:36.415896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d52aea-6a33-4119-b4a1-74848ca50877 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:36.416173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d52aea-6a33-4119-b4a1-74848ca50877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:36.416447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d52aea-6a33-4119-b4a1-74848ca50877 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:36.417198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d52aea-6a33-4119-b4a1-74848ca50877 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:36.417505 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d52aea-6a33-4119-b4a1-74848ca50877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:36.419139 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d52aea-6a33-4119-b4a1-74848ca50877 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:36.429868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 566/1140] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:52:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:36.436526 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec48ab-6509-4088-971c-288713ebc2c8 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:36.446432 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec48ab-6509-4088-971c-288713ebc2c8 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:36.451419 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6c273-60a3-40ee-b278-d7d9a5dc16ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:36.452244 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6c273-60a3-40ee-b278-d7d9a5dc16ec admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:36.452523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6c273-60a3-40ee-b278-d7d9a5dc16ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:36.452797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6c273-60a3-40ee-b278-d7d9a5dc16ec admin admin] PATH_INFO: `/v3/users/e72fef3b38004e739afdfaba0ad86a33` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:36.465316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6c273-60a3-40ee-b278-d7d9a5dc16ec admin admin] RBAC: Authorizing `identity:get_user(user_id=e72fef3b38004e739afdfaba0ad86a33)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:36.467385 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6c273-60a3-40ee-b278-d7d9a5dc16ec admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:36.468939 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 575/1141] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:52:36 2021] GET /identity/v3/users/e72fef3b38004e739afdfaba0ad86a33 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:36.474839 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d52aea-6a33-4119-b4a1-74848ca50877 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:36.484487 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d52aea-6a33-4119-b4a1-74848ca50877 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:36.488938 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed214e-2e69-4570-bc5e-99d8b46fcfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:36.489551 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed214e-2e69-4570-bc5e-99d8b46fcfa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:36.489833 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed214e-2e69-4570-bc5e-99d8b46fcfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:36.490156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed214e-2e69-4570-bc5e-99d8b46fcfa7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:36.498838 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed214e-2e69-4570-bc5e-99d8b46fcfa7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:36.500559 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed214e-2e69-4570-bc5e-99d8b46fcfa7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:36.509339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 567/1142] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:52:36 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:52:36.515831 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6c273-60a3-40ee-b278-d7d9a5dc16ec admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:36.524919 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6c273-60a3-40ee-b278-d7d9a5dc16ec admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:36.529332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a454e-b957-4905-a2a9-9e29817a468e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:36.530164 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a454e-b957-4905-a2a9-9e29817a468e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:36.530446 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a454e-b957-4905-a2a9-9e29817a468e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:36.530720 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a454e-b957-4905-a2a9-9e29817a468e admin admin] PATH_INFO: `/v3/projects/624841362f5846dcb492dbca5095e1c3` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:36.531862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a454e-b957-4905-a2a9-9e29817a468e admin admin] RBAC: Authorizing `identity:get_project(project_id=624841362f5846dcb492dbca5095e1c3)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:36.533829 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a454e-b957-4905-a2a9-9e29817a468e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:36.535604 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 576/1143] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:52:36 2021] GET /identity/v3/projects/624841362f5846dcb492dbca5095e1c3 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:36.541216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed214e-2e69-4570-bc5e-99d8b46fcfa7 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:36.549515 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed214e-2e69-4570-bc5e-99d8b46fcfa7 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:36.553936 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c379c8-d8cb-46bd-896f-98c1ccd7c51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:36.554562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c379c8-d8cb-46bd-896f-98c1ccd7c51d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:36.554845 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c379c8-d8cb-46bd-896f-98c1ccd7c51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:36.555122 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c379c8-d8cb-46bd-896f-98c1ccd7c51d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:36.555955 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c379c8-d8cb-46bd-896f-98c1ccd7c51d admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=624841362f5846dcb492dbca5095e1c3, user.id=e72fef3b38004e739afdfaba0ad86a33) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:36.556259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c379c8-d8cb-46bd-896f-98c1ccd7c51d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:36.558041 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c379c8-d8cb-46bd-896f-98c1ccd7c51d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:36.563718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 568/1144] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:52:36 2021] GET /identity/v3/role_assignments?user.id=e72fef3b38004e739afdfaba0ad86a33&scope.project.id=624841362f5846dcb492dbca5095e1c3&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:38.837415 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e162a-aa4b-40e7-a284-c2ceec1dfc7e None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:38.837968 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e162a-aa4b-40e7-a284-c2ceec1dfc7e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:38.837968 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e162a-aa4b-40e7-a284-c2ceec1dfc7e None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:38.839765 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 577/1145] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:38.845592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bc929-c59d-4d98-b4e2-6293d40d2a36 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:38.846018 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bc929-c59d-4d98-b4e2-6293d40d2a36 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:38.846193 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bc929-c59d-4d98-b4e2-6293d40d2a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:38.863261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-ce5bc929-c59d-4d98-b4e2-6293d40d2a36 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:38.864431 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-ce5bc929-c59d-4d98-b4e2-6293d40d2a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:38.872549 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 569/1146] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:38.896065 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e162a-aa4b-40e7-a284-c2ceec1dfc7e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:38.907820 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e162a-aa4b-40e7-a284-c2ceec1dfc7e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:38.912164 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cb1b6-7bd8-4fea-8ece-b3e9765fadba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:38.912915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cb1b6-7bd8-4fea-8ece-b3e9765fadba admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:38.913199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cb1b6-7bd8-4fea-8ece-b3e9765fadba admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:38.913475 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cb1b6-7bd8-4fea-8ece-b3e9765fadba admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:38.923377 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cb1b6-7bd8-4fea-8ece-b3e9765fadba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:52:38.930152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-8c5cb1b6-7bd8-4fea-8ece-b3e9765fadba admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:52:38.931256 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 578/1147] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:52:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:38.937632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bc929-c59d-4d98-b4e2-6293d40d2a36 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:38.946200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bc929-c59d-4d98-b4e2-6293d40d2a36 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:38.951276 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a8922-1d56-41b6-af0f-0f4128326218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:38.951906 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a8922-1d56-41b6-af0f-0f4128326218 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:38.952187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a8922-1d56-41b6-af0f-0f4128326218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:38.952461 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a8922-1d56-41b6-af0f-0f4128326218 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:38.953210 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a8922-1d56-41b6-af0f-0f4128326218 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:38.953516 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a8922-1d56-41b6-af0f-0f4128326218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:38.955116 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a8922-1d56-41b6-af0f-0f4128326218 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:38.962993 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 570/1148] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:52:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:38.968863 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cb1b6-7bd8-4fea-8ece-b3e9765fadba admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:38.978560 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cb1b6-7bd8-4fea-8ece-b3e9765fadba admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:38.983020 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28c179-39c8-4002-ab48-a0985bc864df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:38.983820 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28c179-39c8-4002-ab48-a0985bc864df admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:38.984102 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28c179-39c8-4002-ab48-a0985bc864df admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:38.984378 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28c179-39c8-4002-ab48-a0985bc864df admin admin] PATH_INFO: `/v3/users/e72fef3b38004e739afdfaba0ad86a33` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:38.985557 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28c179-39c8-4002-ab48-a0985bc864df admin admin] RBAC: Authorizing `identity:get_user(user_id=e72fef3b38004e739afdfaba0ad86a33)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:38.987667 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28c179-39c8-4002-ab48-a0985bc864df admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:38.989204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 579/1149] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:52:38 2021] GET /identity/v3/users/e72fef3b38004e739afdfaba0ad86a33 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:38.994869 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a8922-1d56-41b6-af0f-0f4128326218 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:39.004262 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a8922-1d56-41b6-af0f-0f4128326218 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:39.008851 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce33b45-743b-4905-a9b2-082ee8109729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:39.009643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce33b45-743b-4905-a9b2-082ee8109729 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:39.009918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce33b45-743b-4905-a9b2-082ee8109729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:39.010213 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce33b45-743b-4905-a9b2-082ee8109729 admin admin] PATH_INFO: `/v3/projects/624841362f5846dcb492dbca5095e1c3` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:39.011343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce33b45-743b-4905-a9b2-082ee8109729 admin admin] RBAC: Authorizing `identity:get_project(project_id=624841362f5846dcb492dbca5095e1c3)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:39.013909 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce33b45-743b-4905-a9b2-082ee8109729 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:39.015500 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 571/1150] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:52:38 2021] GET /identity/v3/projects/624841362f5846dcb492dbca5095e1c3 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:39.021188 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28c179-39c8-4002-ab48-a0985bc864df admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:39.030268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28c179-39c8-4002-ab48-a0985bc864df admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:39.034740 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15dced8-389c-4888-8939-3f325e548a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:39.035565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dced8-389c-4888-8939-3f325e548a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:39.035845 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dced8-389c-4888-8939-3f325e548a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:39.036123 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dced8-389c-4888-8939-3f325e548a6e admin admin] PATH_INFO: `/v3/projects/624841362f5846dcb492dbca5095e1c3/users/e72fef3b38004e739afdfaba0ad86a33/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:39.038058 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dced8-389c-4888-8939-3f325e548a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=624841362f5846dcb492dbca5095e1c3, user_id=e72fef3b38004e739afdfaba0ad86a33, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:39.040604 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dced8-389c-4888-8939-3f325e548a6e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:39.052849 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 580/1151] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:52:39 2021] PUT /identity/v3/projects/624841362f5846dcb492dbca5095e1c3/users/e72fef3b38004e739afdfaba0ad86a33/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:52:41.345196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628aaca-8644-490c-a636-ecc884f09b6d None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:41.345709 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628aaca-8644-490c-a636-ecc884f09b6d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:41.345814 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628aaca-8644-490c-a636-ecc884f09b6d None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:41.347543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 572/1152] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:41.353130 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b9d73-4545-4895-9ed0-491a82451791 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:41.353569 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b9d73-4545-4895-9ed0-491a82451791 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:41.353662 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b9d73-4545-4895-9ed0-491a82451791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:41.370599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-c28b9d73-4545-4895-9ed0-491a82451791 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:41.371749 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c28b9d73-4545-4895-9ed0-491a82451791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:41.425923 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 581/1153] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:41.450052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628aaca-8644-490c-a636-ecc884f09b6d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:41.461753 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628aaca-8644-490c-a636-ecc884f09b6d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:41.466613 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70eb936-8251-4eed-b405-e59a3539054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:41.467363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70eb936-8251-4eed-b405-e59a3539054b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:41.467640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70eb936-8251-4eed-b405-e59a3539054b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:41.467908 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70eb936-8251-4eed-b405-e59a3539054b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:41.477628 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70eb936-8251-4eed-b405-e59a3539054b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:52:41.484390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-d70eb936-8251-4eed-b405-e59a3539054b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:52:41.485543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 573/1154] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:52:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:41.491443 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b9d73-4545-4895-9ed0-491a82451791 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:41.500474 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b9d73-4545-4895-9ed0-491a82451791 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:41.504837 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e0523-38af-4d5c-a0e2-461e94cc42a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:41.505468 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e0523-38af-4d5c-a0e2-461e94cc42a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:41.505743 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e0523-38af-4d5c-a0e2-461e94cc42a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:41.506042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e0523-38af-4d5c-a0e2-461e94cc42a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:41.506786 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e0523-38af-4d5c-a0e2-461e94cc42a2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:41.507082 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e0523-38af-4d5c-a0e2-461e94cc42a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:41.508904 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e0523-38af-4d5c-a0e2-461e94cc42a2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:41.517227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 582/1155] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:52:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:41.523250 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70eb936-8251-4eed-b405-e59a3539054b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:41.533588 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70eb936-8251-4eed-b405-e59a3539054b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:41.538178 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72694073-96d5-49b6-9459-32af417921cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:41.538996 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72694073-96d5-49b6-9459-32af417921cf admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:41.539276 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72694073-96d5-49b6-9459-32af417921cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:41.539545 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72694073-96d5-49b6-9459-32af417921cf admin admin] PATH_INFO: `/v3/users/e72fef3b38004e739afdfaba0ad86a33` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:41.540739 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72694073-96d5-49b6-9459-32af417921cf admin admin] RBAC: Authorizing `identity:get_user(user_id=e72fef3b38004e739afdfaba0ad86a33)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:41.542866 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72694073-96d5-49b6-9459-32af417921cf admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:41.544517 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 574/1156] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:52:41 2021] GET /identity/v3/users/e72fef3b38004e739afdfaba0ad86a33 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:41.549937 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e0523-38af-4d5c-a0e2-461e94cc42a2 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:41.558929 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e0523-38af-4d5c-a0e2-461e94cc42a2 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:41.563330 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b76d3-b548-40ca-9ef3-e89223fa0bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:41.563920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b76d3-b548-40ca-9ef3-e89223fa0bac admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:41.564195 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b76d3-b548-40ca-9ef3-e89223fa0bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:41.564464 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b76d3-b548-40ca-9ef3-e89223fa0bac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:41.571791 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b76d3-b548-40ca-9ef3-e89223fa0bac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:41.573440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b76d3-b548-40ca-9ef3-e89223fa0bac admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:41.582277 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 583/1157] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:52:41 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:52:41.587950 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72694073-96d5-49b6-9459-32af417921cf admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:41.597594 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72694073-96d5-49b6-9459-32af417921cf admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:41.602021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c56f9-95a7-4a44-8c71-fb1ab549e717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:41.602801 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c56f9-95a7-4a44-8c71-fb1ab549e717 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:41.603082 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c56f9-95a7-4a44-8c71-fb1ab549e717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:41.603357 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c56f9-95a7-4a44-8c71-fb1ab549e717 admin admin] PATH_INFO: `/v3/projects/624841362f5846dcb492dbca5095e1c3` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:41.604505 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c56f9-95a7-4a44-8c71-fb1ab549e717 admin admin] RBAC: Authorizing `identity:get_project(project_id=624841362f5846dcb492dbca5095e1c3)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:41.606494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c56f9-95a7-4a44-8c71-fb1ab549e717 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:41.608062 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 575/1158] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:52:41 2021] GET /identity/v3/projects/624841362f5846dcb492dbca5095e1c3 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:41.613972 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b76d3-b548-40ca-9ef3-e89223fa0bac admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:41.622085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b76d3-b548-40ca-9ef3-e89223fa0bac admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:41.626443 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df120972-daad-4a58-9437-c236e6e5ce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:41.627023 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df120972-daad-4a58-9437-c236e6e5ce5a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:41.627298 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df120972-daad-4a58-9437-c236e6e5ce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:41.627569 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df120972-daad-4a58-9437-c236e6e5ce5a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:41.628363 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df120972-daad-4a58-9437-c236e6e5ce5a admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=624841362f5846dcb492dbca5095e1c3, user.id=e72fef3b38004e739afdfaba0ad86a33) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:41.628664 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df120972-daad-4a58-9437-c236e6e5ce5a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:41.630435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df120972-daad-4a58-9437-c236e6e5ce5a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:41.636102 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 584/1159] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:52:41 2021] GET /identity/v3/role_assignments?user.id=e72fef3b38004e739afdfaba0ad86a33&scope.project.id=624841362f5846dcb492dbca5095e1c3&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 608 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:43.951706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112153-20e7-4959-aabd-c250154c089b None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:43.952257 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112153-20e7-4959-aabd-c250154c089b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:43.952257 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112153-20e7-4959-aabd-c250154c089b None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:43.954046 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 576/1160] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:43.959922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a050f5-d5ee-4dbd-85de-94bd5545baf6 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:43.960336 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a050f5-d5ee-4dbd-85de-94bd5545baf6 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:43.960471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a050f5-d5ee-4dbd-85de-94bd5545baf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:43.978031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-b2a050f5-d5ee-4dbd-85de-94bd5545baf6 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:43.979192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b2a050f5-d5ee-4dbd-85de-94bd5545baf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:43.987280 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 585/1161] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:44.010766 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e112153-20e7-4959-aabd-c250154c089b None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:44.022610 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e112153-20e7-4959-aabd-c250154c089b None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:44.026926 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7b144-79d0-47dd-8d38-249c7f40c7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:44.028028 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b144-79d0-47dd-8d38-249c7f40c7ba admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:44.028310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b144-79d0-47dd-8d38-249c7f40c7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:44.028586 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b144-79d0-47dd-8d38-249c7f40c7ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:44.036064 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7b144-79d0-47dd-8d38-249c7f40c7ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:44.037778 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7b144-79d0-47dd-8d38-249c7f40c7ba admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:44.046816 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 577/1162] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:52:44 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:52:44.052742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a050f5-d5ee-4dbd-85de-94bd5545baf6 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:44.061274 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a050f5-d5ee-4dbd-85de-94bd5545baf6 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:44.065669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2c247-dd84-44d6-9a93-bd3df8aa49b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:44.066469 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2c247-dd84-44d6-9a93-bd3df8aa49b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:44.066749 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2c247-dd84-44d6-9a93-bd3df8aa49b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:44.067021 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2c247-dd84-44d6-9a93-bd3df8aa49b0 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:44.073653 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2c247-dd84-44d6-9a93-bd3df8aa49b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:44.075492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2c247-dd84-44d6-9a93-bd3df8aa49b0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:44.090096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-17b2c247-dd84-44d6-9a93-bd3df8aa49b0 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Dec 15 02:52:44.091181 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 586/1163] 10.222.0.18 () {56 vars in 1138 bytes} [Wed Dec 15 02:52:44 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:44.097224 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7b144-79d0-47dd-8d38-249c7f40c7ba admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:44.106369 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7b144-79d0-47dd-8d38-249c7f40c7ba admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:44.110839 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d615e5-d827-414d-99b9-1139abe39ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:44.111452 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d615e5-d827-414d-99b9-1139abe39ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:44.111733 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d615e5-d827-414d-99b9-1139abe39ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:44.112011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d615e5-d827-414d-99b9-1139abe39ca8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:44.112722 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d615e5-d827-414d-99b9-1139abe39ca8 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:44.113023 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d615e5-d827-414d-99b9-1139abe39ca8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:44.114599 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d615e5-d827-414d-99b9-1139abe39ca8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:44.121676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 578/1164] 10.222.0.18 () {56 vars in 1136 bytes} [Wed Dec 15 02:52:44 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:46.411077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5b083-11a3-44be-8b73-f34ae9064f91 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:46.411583 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5b083-11a3-44be-8b73-f34ae9064f91 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:46.411691 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5b083-11a3-44be-8b73-f34ae9064f91 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:46.413412 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 587/1165] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:46.419175 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06035f07-74e0-4659-88cb-e79c73d6e405 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:46.419576 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06035f07-74e0-4659-88cb-e79c73d6e405 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:46.419725 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06035f07-74e0-4659-88cb-e79c73d6e405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:46.437464 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-06035f07-74e0-4659-88cb-e79c73d6e405 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:46.438671 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-06035f07-74e0-4659-88cb-e79c73d6e405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:46.446256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 579/1166] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:46 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:46.470779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5b083-11a3-44be-8b73-f34ae9064f91 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:46.482390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5b083-11a3-44be-8b73-f34ae9064f91 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:46.486608 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228d924-86d4-4e61-8351-66b70068071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:46.487231 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228d924-86d4-4e61-8351-66b70068071d admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:46.487506 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228d924-86d4-4e61-8351-66b70068071d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:46.487776 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228d924-86d4-4e61-8351-66b70068071d admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:46.488515 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228d924-86d4-4e61-8351-66b70068071d admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:46.489512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-a228d924-86d4-4e61-8351-66b70068071d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:52:46.489512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:52:46.489512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:52:46.490407 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228d924-86d4-4e61-8351-66b70068071d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:46.504717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 588/1167] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Dec 15 02:52:46 2021] POST /identity/v3/domains => generated 267 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:52:48.874567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08801447-775f-4cc3-a40f-a921f4e206c3 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:48.875129 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08801447-775f-4cc3-a40f-a921f4e206c3 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:48.875129 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08801447-775f-4cc3-a40f-a921f4e206c3 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:48.876861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 580/1168] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:48.882738 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539407f-f3b9-4088-8f99-437138719fb8 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:48.883399 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539407f-f3b9-4088-8f99-437138719fb8 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:48.883542 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539407f-f3b9-4088-8f99-437138719fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:48.901465 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a539407f-f3b9-4088-8f99-437138719fb8 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:48.903250 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a539407f-f3b9-4088-8f99-437138719fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:48.956978 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 589/1169] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:48.981673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08801447-775f-4cc3-a40f-a921f4e206c3 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:48.993337 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08801447-775f-4cc3-a40f-a921f4e206c3 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:48.998169 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18df1d-b671-4a89-97a8-c53c19d5a23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:48.998988 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18df1d-b671-4a89-97a8-c53c19d5a23d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:48.999263 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18df1d-b671-4a89-97a8-c53c19d5a23d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:48.999534 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18df1d-b671-4a89-97a8-c53c19d5a23d admin admin] PATH_INFO: `/v3/domains/36b7fd19151c41f3b2da8a0148e7d6cc` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:49.009755 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18df1d-b671-4a89-97a8-c53c19d5a23d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=36b7fd19151c41f3b2da8a0148e7d6cc)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:49.011736 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18df1d-b671-4a89-97a8-c53c19d5a23d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:49.013272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 581/1170] 10.222.0.18 () {56 vars in 1204 bytes} [Wed Dec 15 02:52:48 2021] GET /identity/v3/domains/36b7fd19151c41f3b2da8a0148e7d6cc => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:49.019180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539407f-f3b9-4088-8f99-437138719fb8 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:49.027755 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539407f-f3b9-4088-8f99-437138719fb8 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:49.032165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5161f62-5247-4d65-b4e6-484cf1718340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:49.032777 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5161f62-5247-4d65-b4e6-484cf1718340 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:49.033059 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5161f62-5247-4d65-b4e6-484cf1718340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:49.033334 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5161f62-5247-4d65-b4e6-484cf1718340 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:49.034086 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5161f62-5247-4d65-b4e6-484cf1718340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:49.035947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5161f62-5247-4d65-b4e6-484cf1718340 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:49.060559 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 590/1171] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Dec 15 02:52:49 2021] POST /identity/v3/projects => generated 361 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 02:52:51.403494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc90f9f-eb5f-4e2f-bed5-ecc2e662db6d None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:51.404032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc90f9f-eb5f-4e2f-bed5-ecc2e662db6d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:51.404032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc90f9f-eb5f-4e2f-bed5-ecc2e662db6d None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:51.405785 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 582/1172] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:51.411809 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d01874-7c75-4f91-b47b-a183b72f2f16 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:51.412215 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d01874-7c75-4f91-b47b-a183b72f2f16 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:51.412360 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d01874-7c75-4f91-b47b-a183b72f2f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:51.429653 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a1d01874-7c75-4f91-b47b-a183b72f2f16 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:51.430848 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a1d01874-7c75-4f91-b47b-a183b72f2f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:51.484871 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 591/1173] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:51 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:51.510931 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc90f9f-eb5f-4e2f-bed5-ecc2e662db6d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:51.523161 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc90f9f-eb5f-4e2f-bed5-ecc2e662db6d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:51.527348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1dcd9-f669-468a-acdc-5a534efd0f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:51.528166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1dcd9-f669-468a-acdc-5a534efd0f5d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:51.528439 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1dcd9-f669-468a-acdc-5a534efd0f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:51.528715 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1dcd9-f669-468a-acdc-5a534efd0f5d admin admin] PATH_INFO: `/v3/domains/36b7fd19151c41f3b2da8a0148e7d6cc` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:51.529862 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1dcd9-f669-468a-acdc-5a534efd0f5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=36b7fd19151c41f3b2da8a0148e7d6cc)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:51.531791 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1dcd9-f669-468a-acdc-5a534efd0f5d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:51.533312 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 583/1174] 10.222.0.18 () {56 vars in 1204 bytes} [Wed Dec 15 02:52:51 2021] GET /identity/v3/domains/36b7fd19151c41f3b2da8a0148e7d6cc => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:51.539103 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d01874-7c75-4f91-b47b-a183b72f2f16 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:51.547647 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d01874-7c75-4f91-b47b-a183b72f2f16 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:51.552016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04350525-a057-40ee-9e44-908890e26485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:51.552652 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04350525-a057-40ee-9e44-908890e26485 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:51.552930 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04350525-a057-40ee-9e44-908890e26485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:51.553201 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04350525-a057-40ee-9e44-908890e26485 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:51.553914 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04350525-a057-40ee-9e44-908890e26485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:51.555823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04350525-a057-40ee-9e44-908890e26485 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:51.575407 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 592/1175] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:52:51 2021] POST /identity/v3/users => generated 311 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:52:53.908388 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06082ed3-e4da-450b-85a2-a1f9127f97e6 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:53.908945 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06082ed3-e4da-450b-85a2-a1f9127f97e6 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:53.908945 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06082ed3-e4da-450b-85a2-a1f9127f97e6 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:53.910761 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 584/1176] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:53.916566 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8e827-f4c5-4ca2-805c-3cd256951b3a None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:53.916984 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8e827-f4c5-4ca2-805c-3cd256951b3a None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:53.917112 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8e827-f4c5-4ca2-805c-3cd256951b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:53.935132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-c4f8e827-f4c5-4ca2-805c-3cd256951b3a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:53.936288 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c4f8e827-f4c5-4ca2-805c-3cd256951b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:53.943731 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 593/1177] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:53.968748 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06082ed3-e4da-450b-85a2-a1f9127f97e6 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:53.980546 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06082ed3-e4da-450b-85a2-a1f9127f97e6 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:53.984847 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6a479-3f2c-42ec-9d8c-a84953434d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:53.985602 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6a479-3f2c-42ec-9d8c-a84953434d40 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:53.985884 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6a479-3f2c-42ec-9d8c-a84953434d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:53.986188 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6a479-3f2c-42ec-9d8c-a84953434d40 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:53.996937 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6a479-3f2c-42ec-9d8c-a84953434d40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:52:54.003673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-7ab6a479-3f2c-42ec-9d8c-a84953434d40 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:52:54.004787 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 585/1178] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:52:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:54.011141 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8e827-f4c5-4ca2-805c-3cd256951b3a None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:54.020248 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8e827-f4c5-4ca2-805c-3cd256951b3a None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:54.024634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254db16f-207d-407b-8cc6-98c91e9b3d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:54.025269 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254db16f-207d-407b-8cc6-98c91e9b3d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:54.025545 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254db16f-207d-407b-8cc6-98c91e9b3d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:54.025817 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254db16f-207d-407b-8cc6-98c91e9b3d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:54.026601 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254db16f-207d-407b-8cc6-98c91e9b3d77 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:54.026904 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254db16f-207d-407b-8cc6-98c91e9b3d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:54.028463 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254db16f-207d-407b-8cc6-98c91e9b3d77 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:54.036317 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 594/1179] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:52:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:54.042311 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6a479-3f2c-42ec-9d8c-a84953434d40 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:54.051523 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6a479-3f2c-42ec-9d8c-a84953434d40 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:54.055923 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572397fe-bb29-449a-9db4-4a1a200f4402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:54.056735 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572397fe-bb29-449a-9db4-4a1a200f4402 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:54.057013 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572397fe-bb29-449a-9db4-4a1a200f4402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:54.057284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572397fe-bb29-449a-9db4-4a1a200f4402 admin admin] PATH_INFO: `/v3/users/a3b755a4763645348199dddada328227` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:54.070615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572397fe-bb29-449a-9db4-4a1a200f4402 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3b755a4763645348199dddada328227)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:54.072710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572397fe-bb29-449a-9db4-4a1a200f4402 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:54.074939 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 586/1180] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:52:54 2021] GET /identity/v3/users/a3b755a4763645348199dddada328227 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:54.080725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254db16f-207d-407b-8cc6-98c91e9b3d77 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:54.089803 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254db16f-207d-407b-8cc6-98c91e9b3d77 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:54.094183 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f70013-97b9-47b2-b1ae-f789d0402c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:54.094791 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f70013-97b9-47b2-b1ae-f789d0402c12 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:54.095069 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f70013-97b9-47b2-b1ae-f789d0402c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:54.095344 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f70013-97b9-47b2-b1ae-f789d0402c12 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:54.102799 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f70013-97b9-47b2-b1ae-f789d0402c12 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:54.104500 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f70013-97b9-47b2-b1ae-f789d0402c12 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:54.113540 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 595/1181] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:52:54 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:52:54.119303 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572397fe-bb29-449a-9db4-4a1a200f4402 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:54.129092 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572397fe-bb29-449a-9db4-4a1a200f4402 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:54.133740 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83553f2-1a09-4e82-8065-b9bd700a794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:54.134583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83553f2-1a09-4e82-8065-b9bd700a794f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:54.134861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83553f2-1a09-4e82-8065-b9bd700a794f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:54.135133 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83553f2-1a09-4e82-8065-b9bd700a794f admin admin] PATH_INFO: `/v3/projects/40760c5aa2a64cb898ead0c869361680` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:54.136334 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83553f2-1a09-4e82-8065-b9bd700a794f admin admin] RBAC: Authorizing `identity:get_project(project_id=40760c5aa2a64cb898ead0c869361680)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:54.138336 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83553f2-1a09-4e82-8065-b9bd700a794f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:54.140062 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 587/1182] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:52:54 2021] GET /identity/v3/projects/40760c5aa2a64cb898ead0c869361680 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:54.145810 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f70013-97b9-47b2-b1ae-f789d0402c12 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:54.154125 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f70013-97b9-47b2-b1ae-f789d0402c12 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:54.158566 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec2886-7dc1-4f88-9146-5f21cd260180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:54.159109 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec2886-7dc1-4f88-9146-5f21cd260180 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:54.159389 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec2886-7dc1-4f88-9146-5f21cd260180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:54.159669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec2886-7dc1-4f88-9146-5f21cd260180 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:54.160472 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec2886-7dc1-4f88-9146-5f21cd260180 admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=40760c5aa2a64cb898ead0c869361680, user.id=a3b755a4763645348199dddada328227) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:54.160776 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec2886-7dc1-4f88-9146-5f21cd260180 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:54.162571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec2886-7dc1-4f88-9146-5f21cd260180 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:54.168158 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 596/1183] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:52:54 2021] GET /identity/v3/role_assignments?user.id=a3b755a4763645348199dddada328227&scope.project.id=40760c5aa2a64cb898ead0c869361680&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:52:56.459616 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77cbe6-1e66-44ec-a9f7-1ecd1298596a None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:56.460114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77cbe6-1e66-44ec-a9f7-1ecd1298596a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:56.460114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77cbe6-1e66-44ec-a9f7-1ecd1298596a None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:56.461856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 588/1184] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:56.468160 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb99b7-52a6-4fbc-8dc2-d785ab96ec69 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:56.468582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb99b7-52a6-4fbc-8dc2-d785ab96ec69 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:56.468712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb99b7-52a6-4fbc-8dc2-d785ab96ec69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:56.485579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-1dfb99b7-52a6-4fbc-8dc2-d785ab96ec69 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:56.486766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-1dfb99b7-52a6-4fbc-8dc2-d785ab96ec69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:56.494093 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 597/1185] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:56.518064 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77cbe6-1e66-44ec-a9f7-1ecd1298596a None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:56.530541 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77cbe6-1e66-44ec-a9f7-1ecd1298596a None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:56.534857 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc6161-1819-4e1c-9d34-a7b6cc7dd59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:56.535640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc6161-1819-4e1c-9d34-a7b6cc7dd59b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:56.535919 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc6161-1819-4e1c-9d34-a7b6cc7dd59b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:56.536192 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc6161-1819-4e1c-9d34-a7b6cc7dd59b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:56.546095 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc6161-1819-4e1c-9d34-a7b6cc7dd59b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:52:56.552834 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-b6dc6161-1819-4e1c-9d34-a7b6cc7dd59b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:52:56.553956 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 589/1186] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:52:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:56.560750 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb99b7-52a6-4fbc-8dc2-d785ab96ec69 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:56.569310 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb99b7-52a6-4fbc-8dc2-d785ab96ec69 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:56.574212 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cd21d-ead0-4cbe-9e72-cbffc14d9bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:56.574845 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cd21d-ead0-4cbe-9e72-cbffc14d9bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:56.575121 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cd21d-ead0-4cbe-9e72-cbffc14d9bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:56.575393 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cd21d-ead0-4cbe-9e72-cbffc14d9bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:56.576135 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cd21d-ead0-4cbe-9e72-cbffc14d9bc7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:56.576437 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cd21d-ead0-4cbe-9e72-cbffc14d9bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:56.578006 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cd21d-ead0-4cbe-9e72-cbffc14d9bc7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:56.585847 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 598/1187] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:52:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:56.592305 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc6161-1819-4e1c-9d34-a7b6cc7dd59b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:56.601821 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc6161-1819-4e1c-9d34-a7b6cc7dd59b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:56.606245 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e3fff-34bb-4055-9d1c-81f90eca01c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:56.607047 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e3fff-34bb-4055-9d1c-81f90eca01c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:56.607325 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e3fff-34bb-4055-9d1c-81f90eca01c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:56.607596 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e3fff-34bb-4055-9d1c-81f90eca01c1 admin admin] PATH_INFO: `/v3/users/a3b755a4763645348199dddada328227` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:56.608756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e3fff-34bb-4055-9d1c-81f90eca01c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3b755a4763645348199dddada328227)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:56.610875 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e3fff-34bb-4055-9d1c-81f90eca01c1 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:56.612390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 590/1188] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:52:56 2021] GET /identity/v3/users/a3b755a4763645348199dddada328227 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:56.617916 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cd21d-ead0-4cbe-9e72-cbffc14d9bc7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:56.626847 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cd21d-ead0-4cbe-9e72-cbffc14d9bc7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:56.631152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c63e06-f7d2-4fb0-a1f1-ff122ee34e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:56.631944 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c63e06-f7d2-4fb0-a1f1-ff122ee34e86 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:56.632223 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c63e06-f7d2-4fb0-a1f1-ff122ee34e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:56.632492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c63e06-f7d2-4fb0-a1f1-ff122ee34e86 admin admin] PATH_INFO: `/v3/projects/40760c5aa2a64cb898ead0c869361680` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:56.633881 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c63e06-f7d2-4fb0-a1f1-ff122ee34e86 admin admin] RBAC: Authorizing `identity:get_project(project_id=40760c5aa2a64cb898ead0c869361680)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:56.635858 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c63e06-f7d2-4fb0-a1f1-ff122ee34e86 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:56.637894 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 599/1189] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:52:56 2021] GET /identity/v3/projects/40760c5aa2a64cb898ead0c869361680 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:56.643471 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e3fff-34bb-4055-9d1c-81f90eca01c1 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:56.652979 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e3fff-34bb-4055-9d1c-81f90eca01c1 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:56.657339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d2682-9b0a-49b1-a088-5f29a182afcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:56.658181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d2682-9b0a-49b1-a088-5f29a182afcf admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:56.658460 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d2682-9b0a-49b1-a088-5f29a182afcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:56.658734 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d2682-9b0a-49b1-a088-5f29a182afcf admin admin] PATH_INFO: `/v3/projects/40760c5aa2a64cb898ead0c869361680/users/a3b755a4763645348199dddada328227/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:56.660617 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d2682-9b0a-49b1-a088-5f29a182afcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=40760c5aa2a64cb898ead0c869361680, user_id=a3b755a4763645348199dddada328227, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:56.663174 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d2682-9b0a-49b1-a088-5f29a182afcf admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:56.675387 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 591/1190] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:52:56 2021] PUT /identity/v3/projects/40760c5aa2a64cb898ead0c869361680/users/a3b755a4763645348199dddada328227/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:52:58.980644 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793760bd-fb44-4f8f-9bac-fe74f2b62010 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:58.981268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793760bd-fb44-4f8f-9bac-fe74f2b62010 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:58.981268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793760bd-fb44-4f8f-9bac-fe74f2b62010 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:58.983016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 600/1191] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:52:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:52:58.988743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436abb5-a47b-4bca-8f4a-83df7c7a4086 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:58.989163 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436abb5-a47b-4bca-8f4a-83df7c7a4086 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:58.989300 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436abb5-a47b-4bca-8f4a-83df7c7a4086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:59.006574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-f436abb5-a47b-4bca-8f4a-83df7c7a4086 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:52:59.008002 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f436abb5-a47b-4bca-8f4a-83df7c7a4086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:52:59.062079 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 592/1192] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:52:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:52:59.085548 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793760bd-fb44-4f8f-9bac-fe74f2b62010 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:59.097790 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793760bd-fb44-4f8f-9bac-fe74f2b62010 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:59.102154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d92690-d6cd-4665-b3ff-2d20a4041ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:59.102914 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d92690-d6cd-4665-b3ff-2d20a4041ceb admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:59.103198 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d92690-d6cd-4665-b3ff-2d20a4041ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:59.103473 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d92690-d6cd-4665-b3ff-2d20a4041ceb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:59.113935 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d92690-d6cd-4665-b3ff-2d20a4041ceb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:52:59.120745 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-c5d92690-d6cd-4665-b3ff-2d20a4041ceb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:52:59.121857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 601/1193] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:52:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:52:59.127823 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436abb5-a47b-4bca-8f4a-83df7c7a4086 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:59.136512 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436abb5-a47b-4bca-8f4a-83df7c7a4086 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:59.140872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496aad96-2e6f-4495-a37b-147f37c0311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:59.141494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496aad96-2e6f-4495-a37b-147f37c0311f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:59.141772 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496aad96-2e6f-4495-a37b-147f37c0311f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:59.142067 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496aad96-2e6f-4495-a37b-147f37c0311f admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:59.142804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496aad96-2e6f-4495-a37b-147f37c0311f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:59.143101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496aad96-2e6f-4495-a37b-147f37c0311f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:59.144664 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496aad96-2e6f-4495-a37b-147f37c0311f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:59.152911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 593/1194] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:52:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:59.158771 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d92690-d6cd-4665-b3ff-2d20a4041ceb admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:59.169063 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d92690-d6cd-4665-b3ff-2d20a4041ceb admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:59.173504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7344a-b113-49c3-9ee8-d2fc0b5e7a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:59.174338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7344a-b113-49c3-9ee8-d2fc0b5e7a0f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:59.174621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7344a-b113-49c3-9ee8-d2fc0b5e7a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:59.174897 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7344a-b113-49c3-9ee8-d2fc0b5e7a0f admin admin] PATH_INFO: `/v3/users/a3b755a4763645348199dddada328227` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:59.176104 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7344a-b113-49c3-9ee8-d2fc0b5e7a0f admin admin] RBAC: Authorizing `identity:get_user(user_id=a3b755a4763645348199dddada328227)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:59.178204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7344a-b113-49c3-9ee8-d2fc0b5e7a0f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:59.179865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 602/1195] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Dec 15 02:52:59 2021] GET /identity/v3/users/a3b755a4763645348199dddada328227 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:59.185373 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496aad96-2e6f-4495-a37b-147f37c0311f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:59.194284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496aad96-2e6f-4495-a37b-147f37c0311f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:59.198592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a5a66-eb60-42b7-98f9-3bdfeb81d4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:59.199188 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a5a66-eb60-42b7-98f9-3bdfeb81d4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:59.199467 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a5a66-eb60-42b7-98f9-3bdfeb81d4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:59.199738 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a5a66-eb60-42b7-98f9-3bdfeb81d4d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:59.207410 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a5a66-eb60-42b7-98f9-3bdfeb81d4d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:59.209106 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a5a66-eb60-42b7-98f9-3bdfeb81d4d0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:59.218012 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 594/1196] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:52:59 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:52:59.224061 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7344a-b113-49c3-9ee8-d2fc0b5e7a0f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:59.234161 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7344a-b113-49c3-9ee8-d2fc0b5e7a0f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:59.238529 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96626ab4-0c46-456f-9503-3a4d9e9f36df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:59.239377 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96626ab4-0c46-456f-9503-3a4d9e9f36df admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:59.239659 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96626ab4-0c46-456f-9503-3a4d9e9f36df admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:59.239937 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96626ab4-0c46-456f-9503-3a4d9e9f36df admin admin] PATH_INFO: `/v3/projects/40760c5aa2a64cb898ead0c869361680` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:59.241104 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96626ab4-0c46-456f-9503-3a4d9e9f36df admin admin] RBAC: Authorizing `identity:get_project(project_id=40760c5aa2a64cb898ead0c869361680)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:59.243149 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96626ab4-0c46-456f-9503-3a4d9e9f36df admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:59.244747 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 603/1197] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:52:59 2021] GET /identity/v3/projects/40760c5aa2a64cb898ead0c869361680 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:52:59.250644 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a5a66-eb60-42b7-98f9-3bdfeb81d4d0 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:52:59.259167 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a5a66-eb60-42b7-98f9-3bdfeb81d4d0 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:52:59.263633 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b999f2-b413-416e-ada6-4fcae792e24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:52:59.264228 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b999f2-b413-416e-ada6-4fcae792e24a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:52:59.264508 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b999f2-b413-416e-ada6-4fcae792e24a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:52:59.264779 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b999f2-b413-416e-ada6-4fcae792e24a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:52:59.265585 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b999f2-b413-416e-ada6-4fcae792e24a admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=40760c5aa2a64cb898ead0c869361680, user.id=a3b755a4763645348199dddada328227) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:52:59.265888 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b999f2-b413-416e-ada6-4fcae792e24a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:52:59.267678 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b999f2-b413-416e-ada6-4fcae792e24a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:52:59.273209 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 595/1198] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:52:59 2021] GET /identity/v3/role_assignments?user.id=a3b755a4763645348199dddada328227&scope.project.id=40760c5aa2a64cb898ead0c869361680&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:53:57.100220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf694d9f-f056-464f-86f9-9f63f1069547 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:53:57.100795 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf694d9f-f056-464f-86f9-9f63f1069547 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:53:57.100904 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf694d9f-f056-464f-86f9-9f63f1069547 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:53:57.103168 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 604/1199] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:53:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:53:57.112599 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a30a-cbf4-4127-bed9-e87faf15ea6f None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:53:57.112599 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a30a-cbf4-4127-bed9-e87faf15ea6f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:53:57.112599 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a30a-cbf4-4127-bed9-e87faf15ea6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:53:57.131087 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-9192a30a-cbf4-4127-bed9-e87faf15ea6f None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:53:57.132856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9192a30a-cbf4-4127-bed9-e87faf15ea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:53:57.141830 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 596/1200] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:53:57 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:53:57.173262 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf694d9f-f056-464f-86f9-9f63f1069547 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:53:57.186570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf694d9f-f056-464f-86f9-9f63f1069547 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:53:57.192671 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d01ba8-33a2-4199-8d1b-09881fb51e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:53:57.193542 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d01ba8-33a2-4199-8d1b-09881fb51e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:53:57.193826 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d01ba8-33a2-4199-8d1b-09881fb51e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:53:57.194308 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d01ba8-33a2-4199-8d1b-09881fb51e88 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:53:57.215326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d01ba8-33a2-4199-8d1b-09881fb51e88 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:53:57.217488 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d01ba8-33a2-4199-8d1b-09881fb51e88 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:53:57.236129 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-c5d01ba8-33a2-4199-8d1b-09881fb51e88 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:53:57.237348 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 605/1201] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:53:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:53:57.244372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192a30a-cbf4-4127-bed9-e87faf15ea6f None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:53:57.254059 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192a30a-cbf4-4127-bed9-e87faf15ea6f None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:53:57.262514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcc108-c76b-45b8-8005-65440ba39edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:53:57.263610 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcc108-c76b-45b8-8005-65440ba39edb admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:53:57.264282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcc108-c76b-45b8-8005-65440ba39edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:53:57.264716 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcc108-c76b-45b8-8005-65440ba39edb admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:53:57.265799 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcc108-c76b-45b8-8005-65440ba39edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:53:57.266253 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcc108-c76b-45b8-8005-65440ba39edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:53:57.268056 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcc108-c76b-45b8-8005-65440ba39edb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:53:57.286071 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 597/1202] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:53:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:53:57.289582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d01ba8-33a2-4199-8d1b-09881fb51e88 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:53:57.299471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d01ba8-33a2-4199-8d1b-09881fb51e88 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:53:57.304910 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894517c9-89c1-49e1-9939-0bff16ae8c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:53:57.305649 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894517c9-89c1-49e1-9939-0bff16ae8c5d admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:53:57.306033 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894517c9-89c1-49e1-9939-0bff16ae8c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:53:57.306363 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894517c9-89c1-49e1-9939-0bff16ae8c5d admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:53:57.307160 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894517c9-89c1-49e1-9939-0bff16ae8c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:53:57.309245 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894517c9-89c1-49e1-9939-0bff16ae8c5d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:53:57.336793 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 606/1203] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Dec 15 02:53:57 2021] POST /identity/v3/users => generated 251 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 02:53:59.952122 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521cf0c-212d-401e-88be-dc4a0bf05923 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:53:59.952699 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521cf0c-212d-401e-88be-dc4a0bf05923 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:53:59.952699 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521cf0c-212d-401e-88be-dc4a0bf05923 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:53:59.954648 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 598/1204] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:53:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:53:59.961139 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac4a1c-9507-4697-8a1e-a2e3e6978eec None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:53:59.962250 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac4a1c-9507-4697-8a1e-a2e3e6978eec None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:53:59.962250 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac4a1c-9507-4697-8a1e-a2e3e6978eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:53:59.983033 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-24ac4a1c-9507-4697-8a1e-a2e3e6978eec None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:53:59.984726 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-24ac4a1c-9507-4697-8a1e-a2e3e6978eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:53:59.994441 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 607/1205] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:53:59 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:54:00.022470 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521cf0c-212d-401e-88be-dc4a0bf05923 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:00.037057 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521cf0c-212d-401e-88be-dc4a0bf05923 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:00.042212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd633c3-d3ea-405c-bd8f-37f5756e73b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:00.043002 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd633c3-d3ea-405c-bd8f-37f5756e73b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:00.043352 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd633c3-d3ea-405c-bd8f-37f5756e73b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:00.043582 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd633c3-d3ea-405c-bd8f-37f5756e73b6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:00.056580 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd633c3-d3ea-405c-bd8f-37f5756e73b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:54:00.064108 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-1bd633c3-d3ea-405c-bd8f-37f5756e73b6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:54:00.066018 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 599/1206] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:54:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:54:00.072229 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac4a1c-9507-4697-8a1e-a2e3e6978eec None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:00.081687 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac4a1c-9507-4697-8a1e-a2e3e6978eec None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:00.087887 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8a1d9-cc59-4a98-94ea-d4ebfd6cf204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:00.088749 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8a1d9-cc59-4a98-94ea-d4ebfd6cf204 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:00.089040 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8a1d9-cc59-4a98-94ea-d4ebfd6cf204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:00.089318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8a1d9-cc59-4a98-94ea-d4ebfd6cf204 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:00.090116 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8a1d9-cc59-4a98-94ea-d4ebfd6cf204 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:00.090475 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8a1d9-cc59-4a98-94ea-d4ebfd6cf204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:00.092569 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8a1d9-cc59-4a98-94ea-d4ebfd6cf204 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:00.107525 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 608/1207] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:54:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:00.108735 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd633c3-d3ea-405c-bd8f-37f5756e73b6 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:00.120840 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd633c3-d3ea-405c-bd8f-37f5756e73b6 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:00.126256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1fd75-04be-4dd4-9f8d-0c856a0819bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:00.127189 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1fd75-04be-4dd4-9f8d-0c856a0819bc admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:00.127513 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1fd75-04be-4dd4-9f8d-0c856a0819bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:00.127877 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1fd75-04be-4dd4-9f8d-0c856a0819bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:00.141136 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1fd75-04be-4dd4-9f8d-0c856a0819bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:00.143454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1fd75-04be-4dd4-9f8d-0c856a0819bc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:00.168674 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-bdf1fd75-04be-4dd4-9f8d-0c856a0819bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:54:00.175553 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 600/1208] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:00.177206 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8a1d9-cc59-4a98-94ea-d4ebfd6cf204 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:00.191225 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8a1d9-cc59-4a98-94ea-d4ebfd6cf204 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:00.197081 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec4e34-b3b1-4e18-8692-d1d74c793110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:00.197967 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec4e34-b3b1-4e18-8692-d1d74c793110 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:00.205869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec4e34-b3b1-4e18-8692-d1d74c793110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:00.205869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec4e34-b3b1-4e18-8692-d1d74c793110 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:00.205869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec4e34-b3b1-4e18-8692-d1d74c793110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:00.205869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec4e34-b3b1-4e18-8692-d1d74c793110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:00.205869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec4e34-b3b1-4e18-8692-d1d74c793110 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:00.218492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 609/1209] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:54:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:00.225600 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1fd75-04be-4dd4-9f8d-0c856a0819bc admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:00.236048 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1fd75-04be-4dd4-9f8d-0c856a0819bc admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:00.241164 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27459c-e742-465a-a6c7-d5b57bc7e043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:00.241958 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27459c-e742-465a-a6c7-d5b57bc7e043 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:00.242265 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27459c-e742-465a-a6c7-d5b57bc7e043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:00.242537 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27459c-e742-465a-a6c7-d5b57bc7e043 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:00.250635 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27459c-e742-465a-a6c7-d5b57bc7e043 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:00.252638 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27459c-e742-465a-a6c7-d5b57bc7e043 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:00.268506 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-9f27459c-e742-465a-a6c7-d5b57bc7e043 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 02:54:00.269893 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 601/1210] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:00 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:54:00.277246 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec4e34-b3b1-4e18-8692-d1d74c793110 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:00.291326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec4e34-b3b1-4e18-8692-d1d74c793110 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:00.296823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a147b5-8e3b-4df2-bcd9-d2a2b4e13f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:00.297632 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a147b5-8e3b-4df2-bcd9-d2a2b4e13f7a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:00.297913 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a147b5-8e3b-4df2-bcd9-d2a2b4e13f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:00.298334 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a147b5-8e3b-4df2-bcd9-d2a2b4e13f7a admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:00.299185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a147b5-8e3b-4df2-bcd9-d2a2b4e13f7a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:00.299494 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a147b5-8e3b-4df2-bcd9-d2a2b4e13f7a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:00.301318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a147b5-8e3b-4df2-bcd9-d2a2b4e13f7a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:00.321683 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 610/1211] 10.222.0.18 () {56 vars in 1164 bytes} [Wed Dec 15 02:54:00 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:00.328853 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27459c-e742-465a-a6c7-d5b57bc7e043 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:00.339710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27459c-e742-465a-a6c7-d5b57bc7e043 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:00.345640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcff1ee-e7cf-4b16-9b36-0f05242bdafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:00.346520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcff1ee-e7cf-4b16-9b36-0f05242bdafe admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:00.346706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcff1ee-e7cf-4b16-9b36-0f05242bdafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:00.347007 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcff1ee-e7cf-4b16-9b36-0f05242bdafe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:00.360677 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcff1ee-e7cf-4b16-9b36-0f05242bdafe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:00.362506 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcff1ee-e7cf-4b16-9b36-0f05242bdafe admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:00.373117 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 602/1212] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:54:00 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:54:00.382894 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a147b5-8e3b-4df2-bcd9-d2a2b4e13f7a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:00.394706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a147b5-8e3b-4df2-bcd9-d2a2b4e13f7a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:00.400454 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb51abd-c3ae-477c-8d4e-185786310dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:00.401269 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb51abd-c3ae-477c-8d4e-185786310dcb admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:00.401597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb51abd-c3ae-477c-8d4e-185786310dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:00.401921 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb51abd-c3ae-477c-8d4e-185786310dcb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:00.415164 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb51abd-c3ae-477c-8d4e-185786310dcb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:00.417291 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb51abd-c3ae-477c-8d4e-185786310dcb admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:00.437376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-bfb51abd-c3ae-477c-8d4e-185786310dcb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:54:00.443812 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 611/1213] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:00.445584 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcff1ee-e7cf-4b16-9b36-0f05242bdafe admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:00.455336 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcff1ee-e7cf-4b16-9b36-0f05242bdafe admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:00.460194 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d368f9d-1dcf-482f-a23e-a1e462092686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:00.460873 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d368f9d-1dcf-482f-a23e-a1e462092686 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:00.461158 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d368f9d-1dcf-482f-a23e-a1e462092686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:00.461429 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d368f9d-1dcf-482f-a23e-a1e462092686 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:00.462227 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d368f9d-1dcf-482f-a23e-a1e462092686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:00.462528 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d368f9d-1dcf-482f-a23e-a1e462092686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:00.464116 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d368f9d-1dcf-482f-a23e-a1e462092686 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:00.480022 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 603/1214] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:54:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:54:00.486507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb51abd-c3ae-477c-8d4e-185786310dcb admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:00.499457 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb51abd-c3ae-477c-8d4e-185786310dcb admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:00.505369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a0621-9d37-4440-8779-863f3e353d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:00.506282 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a0621-9d37-4440-8779-863f3e353d6a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:00.506826 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a0621-9d37-4440-8779-863f3e353d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:00.507150 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a0621-9d37-4440-8779-863f3e353d6a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:00.515228 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a0621-9d37-4440-8779-863f3e353d6a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:00.517154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a0621-9d37-4440-8779-863f3e353d6a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:00.532044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-4c5a0621-9d37-4440-8779-863f3e353d6a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:54:00.533618 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 612/1215] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:54:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:00.540026 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d368f9d-1dcf-482f-a23e-a1e462092686 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:00.549934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d368f9d-1dcf-482f-a23e-a1e462092686 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:00.556039 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c86ec-7aee-4e09-abff-78264bc4b404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:00.556766 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c86ec-7aee-4e09-abff-78264bc4b404 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:00.557065 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c86ec-7aee-4e09-abff-78264bc4b404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:00.557346 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c86ec-7aee-4e09-abff-78264bc4b404 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:00.558265 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c86ec-7aee-4e09-abff-78264bc4b404 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:00.558572 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c86ec-7aee-4e09-abff-78264bc4b404 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:00.560515 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c86ec-7aee-4e09-abff-78264bc4b404 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:00.583015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 604/1216] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:54:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:54:00.589724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a0621-9d37-4440-8779-863f3e353d6a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:00.600407 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a0621-9d37-4440-8779-863f3e353d6a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:00.605052 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eae203-c89f-4614-b3bc-71fd74d000d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:00.605678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eae203-c89f-4614-b3bc-71fd74d000d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:00.605957 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eae203-c89f-4614-b3bc-71fd74d000d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:00.606256 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eae203-c89f-4614-b3bc-71fd74d000d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:00.607088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eae203-c89f-4614-b3bc-71fd74d000d0 admin admin] RBAC: Adding query filter params (role.id=4f557aac969f4c2f95aee8e21d67c802, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=93762c21f03d44d5bf3881d17e14ef90) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:00.607393 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eae203-c89f-4614-b3bc-71fd74d000d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:00.609385 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eae203-c89f-4614-b3bc-71fd74d000d0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:00.616351 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 613/1217] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:54:00 2021] GET /identity/v3/role_assignments?user.id=93762c21f03d44d5bf3881d17e14ef90&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=4f557aac969f4c2f95aee8e21d67c802 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:03.115096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060074b1-9de6-4dfb-ab59-30fffba93364 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:03.115686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060074b1-9de6-4dfb-ab59-30fffba93364 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:03.115686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060074b1-9de6-4dfb-ab59-30fffba93364 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:03.117474 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 605/1218] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:54:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:54:03.123633 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec099b-4473-4280-bc91-e3fb275bfae3 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:03.124085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec099b-4473-4280-bc91-e3fb275bfae3 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:03.124185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec099b-4473-4280-bc91-e3fb275bfae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:03.142890 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-b1ec099b-4473-4280-bc91-e3fb275bfae3 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:54:03.144073 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b1ec099b-4473-4280-bc91-e3fb275bfae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:54:03.153200 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 614/1219] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:54:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:54:03.179233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060074b1-9de6-4dfb-ab59-30fffba93364 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:03.194380 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060074b1-9de6-4dfb-ab59-30fffba93364 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:03.200068 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db33790-32fb-4326-805c-5eb77c7ca9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:03.200868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db33790-32fb-4326-805c-5eb77c7ca9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:03.201162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db33790-32fb-4326-805c-5eb77c7ca9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:03.201504 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db33790-32fb-4326-805c-5eb77c7ca9e1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:03.213652 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db33790-32fb-4326-805c-5eb77c7ca9e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:54:03.221349 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-4db33790-32fb-4326-805c-5eb77c7ca9e1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:54:03.222641 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 606/1220] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:54:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:03.229476 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec099b-4473-4280-bc91-e3fb275bfae3 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:03.239428 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec099b-4473-4280-bc91-e3fb275bfae3 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:03.244653 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88188b07-c777-4a10-bde6-1a2efe741520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:03.245447 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88188b07-c777-4a10-bde6-1a2efe741520 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:03.245734 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88188b07-c777-4a10-bde6-1a2efe741520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:03.246166 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88188b07-c777-4a10-bde6-1a2efe741520 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:03.246927 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88188b07-c777-4a10-bde6-1a2efe741520 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:03.247239 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88188b07-c777-4a10-bde6-1a2efe741520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:03.248983 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88188b07-c777-4a10-bde6-1a2efe741520 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:03.258290 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 615/1221] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:54:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:03.265254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db33790-32fb-4326-805c-5eb77c7ca9e1 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:03.277630 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db33790-32fb-4326-805c-5eb77c7ca9e1 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:03.282293 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65310072-a7d1-42ee-bb4a-4ded9a1acf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:03.283203 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65310072-a7d1-42ee-bb4a-4ded9a1acf38 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:03.283475 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65310072-a7d1-42ee-bb4a-4ded9a1acf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:03.283772 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65310072-a7d1-42ee-bb4a-4ded9a1acf38 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:03.294313 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65310072-a7d1-42ee-bb4a-4ded9a1acf38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:03.296202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65310072-a7d1-42ee-bb4a-4ded9a1acf38 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:03.312482 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-65310072-a7d1-42ee-bb4a-4ded9a1acf38 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:54:03.313645 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 607/1222] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:54:03.320229 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88188b07-c777-4a10-bde6-1a2efe741520 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:03.331936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88188b07-c777-4a10-bde6-1a2efe741520 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:03.336082 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bfa0e-174b-48ec-b67e-362242a193b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:03.337378 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bfa0e-174b-48ec-b67e-362242a193b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:03.337667 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bfa0e-174b-48ec-b67e-362242a193b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:03.337964 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bfa0e-174b-48ec-b67e-362242a193b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:03.338854 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bfa0e-174b-48ec-b67e-362242a193b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:03.339168 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bfa0e-174b-48ec-b67e-362242a193b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:03.341044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bfa0e-174b-48ec-b67e-362242a193b4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:03.355695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 616/1223] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:54:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:03.363835 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65310072-a7d1-42ee-bb4a-4ded9a1acf38 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:03.374991 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65310072-a7d1-42ee-bb4a-4ded9a1acf38 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:03.380295 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa193d4-5a07-4cb4-835c-4ea4c561123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:03.381082 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa193d4-5a07-4cb4-835c-4ea4c561123b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:03.381615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa193d4-5a07-4cb4-835c-4ea4c561123b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:03.381887 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa193d4-5a07-4cb4-835c-4ea4c561123b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:03.390059 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa193d4-5a07-4cb4-835c-4ea4c561123b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:03.394910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa193d4-5a07-4cb4-835c-4ea4c561123b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:03.412336 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-2fa193d4-5a07-4cb4-835c-4ea4c561123b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 02:54:03.419655 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 608/1224] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:03 2021] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:03.421112 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bfa0e-174b-48ec-b67e-362242a193b4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:03.431326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bfa0e-174b-48ec-b67e-362242a193b4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:03.435892 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073ecd0-6898-4b66-935b-85478e50ea3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:03.436543 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073ecd0-6898-4b66-935b-85478e50ea3f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:03.436824 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073ecd0-6898-4b66-935b-85478e50ea3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:03.437102 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073ecd0-6898-4b66-935b-85478e50ea3f admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:03.437993 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073ecd0-6898-4b66-935b-85478e50ea3f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:03.438344 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073ecd0-6898-4b66-935b-85478e50ea3f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:03.440280 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073ecd0-6898-4b66-935b-85478e50ea3f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:03.458782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 617/1225] 10.222.0.18 () {56 vars in 1164 bytes} [Wed Dec 15 02:54:03 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:03.465015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa193d4-5a07-4cb4-835c-4ea4c561123b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:03.475097 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa193d4-5a07-4cb4-835c-4ea4c561123b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:03.479706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e4151-bbaf-4729-88d6-1e3ec75d865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:03.480457 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e4151-bbaf-4729-88d6-1e3ec75d865b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:03.480728 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e4151-bbaf-4729-88d6-1e3ec75d865b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:03.481001 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e4151-bbaf-4729-88d6-1e3ec75d865b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:03.495184 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e4151-bbaf-4729-88d6-1e3ec75d865b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:03.497114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e4151-bbaf-4729-88d6-1e3ec75d865b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:03.515039 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-ec1e4151-bbaf-4729-88d6-1e3ec75d865b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:54:03.516280 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 609/1226] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:03.523427 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073ecd0-6898-4b66-935b-85478e50ea3f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:03.533453 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073ecd0-6898-4b66-935b-85478e50ea3f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:03.538193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5f7f0-5c0d-462d-b2af-57c1263798ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:03.538946 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5f7f0-5c0d-462d-b2af-57c1263798ad admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:03.539245 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5f7f0-5c0d-462d-b2af-57c1263798ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:03.539553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5f7f0-5c0d-462d-b2af-57c1263798ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:03.540332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5f7f0-5c0d-462d-b2af-57c1263798ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:03.540633 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5f7f0-5c0d-462d-b2af-57c1263798ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:03.542262 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5f7f0-5c0d-462d-b2af-57c1263798ad admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:03.554130 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 618/1227] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:54:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:03.561880 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e4151-bbaf-4729-88d6-1e3ec75d865b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:03.572185 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e4151-bbaf-4729-88d6-1e3ec75d865b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:03.577274 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b36789-e9e8-40e6-b1bb-ecef2e7632cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:03.578691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b36789-e9e8-40e6-b1bb-ecef2e7632cb admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:03.579134 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b36789-e9e8-40e6-b1bb-ecef2e7632cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:03.579494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b36789-e9e8-40e6-b1bb-ecef2e7632cb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:03.587405 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b36789-e9e8-40e6-b1bb-ecef2e7632cb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:03.590307 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b36789-e9e8-40e6-b1bb-ecef2e7632cb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:03.606627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-12b36789-e9e8-40e6-b1bb-ecef2e7632cb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:54:03.608183 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 610/1228] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:54:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:03.614570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5f7f0-5c0d-462d-b2af-57c1263798ad admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:03.627946 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5f7f0-5c0d-462d-b2af-57c1263798ad admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:03.634857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20dd5a4-ca76-43f3-a206-20c141bb8079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:03.635879 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dd5a4-ca76-43f3-a206-20c141bb8079 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:03.636292 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dd5a4-ca76-43f3-a206-20c141bb8079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:03.636727 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dd5a4-ca76-43f3-a206-20c141bb8079 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:03.637687 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20dd5a4-ca76-43f3-a206-20c141bb8079 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:03.638510 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20dd5a4-ca76-43f3-a206-20c141bb8079 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:03.641003 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20dd5a4-ca76-43f3-a206-20c141bb8079 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:03.655077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 619/1229] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:54:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:03.663248 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b36789-e9e8-40e6-b1bb-ecef2e7632cb admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:03.676108 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b36789-e9e8-40e6-b1bb-ecef2e7632cb admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:03.682750 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75a156-5c3f-402e-ac5c-ff075b99bac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:03.684064 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75a156-5c3f-402e-ac5c-ff075b99bac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:03.684454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75a156-5c3f-402e-ac5c-ff075b99bac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:03.684757 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75a156-5c3f-402e-ac5c-ff075b99bac2 admin admin] PATH_INFO: `/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/93762c21f03d44d5bf3881d17e14ef90/roles/4f557aac969f4c2f95aee8e21d67c802` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:03.703804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75a156-5c3f-402e-ac5c-ff075b99bac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user_id=93762c21f03d44d5bf3881d17e14ef90, role_id=4f557aac969f4c2f95aee8e21d67c802)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:03.706581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75a156-5c3f-402e-ac5c-ff075b99bac2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:03.719956 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 611/1230] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:54:03 2021] PUT /identity/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/93762c21f03d44d5bf3881d17e14ef90/roles/4f557aac969f4c2f95aee8e21d67c802 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:54:06.172764 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cea320-1630-45af-aed2-6023e3a26f4d None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:06.173314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cea320-1630-45af-aed2-6023e3a26f4d None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:06.173314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cea320-1630-45af-aed2-6023e3a26f4d None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:06.175100 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 620/1231] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:54:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:54:06.181730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b30e01-2e31-4141-951a-2afddc6e76df None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:06.182229 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b30e01-2e31-4141-951a-2afddc6e76df None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:06.182324 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b30e01-2e31-4141-951a-2afddc6e76df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:06.200821 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-f1b30e01-2e31-4141-951a-2afddc6e76df None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:54:06.202248 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f1b30e01-2e31-4141-951a-2afddc6e76df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:54:06.265008 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 612/1232] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:54:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:54:06.290969 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cea320-1630-45af-aed2-6023e3a26f4d None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:06.304871 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cea320-1630-45af-aed2-6023e3a26f4d None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:06.310664 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c92ef5-28d7-4e36-8d70-939f22f8bb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:06.311547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c92ef5-28d7-4e36-8d70-939f22f8bb5d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:06.311824 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c92ef5-28d7-4e36-8d70-939f22f8bb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:06.312226 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c92ef5-28d7-4e36-8d70-939f22f8bb5d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:06.324547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c92ef5-28d7-4e36-8d70-939f22f8bb5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:54:06.331616 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-87c92ef5-28d7-4e36-8d70-939f22f8bb5d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 02:54:06.332809 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 621/1233] 10.222.0.18 () {56 vars in 1123 bytes} [Wed Dec 15 02:54:06 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:06.340445 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b30e01-2e31-4141-951a-2afddc6e76df None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:06.350275 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b30e01-2e31-4141-951a-2afddc6e76df None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:06.356723 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c771ebf-384f-4e6d-91a5-bb75b63d04a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:06.357526 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c771ebf-384f-4e6d-91a5-bb75b63d04a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:06.357992 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c771ebf-384f-4e6d-91a5-bb75b63d04a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:06.358405 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c771ebf-384f-4e6d-91a5-bb75b63d04a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:06.359495 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c771ebf-384f-4e6d-91a5-bb75b63d04a6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:06.360020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c771ebf-384f-4e6d-91a5-bb75b63d04a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:06.362002 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c771ebf-384f-4e6d-91a5-bb75b63d04a6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:06.373415 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 613/1234] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Dec 15 02:54:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:06.380212 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c92ef5-28d7-4e36-8d70-939f22f8bb5d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:06.393099 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c92ef5-28d7-4e36-8d70-939f22f8bb5d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:06.400560 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78ffe4-e10f-4713-8638-550060bf4a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:06.401619 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78ffe4-e10f-4713-8638-550060bf4a5d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:06.402137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78ffe4-e10f-4713-8638-550060bf4a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:06.402612 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78ffe4-e10f-4713-8638-550060bf4a5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:06.415637 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78ffe4-e10f-4713-8638-550060bf4a5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:06.417457 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78ffe4-e10f-4713-8638-550060bf4a5d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:06.445933 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-1b78ffe4-e10f-4713-8638-550060bf4a5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:54:06.448143 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 622/1235] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:06.454386 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c771ebf-384f-4e6d-91a5-bb75b63d04a6 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:06.464896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c771ebf-384f-4e6d-91a5-bb75b63d04a6 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:06.470034 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626a9ed-c7c4-4a88-a3d0-20295517b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:06.470841 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626a9ed-c7c4-4a88-a3d0-20295517b816 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:06.471249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626a9ed-c7c4-4a88-a3d0-20295517b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:06.471636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626a9ed-c7c4-4a88-a3d0-20295517b816 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:06.472492 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626a9ed-c7c4-4a88-a3d0-20295517b816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:06.472882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626a9ed-c7c4-4a88-a3d0-20295517b816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:06.474701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626a9ed-c7c4-4a88-a3d0-20295517b816 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:06.490014 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 614/1236] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:54:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:06.494862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78ffe4-e10f-4713-8638-550060bf4a5d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:06.504949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78ffe4-e10f-4713-8638-550060bf4a5d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:06.509543 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31946ae2-6a39-4425-8fdb-300256607f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:06.510378 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946ae2-6a39-4425-8fdb-300256607f7e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:06.510657 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946ae2-6a39-4425-8fdb-300256607f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:06.510929 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946ae2-6a39-4425-8fdb-300256607f7e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:06.519338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31946ae2-6a39-4425-8fdb-300256607f7e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:06.521324 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31946ae2-6a39-4425-8fdb-300256607f7e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:06.536785 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-31946ae2-6a39-4425-8fdb-300256607f7e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 02:54:06.538327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 623/1237] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:06 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:06.545350 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626a9ed-c7c4-4a88-a3d0-20295517b816 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:06.555567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626a9ed-c7c4-4a88-a3d0-20295517b816 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:06.560427 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70be6f2-121b-4527-9716-361c6b52b34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:06.561084 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70be6f2-121b-4527-9716-361c6b52b34a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:06.561359 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70be6f2-121b-4527-9716-361c6b52b34a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:06.561627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70be6f2-121b-4527-9716-361c6b52b34a admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:06.562476 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70be6f2-121b-4527-9716-361c6b52b34a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:06.562777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70be6f2-121b-4527-9716-361c6b52b34a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:06.564604 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70be6f2-121b-4527-9716-361c6b52b34a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:06.582376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 615/1238] 10.222.0.18 () {56 vars in 1164 bytes} [Wed Dec 15 02:54:06 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:06.589109 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31946ae2-6a39-4425-8fdb-300256607f7e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:06.600435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31946ae2-6a39-4425-8fdb-300256607f7e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:06.605440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27801121-851c-4c6c-8d76-f94466b34743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:06.606169 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27801121-851c-4c6c-8d76-f94466b34743 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:06.606388 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27801121-851c-4c6c-8d76-f94466b34743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:06.606798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27801121-851c-4c6c-8d76-f94466b34743 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:06.616685 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27801121-851c-4c6c-8d76-f94466b34743 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:06.618915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27801121-851c-4c6c-8d76-f94466b34743 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:06.629156 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 624/1239] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:54:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:54:06.635910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70be6f2-121b-4527-9716-361c6b52b34a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:06.645630 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70be6f2-121b-4527-9716-361c6b52b34a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:06.650775 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794504d-e037-448c-97d6-df18e91ca689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:06.651512 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794504d-e037-448c-97d6-df18e91ca689 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:06.651788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794504d-e037-448c-97d6-df18e91ca689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:06.652069 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794504d-e037-448c-97d6-df18e91ca689 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:06.662158 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794504d-e037-448c-97d6-df18e91ca689 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:06.664109 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794504d-e037-448c-97d6-df18e91ca689 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:06.681637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-e794504d-e037-448c-97d6-df18e91ca689 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:54:06.682860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 616/1240] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:54:06.689235 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27801121-851c-4c6c-8d76-f94466b34743 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:06.698243 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27801121-851c-4c6c-8d76-f94466b34743 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:06.702822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88133b18-05e5-436c-a629-a92c1df2fedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:06.703460 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88133b18-05e5-436c-a629-a92c1df2fedd admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:06.703746 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88133b18-05e5-436c-a629-a92c1df2fedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:06.704022 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88133b18-05e5-436c-a629-a92c1df2fedd admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:06.704747 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88133b18-05e5-436c-a629-a92c1df2fedd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:06.705050 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88133b18-05e5-436c-a629-a92c1df2fedd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:06.706656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88133b18-05e5-436c-a629-a92c1df2fedd admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:06.719485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 625/1241] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:54:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:06.725847 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794504d-e037-448c-97d6-df18e91ca689 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:06.738299 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794504d-e037-448c-97d6-df18e91ca689 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:06.743356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bc9f9-7c4c-4afe-b3e9-9781ea5b9865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:06.744447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bc9f9-7c4c-4afe-b3e9-9781ea5b9865 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:06.744828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bc9f9-7c4c-4afe-b3e9-9781ea5b9865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:06.745243 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bc9f9-7c4c-4afe-b3e9-9781ea5b9865 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:06.754106 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bc9f9-7c4c-4afe-b3e9-9781ea5b9865 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:06.756743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bc9f9-7c4c-4afe-b3e9-9781ea5b9865 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:06.771909 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-696bc9f9-7c4c-4afe-b3e9-9781ea5b9865 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:54:06.773199 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 617/1242] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:54:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:06.780342 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88133b18-05e5-436c-a629-a92c1df2fedd admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:06.791410 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88133b18-05e5-436c-a629-a92c1df2fedd admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:06.796965 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b44e1-ccfc-4543-b282-4e6c119931d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:06.797765 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b44e1-ccfc-4543-b282-4e6c119931d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:06.798097 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b44e1-ccfc-4543-b282-4e6c119931d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:06.798375 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b44e1-ccfc-4543-b282-4e6c119931d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:06.799292 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b44e1-ccfc-4543-b282-4e6c119931d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:06.799679 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b44e1-ccfc-4543-b282-4e6c119931d2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:06.801922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b44e1-ccfc-4543-b282-4e6c119931d2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:06.814917 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 626/1243] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:54:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:06.822299 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bc9f9-7c4c-4afe-b3e9-9781ea5b9865 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:06.833762 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bc9f9-7c4c-4afe-b3e9-9781ea5b9865 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:06.839632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc2a3e-9db0-4b11-a9d7-7e88b7baa268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:06.840953 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc2a3e-9db0-4b11-a9d7-7e88b7baa268 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:06.840953 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc2a3e-9db0-4b11-a9d7-7e88b7baa268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:06.841150 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc2a3e-9db0-4b11-a9d7-7e88b7baa268 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:06.841962 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc2a3e-9db0-4b11-a9d7-7e88b7baa268 admin admin] RBAC: Adding query filter params (role.id=4f557aac969f4c2f95aee8e21d67c802, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=93762c21f03d44d5bf3881d17e14ef90) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:06.842320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc2a3e-9db0-4b11-a9d7-7e88b7baa268 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:06.844392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc2a3e-9db0-4b11-a9d7-7e88b7baa268 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:06.851338 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 618/1244] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:54:06 2021] GET /identity/v3/role_assignments?user.id=93762c21f03d44d5bf3881d17e14ef90&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=4f557aac969f4c2f95aee8e21d67c802 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:09.260639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c978e-9126-44ea-8a5b-e2a2029d426a None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:09.261185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c978e-9126-44ea-8a5b-e2a2029d426a None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:09.261185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c978e-9126-44ea-8a5b-e2a2029d426a None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:09.263067 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 627/1245] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:54:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:54:09.268865 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003b2e7-456b-4d6e-8f89-1cb175dbd150 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:09.269312 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003b2e7-456b-4d6e-8f89-1cb175dbd150 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:09.269520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003b2e7-456b-4d6e-8f89-1cb175dbd150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:09.289317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-0003b2e7-456b-4d6e-8f89-1cb175dbd150 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:54:09.290641 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0003b2e7-456b-4d6e-8f89-1cb175dbd150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:54:09.300308 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 619/1246] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:54:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:54:09.327197 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c978e-9126-44ea-8a5b-e2a2029d426a None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:09.341682 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c978e-9126-44ea-8a5b-e2a2029d426a None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:09.346925 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c3f3b-def0-4c83-89af-4d7f02dc5861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:09.347855 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c3f3b-def0-4c83-89af-4d7f02dc5861 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:09.348139 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c3f3b-def0-4c83-89af-4d7f02dc5861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:09.348531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c3f3b-def0-4c83-89af-4d7f02dc5861 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:09.361395 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c3f3b-def0-4c83-89af-4d7f02dc5861 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:54:09.368798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-743c3f3b-def0-4c83-89af-4d7f02dc5861 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:54:09.370083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 628/1247] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:54:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:54:09.378075 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003b2e7-456b-4d6e-8f89-1cb175dbd150 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:09.390376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003b2e7-456b-4d6e-8f89-1cb175dbd150 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:09.396462 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929064-1a82-4d0d-8ace-3241a8368705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:09.397280 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929064-1a82-4d0d-8ace-3241a8368705 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:09.397561 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929064-1a82-4d0d-8ace-3241a8368705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:09.398030 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929064-1a82-4d0d-8ace-3241a8368705 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:09.398994 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70929064-1a82-4d0d-8ace-3241a8368705 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:09.399804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70929064-1a82-4d0d-8ace-3241a8368705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:09.401935 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70929064-1a82-4d0d-8ace-3241a8368705 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:09.414032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 620/1248] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:54:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:09.419429 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c3f3b-def0-4c83-89af-4d7f02dc5861 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:09.429758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c3f3b-def0-4c83-89af-4d7f02dc5861 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:09.434978 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d01900-2b57-46e8-ac3a-5c617d80fe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:09.435740 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d01900-2b57-46e8-ac3a-5c617d80fe9d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:09.436014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d01900-2b57-46e8-ac3a-5c617d80fe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:09.436295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d01900-2b57-46e8-ac3a-5c617d80fe9d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:09.447625 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d01900-2b57-46e8-ac3a-5c617d80fe9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:09.449428 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d01900-2b57-46e8-ac3a-5c617d80fe9d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:09.466030 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-07d01900-2b57-46e8-ac3a-5c617d80fe9d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:54:09.467106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 629/1249] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:09.473557 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929064-1a82-4d0d-8ace-3241a8368705 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:09.483146 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929064-1a82-4d0d-8ace-3241a8368705 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:09.488499 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb261a8-f518-4ad3-b857-910d733c6983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:09.489330 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb261a8-f518-4ad3-b857-910d733c6983 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:09.489714 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb261a8-f518-4ad3-b857-910d733c6983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:09.490073 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb261a8-f518-4ad3-b857-910d733c6983 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:09.490838 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb261a8-f518-4ad3-b857-910d733c6983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:09.491289 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb261a8-f518-4ad3-b857-910d733c6983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:09.493552 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb261a8-f518-4ad3-b857-910d733c6983 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:09.506492 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 621/1250] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:54:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:09.513237 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d01900-2b57-46e8-ac3a-5c617d80fe9d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:09.523042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d01900-2b57-46e8-ac3a-5c617d80fe9d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:09.527625 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08ebac-6bc4-41f3-8e75-612a54859f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:09.528403 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ebac-6bc4-41f3-8e75-612a54859f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:09.528678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ebac-6bc4-41f3-8e75-612a54859f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:09.528947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ebac-6bc4-41f3-8e75-612a54859f30 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:09.537026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08ebac-6bc4-41f3-8e75-612a54859f30 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:09.539040 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08ebac-6bc4-41f3-8e75-612a54859f30 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:09.554914 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-1b08ebac-6bc4-41f3-8e75-612a54859f30 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 02:54:09.556661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 630/1251] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:09 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:09.563686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb261a8-f518-4ad3-b857-910d733c6983 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:09.574005 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb261a8-f518-4ad3-b857-910d733c6983 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:09.578600 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bc454-0539-4bdb-8391-5a4412d9838b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:09.579243 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc454-0539-4bdb-8391-5a4412d9838b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:09.579513 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc454-0539-4bdb-8391-5a4412d9838b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:09.579781 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc454-0539-4bdb-8391-5a4412d9838b admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:09.580663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bc454-0539-4bdb-8391-5a4412d9838b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:09.580962 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bc454-0539-4bdb-8391-5a4412d9838b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:09.582797 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bc454-0539-4bdb-8391-5a4412d9838b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:09.601694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 622/1252] 10.222.0.18 () {56 vars in 1164 bytes} [Wed Dec 15 02:54:09 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:09.608551 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08ebac-6bc4-41f3-8e75-612a54859f30 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:09.620378 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08ebac-6bc4-41f3-8e75-612a54859f30 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:09.625949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dac29-999b-4dbc-986d-7c16d0d72275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:09.626728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dac29-999b-4dbc-986d-7c16d0d72275 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:09.627167 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dac29-999b-4dbc-986d-7c16d0d72275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:09.627372 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dac29-999b-4dbc-986d-7c16d0d72275 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:09.637458 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0dac29-999b-4dbc-986d-7c16d0d72275 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:09.639521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0dac29-999b-4dbc-986d-7c16d0d72275 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:09.650049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 631/1253] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:54:09 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:54:09.656609 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bc454-0539-4bdb-8391-5a4412d9838b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:09.666333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bc454-0539-4bdb-8391-5a4412d9838b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:09.670823 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f7989-b54a-442b-9c5b-ce4e4be1c6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:09.671587 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f7989-b54a-442b-9c5b-ce4e4be1c6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:09.671873 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f7989-b54a-442b-9c5b-ce4e4be1c6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:09.672145 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f7989-b54a-442b-9c5b-ce4e4be1c6f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:09.682472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f7989-b54a-442b-9c5b-ce4e4be1c6f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:09.684296 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f7989-b54a-442b-9c5b-ce4e4be1c6f5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:09.702297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-c92f7989-b54a-442b-9c5b-ce4e4be1c6f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:54:09.703621 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 623/1254] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:09.710376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dac29-999b-4dbc-986d-7c16d0d72275 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:09.720651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dac29-999b-4dbc-986d-7c16d0d72275 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:09.726916 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b08e48-548c-4b30-ac18-611e79ab41db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:09.727713 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b08e48-548c-4b30-ac18-611e79ab41db admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:09.728074 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b08e48-548c-4b30-ac18-611e79ab41db admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:09.728469 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b08e48-548c-4b30-ac18-611e79ab41db admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:09.729301 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b08e48-548c-4b30-ac18-611e79ab41db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:09.729670 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b08e48-548c-4b30-ac18-611e79ab41db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:09.731689 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b08e48-548c-4b30-ac18-611e79ab41db admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:09.745464 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 632/1255] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:54:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:09.751687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f7989-b54a-442b-9c5b-ce4e4be1c6f5 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:09.762704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f7989-b54a-442b-9c5b-ce4e4be1c6f5 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:09.767205 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb7765-9903-4f42-b416-d81f198d3e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:09.768154 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb7765-9903-4f42-b416-d81f198d3e29 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:09.768429 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb7765-9903-4f42-b416-d81f198d3e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:09.768788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb7765-9903-4f42-b416-d81f198d3e29 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:09.776234 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb7765-9903-4f42-b416-d81f198d3e29 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:09.778208 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb7765-9903-4f42-b416-d81f198d3e29 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:09.791849 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-99bb7765-9903-4f42-b416-d81f198d3e29 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:54:09.793114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 624/1256] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:54:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:09.799889 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b08e48-548c-4b30-ac18-611e79ab41db admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:09.811549 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b08e48-548c-4b30-ac18-611e79ab41db admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:09.816745 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6203056-72aa-48f8-82a3-86d4c79805da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:09.817471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6203056-72aa-48f8-82a3-86d4c79805da admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:09.817796 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6203056-72aa-48f8-82a3-86d4c79805da admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:09.818191 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6203056-72aa-48f8-82a3-86d4c79805da admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:09.819082 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6203056-72aa-48f8-82a3-86d4c79805da admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:09.819450 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6203056-72aa-48f8-82a3-86d4c79805da admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:09.822229 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6203056-72aa-48f8-82a3-86d4c79805da admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:09.836433 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 633/1257] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:54:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:09.843215 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb7765-9903-4f42-b416-d81f198d3e29 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:09.854141 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb7765-9903-4f42-b416-d81f198d3e29 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:09.859303 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c955e7-d6a1-4f1a-bae5-d12ef634ce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:09.860000 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c955e7-d6a1-4f1a-bae5-d12ef634ce48 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:09.860265 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c955e7-d6a1-4f1a-bae5-d12ef634ce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:09.860576 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c955e7-d6a1-4f1a-bae5-d12ef634ce48 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:09.861537 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c955e7-d6a1-4f1a-bae5-d12ef634ce48 admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=93762c21f03d44d5bf3881d17e14ef90) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:09.861963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c955e7-d6a1-4f1a-bae5-d12ef634ce48 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:09.864030 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c955e7-d6a1-4f1a-bae5-d12ef634ce48 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:09.870719 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 625/1258] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:54:09 2021] GET /identity/v3/role_assignments?user.id=93762c21f03d44d5bf3881d17e14ef90&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:54:12.306411 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5cc0f-6883-4c87-b695-7b083a28a838 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:12.307049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5cc0f-6883-4c87-b695-7b083a28a838 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:12.307049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5cc0f-6883-4c87-b695-7b083a28a838 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:12.309059 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 634/1259] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:54:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:54:12.316691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75291ec6-240d-4dac-a038-a56a56067c3f None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:12.317244 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75291ec6-240d-4dac-a038-a56a56067c3f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:12.317244 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75291ec6-240d-4dac-a038-a56a56067c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:12.336578 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-75291ec6-240d-4dac-a038-a56a56067c3f None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:54:12.337873 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-75291ec6-240d-4dac-a038-a56a56067c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:54:12.345783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 626/1260] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:54:12 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:54:12.372954 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5cc0f-6883-4c87-b695-7b083a28a838 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:12.386398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5cc0f-6883-4c87-b695-7b083a28a838 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:12.391090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5a22d-5bbf-45f0-99c2-712c938d15d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:12.391863 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5a22d-5bbf-45f0-99c2-712c938d15d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:12.392140 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5a22d-5bbf-45f0-99c2-712c938d15d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:12.392423 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5a22d-5bbf-45f0-99c2-712c938d15d0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:12.404450 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5a22d-5bbf-45f0-99c2-712c938d15d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:54:12.411637 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-9cf5a22d-5bbf-45f0-99c2-712c938d15d0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:54:12.412889 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 635/1261] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:54:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:12.420249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75291ec6-240d-4dac-a038-a56a56067c3f None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:12.429866 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75291ec6-240d-4dac-a038-a56a56067c3f None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:12.435555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d6b33-c4c0-4964-b934-9963bee66204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:12.436306 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d6b33-c4c0-4964-b934-9963bee66204 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:12.436648 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d6b33-c4c0-4964-b934-9963bee66204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:12.437054 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d6b33-c4c0-4964-b934-9963bee66204 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:12.437860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d6b33-c4c0-4964-b934-9963bee66204 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:12.438276 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d6b33-c4c0-4964-b934-9963bee66204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:12.439985 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d6b33-c4c0-4964-b934-9963bee66204 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:12.449106 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 627/1262] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:54:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:12.456255 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5a22d-5bbf-45f0-99c2-712c938d15d0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:12.467389 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5a22d-5bbf-45f0-99c2-712c938d15d0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:12.471803 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ed76e-0e25-4f56-b099-2167f920a09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:12.472624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ed76e-0e25-4f56-b099-2167f920a09d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:12.472962 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ed76e-0e25-4f56-b099-2167f920a09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:12.473248 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ed76e-0e25-4f56-b099-2167f920a09d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:12.484522 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ed76e-0e25-4f56-b099-2167f920a09d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:12.486366 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ed76e-0e25-4f56-b099-2167f920a09d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:12.505531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-a86ed76e-0e25-4f56-b099-2167f920a09d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:54:12.512924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 636/1263] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:12.514606 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d6b33-c4c0-4964-b934-9963bee66204 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:12.527661 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d6b33-c4c0-4964-b934-9963bee66204 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:12.532517 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b247268-76e1-47db-9eae-e97840c354c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:12.533413 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b247268-76e1-47db-9eae-e97840c354c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:12.533675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b247268-76e1-47db-9eae-e97840c354c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:12.534017 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b247268-76e1-47db-9eae-e97840c354c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:12.534884 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b247268-76e1-47db-9eae-e97840c354c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:12.535191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b247268-76e1-47db-9eae-e97840c354c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:12.537072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b247268-76e1-47db-9eae-e97840c354c3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:12.551005 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 628/1264] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:54:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:12.557535 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ed76e-0e25-4f56-b099-2167f920a09d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:12.568234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ed76e-0e25-4f56-b099-2167f920a09d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:12.573921 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c90e86-71f8-449b-bf96-95fe86177674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:12.574877 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c90e86-71f8-449b-bf96-95fe86177674 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:12.575221 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c90e86-71f8-449b-bf96-95fe86177674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:12.575508 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c90e86-71f8-449b-bf96-95fe86177674 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:12.584164 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c90e86-71f8-449b-bf96-95fe86177674 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:12.586191 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c90e86-71f8-449b-bf96-95fe86177674 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:12.602822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-d2c90e86-71f8-449b-bf96-95fe86177674 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 02:54:12.604011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 637/1265] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:12 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:12.610549 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b247268-76e1-47db-9eae-e97840c354c3 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:12.621217 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b247268-76e1-47db-9eae-e97840c354c3 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:12.625925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfcddd-1655-4c6e-997d-76d6260300e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:12.626725 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfcddd-1655-4c6e-997d-76d6260300e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:12.627034 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfcddd-1655-4c6e-997d-76d6260300e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:12.627321 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfcddd-1655-4c6e-997d-76d6260300e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:12.628405 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfcddd-1655-4c6e-997d-76d6260300e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:12.628818 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfcddd-1655-4c6e-997d-76d6260300e2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:12.630837 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfcddd-1655-4c6e-997d-76d6260300e2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:12.653924 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 629/1266] 10.222.0.18 () {56 vars in 1164 bytes} [Wed Dec 15 02:54:12 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:12.661295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c90e86-71f8-449b-bf96-95fe86177674 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:12.674962 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c90e86-71f8-449b-bf96-95fe86177674 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:12.680776 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113831f-ab44-4877-a8ab-a49b47cc486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:12.681653 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113831f-ab44-4877-a8ab-a49b47cc486c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:12.681968 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113831f-ab44-4877-a8ab-a49b47cc486c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:12.682559 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113831f-ab44-4877-a8ab-a49b47cc486c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:12.696780 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113831f-ab44-4877-a8ab-a49b47cc486c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:12.698723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113831f-ab44-4877-a8ab-a49b47cc486c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:12.717036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-9113831f-ab44-4877-a8ab-a49b47cc486c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:54:12.718408 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 638/1267] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:12.725049 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfcddd-1655-4c6e-997d-76d6260300e2 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:12.737629 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfcddd-1655-4c6e-997d-76d6260300e2 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:12.742462 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d6c6f-3605-43e5-9940-d4eb7aa43260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:12.743377 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d6c6f-3605-43e5-9940-d4eb7aa43260 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:12.743669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d6c6f-3605-43e5-9940-d4eb7aa43260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:12.743950 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d6c6f-3605-43e5-9940-d4eb7aa43260 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:12.744765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d6c6f-3605-43e5-9940-d4eb7aa43260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:12.745297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d6c6f-3605-43e5-9940-d4eb7aa43260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:12.747234 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d6c6f-3605-43e5-9940-d4eb7aa43260 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:12.761521 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 630/1268] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:54:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:12.771038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113831f-ab44-4877-a8ab-a49b47cc486c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:12.783440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113831f-ab44-4877-a8ab-a49b47cc486c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:12.788346 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef9d0f-80f0-46b4-b009-66a283a86231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:12.789123 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef9d0f-80f0-46b4-b009-66a283a86231 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:12.790085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef9d0f-80f0-46b4-b009-66a283a86231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:12.790328 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef9d0f-80f0-46b4-b009-66a283a86231 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:12.798559 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef9d0f-80f0-46b4-b009-66a283a86231 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:12.800756 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef9d0f-80f0-46b4-b009-66a283a86231 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:12.816883 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-c4ef9d0f-80f0-46b4-b009-66a283a86231 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:54:12.818330 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 639/1269] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:54:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:12.828049 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d6c6f-3605-43e5-9940-d4eb7aa43260 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:12.840036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d6c6f-3605-43e5-9940-d4eb7aa43260 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:12.845197 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aebe47-329c-4761-a642-b841896f7654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:12.845901 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aebe47-329c-4761-a642-b841896f7654 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:12.846279 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aebe47-329c-4761-a642-b841896f7654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:12.846643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aebe47-329c-4761-a642-b841896f7654 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:12.847543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aebe47-329c-4761-a642-b841896f7654 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:12.847858 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aebe47-329c-4761-a642-b841896f7654 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:12.849910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aebe47-329c-4761-a642-b841896f7654 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:12.865129 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 631/1270] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:54:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:12.872186 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef9d0f-80f0-46b4-b009-66a283a86231 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:12.885181 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef9d0f-80f0-46b4-b009-66a283a86231 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:12.890034 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdeae6-bc26-474c-b175-99133c447c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:12.891473 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdeae6-bc26-474c-b175-99133c447c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:12.891966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdeae6-bc26-474c-b175-99133c447c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:12.892463 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdeae6-bc26-474c-b175-99133c447c17 admin admin] PATH_INFO: `/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/93762c21f03d44d5bf3881d17e14ef90/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:12.896000 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdeae6-bc26-474c-b175-99133c447c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user_id=93762c21f03d44d5bf3881d17e14ef90, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:12.901332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdeae6-bc26-474c-b175-99133c447c17 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:12.915483 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 640/1271] 10.222.0.18 () {58 vars in 1460 bytes} [Wed Dec 15 02:54:12 2021] PUT /identity/v3/projects/aa03bf53a5ea4742be5ec4d1b69ac5ce/users/93762c21f03d44d5bf3881d17e14ef90/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:54:15.254475 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccc9d5-46f1-4bd2-bc85-92e48bc97609 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:15.254937 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccc9d5-46f1-4bd2-bc85-92e48bc97609 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:15.255036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccc9d5-46f1-4bd2-bc85-92e48bc97609 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:15.257021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 632/1272] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:54:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:54:15.262544 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df793ec-9b2e-40c7-b9a7-19ba28c517e5 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:15.262908 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df793ec-9b2e-40c7-b9a7-19ba28c517e5 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:15.263088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df793ec-9b2e-40c7-b9a7-19ba28c517e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:15.279980 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-6df793ec-9b2e-40c7-b9a7-19ba28c517e5 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:54:15.281142 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6df793ec-9b2e-40c7-b9a7-19ba28c517e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:54:15.334345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 641/1273] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:54:15 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:54:15.359882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccc9d5-46f1-4bd2-bc85-92e48bc97609 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:15.375034 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccc9d5-46f1-4bd2-bc85-92e48bc97609 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:15.380412 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59fc90-6260-4832-85bc-fb1941e2e2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:15.381468 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59fc90-6260-4832-85bc-fb1941e2e2bc admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:15.381744 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59fc90-6260-4832-85bc-fb1941e2e2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:15.382033 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59fc90-6260-4832-85bc-fb1941e2e2bc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:15.393801 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59fc90-6260-4832-85bc-fb1941e2e2bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 02:54:15.401795 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-2a59fc90-6260-4832-85bc-fb1941e2e2bc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 02:54:15.402987 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 633/1274] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Dec 15 02:54:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:15.409350 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df793ec-9b2e-40c7-b9a7-19ba28c517e5 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:15.418620 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df793ec-9b2e-40c7-b9a7-19ba28c517e5 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:15.423030 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc1c93-c788-4b8d-948a-805c62002edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:15.423669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc1c93-c788-4b8d-948a-805c62002edf admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:15.423948 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc1c93-c788-4b8d-948a-805c62002edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:15.424222 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc1c93-c788-4b8d-948a-805c62002edf admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:15.424970 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc1c93-c788-4b8d-948a-805c62002edf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:15.425275 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc1c93-c788-4b8d-948a-805c62002edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:15.426888 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc1c93-c788-4b8d-948a-805c62002edf admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:15.435434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 642/1275] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Dec 15 02:54:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:15.441163 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59fc90-6260-4832-85bc-fb1941e2e2bc admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:15.450868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59fc90-6260-4832-85bc-fb1941e2e2bc admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:15.455273 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cf3a8-6ef8-4a49-a793-693246717c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:15.456003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cf3a8-6ef8-4a49-a793-693246717c09 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:15.456328 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cf3a8-6ef8-4a49-a793-693246717c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:15.456550 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cf3a8-6ef8-4a49-a793-693246717c09 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:15.466876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cf3a8-6ef8-4a49-a793-693246717c09 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:15.468661 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cf3a8-6ef8-4a49-a793-693246717c09 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:15.485290 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-1a0cf3a8-6ef8-4a49-a793-693246717c09 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:54:15.486405 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 634/1276] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:15.492151 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc1c93-c788-4b8d-948a-805c62002edf admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:15.501270 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc1c93-c788-4b8d-948a-805c62002edf admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:15.505625 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb52e7-5c99-4bec-bb4d-bbd3704bf6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:15.506524 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb52e7-5c99-4bec-bb4d-bbd3704bf6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:15.506804 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb52e7-5c99-4bec-bb4d-bbd3704bf6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:15.507079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb52e7-5c99-4bec-bb4d-bbd3704bf6d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:15.507789 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb52e7-5c99-4bec-bb4d-bbd3704bf6d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:15.508089 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb52e7-5c99-4bec-bb4d-bbd3704bf6d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:15.509616 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb52e7-5c99-4bec-bb4d-bbd3704bf6d7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:15.520805 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 643/1277] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:54:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:15.526811 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cf3a8-6ef8-4a49-a793-693246717c09 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:15.535743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cf3a8-6ef8-4a49-a793-693246717c09 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:15.540753 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d427b-8525-4680-b268-21c83e35db26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:15.541478 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d427b-8525-4680-b268-21c83e35db26 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:15.541754 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d427b-8525-4680-b268-21c83e35db26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:15.542057 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d427b-8525-4680-b268-21c83e35db26 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:15.548963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d427b-8525-4680-b268-21c83e35db26 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:15.550946 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d427b-8525-4680-b268-21c83e35db26 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:15.565250 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-736d427b-8525-4680-b268-21c83e35db26 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 02:54:15.566337 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 635/1278] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:15 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:15.572109 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb52e7-5c99-4bec-bb4d-bbd3704bf6d7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:15.581147 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb52e7-5c99-4bec-bb4d-bbd3704bf6d7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:15.585673 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5891b41-20ae-4931-9369-8fde7020e703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:15.586857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5891b41-20ae-4931-9369-8fde7020e703 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:15.587136 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5891b41-20ae-4931-9369-8fde7020e703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:15.587410 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5891b41-20ae-4931-9369-8fde7020e703 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:15.588255 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5891b41-20ae-4931-9369-8fde7020e703 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:15.588555 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5891b41-20ae-4931-9369-8fde7020e703 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:15.590367 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5891b41-20ae-4931-9369-8fde7020e703 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:15.607218 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 644/1279] 10.222.0.18 () {56 vars in 1164 bytes} [Wed Dec 15 02:54:15 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:15.612920 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d427b-8525-4680-b268-21c83e35db26 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:15.622134 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d427b-8525-4680-b268-21c83e35db26 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:15.626532 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052c687-8561-4361-85c8-f4147d29de65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:15.627135 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052c687-8561-4361-85c8-f4147d29de65 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:15.627414 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052c687-8561-4361-85c8-f4147d29de65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:15.627687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052c687-8561-4361-85c8-f4147d29de65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:15.635375 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052c687-8561-4361-85c8-f4147d29de65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:15.637090 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052c687-8561-4361-85c8-f4147d29de65 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:15.645518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 636/1280] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Dec 15 02:54:15 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:54:15.651808 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5891b41-20ae-4931-9369-8fde7020e703 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:15.660809 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5891b41-20ae-4931-9369-8fde7020e703 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:15.665824 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d245ec-e9b4-458d-9331-cf2477eaedef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:15.666611 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d245ec-e9b4-458d-9331-cf2477eaedef admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:15.666893 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d245ec-e9b4-458d-9331-cf2477eaedef admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:15.667168 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d245ec-e9b4-458d-9331-cf2477eaedef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:15.676930 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d245ec-e9b4-458d-9331-cf2477eaedef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:15.678721 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d245ec-e9b4-458d-9331-cf2477eaedef admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:15.694750 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-a0d245ec-e9b4-458d-9331-cf2477eaedef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 02:54:15.695870 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 645/1281] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Dec 15 02:54:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:15.701543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052c687-8561-4361-85c8-f4147d29de65 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:15.709878 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052c687-8561-4361-85c8-f4147d29de65 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:15.714751 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2374d37-cc1c-4157-8e40-09cc943f544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:15.715359 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2374d37-cc1c-4157-8e40-09cc943f544d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:15.715636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2374d37-cc1c-4157-8e40-09cc943f544d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:15.715907 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2374d37-cc1c-4157-8e40-09cc943f544d admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:15.716602 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2374d37-cc1c-4157-8e40-09cc943f544d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:15.716898 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2374d37-cc1c-4157-8e40-09cc943f544d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:15.718451 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2374d37-cc1c-4157-8e40-09cc943f544d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:15.729706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 637/1282] 10.222.0.18 () {56 vars in 1130 bytes} [Wed Dec 15 02:54:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:15.735221 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d245ec-e9b4-458d-9331-cf2477eaedef admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:15.744322 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d245ec-e9b4-458d-9331-cf2477eaedef admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:15.748656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda2a6e-5b5a-4de7-95d3-95dca5090f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:15.749375 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda2a6e-5b5a-4de7-95d3-95dca5090f7f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:15.749650 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda2a6e-5b5a-4de7-95d3-95dca5090f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:15.749918 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda2a6e-5b5a-4de7-95d3-95dca5090f7f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:15.756652 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda2a6e-5b5a-4de7-95d3-95dca5090f7f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:15.758549 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda2a6e-5b5a-4de7-95d3-95dca5090f7f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:15.770896 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING keystone.server.flask.application [None req-aeda2a6e-5b5a-4de7-95d3-95dca5090f7f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 02:54:15.771966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 646/1283] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Dec 15 02:54:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 02:54:15.778136 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2374d37-cc1c-4157-8e40-09cc943f544d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:15.787137 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2374d37-cc1c-4157-8e40-09cc943f544d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:15.792180 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511bd20-fc8e-4bb5-84ae-3739e0b9b868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:15.792785 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511bd20-fc8e-4bb5-84ae-3739e0b9b868 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:15.793061 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511bd20-fc8e-4bb5-84ae-3739e0b9b868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:15.793329 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511bd20-fc8e-4bb5-84ae-3739e0b9b868 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:15.794134 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511bd20-fc8e-4bb5-84ae-3739e0b9b868 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:15.794436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511bd20-fc8e-4bb5-84ae-3739e0b9b868 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:15.796207 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511bd20-fc8e-4bb5-84ae-3739e0b9b868 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:15.807774 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 638/1284] 10.222.0.18 () {56 vars in 1169 bytes} [Wed Dec 15 02:54:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:15.813548 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda2a6e-5b5a-4de7-95d3-95dca5090f7f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:15.823672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda2a6e-5b5a-4de7-95d3-95dca5090f7f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:15.828002 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac309ba-1cfa-42f9-9ac0-e1ccbe0c55bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:15.828593 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac309ba-1cfa-42f9-9ac0-e1ccbe0c55bb admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:15.828872 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac309ba-1cfa-42f9-9ac0-e1ccbe0c55bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:15.829144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac309ba-1cfa-42f9-9ac0-e1ccbe0c55bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:15.829952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac309ba-1cfa-42f9-9ac0-e1ccbe0c55bb admin admin] RBAC: Adding query filter params (role.id=5f5ed2f047e14fffbb71361f14dc13a1, scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce, user.id=93762c21f03d44d5bf3881d17e14ef90) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:15.830285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac309ba-1cfa-42f9-9ac0-e1ccbe0c55bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:15.832043 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac309ba-1cfa-42f9-9ac0-e1ccbe0c55bb admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:15.838178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 647/1285] 10.222.0.18 () {56 vars in 1395 bytes} [Wed Dec 15 02:54:15 2021] GET /identity/v3/role_assignments?user.id=93762c21f03d44d5bf3881d17e14ef90&scope.project.id=aa03bf53a5ea4742be5ec4d1b69ac5ce&role.id=5f5ed2f047e14fffbb71361f14dc13a1 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:18.168866 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dd18b-b808-438f-824b-afacb6709320 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:18.169411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dd18b-b808-438f-824b-afacb6709320 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:18.169411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dd18b-b808-438f-824b-afacb6709320 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:18.171203 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 639/1286] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:54:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:54:18.176766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312270d-1f93-4244-99cb-d1601ef96baf None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:18.177159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312270d-1f93-4244-99cb-d1601ef96baf None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:18.177314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312270d-1f93-4244-99cb-d1601ef96baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:18.195087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-0312270d-1f93-4244-99cb-d1601ef96baf None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:54:18.196240 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-0312270d-1f93-4244-99cb-d1601ef96baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:54:18.203754 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 648/1287] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:54:18 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:54:18.226005 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dd18b-b808-438f-824b-afacb6709320 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:18.238313 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dd18b-b808-438f-824b-afacb6709320 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:18.243146 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdc306-924b-421c-87f5-68ce64dd2bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:18.243912 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdc306-924b-421c-87f5-68ce64dd2bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:18.244190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdc306-924b-421c-87f5-68ce64dd2bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:18.244462 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdc306-924b-421c-87f5-68ce64dd2bb8 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:18.245115 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdc306-924b-421c-87f5-68ce64dd2bb8 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:18.246740 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdc306-924b-421c-87f5-68ce64dd2bb8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:18.257645 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-59fdc306-924b-421c-87f5-68ce64dd2bb8 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 02:54:18.258802 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 640/1288] 10.222.0.18 () {56 vars in 1138 bytes} [Wed Dec 15 02:54:18 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:18.265031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312270d-1f93-4244-99cb-d1601ef96baf None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:18.273847 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312270d-1f93-4244-99cb-d1601ef96baf None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:18.278370 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f486a-6327-4b08-998f-947693cedaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:18.279007 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f486a-6327-4b08-998f-947693cedaca admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:18.279290 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f486a-6327-4b08-998f-947693cedaca admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:18.279569 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f486a-6327-4b08-998f-947693cedaca admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:18.280283 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f486a-6327-4b08-998f-947693cedaca admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:18.280598 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f486a-6327-4b08-998f-947693cedaca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:18.282196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f486a-6327-4b08-998f-947693cedaca admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:18.286942 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 649/1289] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Dec 15 02:54:18 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:18.292744 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdc306-924b-421c-87f5-68ce64dd2bb8 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:18.301790 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdc306-924b-421c-87f5-68ce64dd2bb8 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:18.306809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1588422-c398-40d8-b409-597fc85a9134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:18.307423 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1588422-c398-40d8-b409-597fc85a9134 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:18.307702 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1588422-c398-40d8-b409-597fc85a9134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:18.307975 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1588422-c398-40d8-b409-597fc85a9134 admin admin] PATH_INFO: `/v3/services` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:18.308670 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1588422-c398-40d8-b409-597fc85a9134 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:18.308969 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1588422-c398-40d8-b409-597fc85a9134 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:18.310553 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1588422-c398-40d8-b409-597fc85a9134 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:18.314746 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 641/1290] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Dec 15 02:54:18 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 02:54:20.610635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeb598-830d-41da-a91f-38deffb8dd04 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:20.611171 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeb598-830d-41da-a91f-38deffb8dd04 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:20.611171 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeb598-830d-41da-a91f-38deffb8dd04 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:20.612941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 650/1291] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:54:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:54:20.618494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc03b79-0656-4013-b5c2-315a768b4507 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:20.618914 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc03b79-0656-4013-b5c2-315a768b4507 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:20.619045 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc03b79-0656-4013-b5c2-315a768b4507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:20.636926 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-6bc03b79-0656-4013-b5c2-315a768b4507 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:54:20.638138 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6bc03b79-0656-4013-b5c2-315a768b4507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:54:20.645526 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 642/1292] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:54:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:54:20.669058 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeb598-830d-41da-a91f-38deffb8dd04 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:20.681271 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeb598-830d-41da-a91f-38deffb8dd04 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:20.685515 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d19a13-1366-4beb-875b-759689323355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:20.686165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d19a13-1366-4beb-875b-759689323355 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:20.686449 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d19a13-1366-4beb-875b-759689323355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:20.686721 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d19a13-1366-4beb-875b-759689323355 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:20.687439 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d19a13-1366-4beb-875b-759689323355 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:20.689002 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d19a13-1366-4beb-875b-759689323355 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:20.702239 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 651/1293] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Dec 15 02:54:20 2021] POST /identity/v3/services => generated 246 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:54:23.007218 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b161df-77a2-4742-b19f-743f93ad3cc3 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:23.007751 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b161df-77a2-4742-b19f-743f93ad3cc3 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:23.007751 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b161df-77a2-4742-b19f-743f93ad3cc3 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:23.009552 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 643/1294] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:54:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:54:23.015163 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dee9f7-49dd-4c0e-8ab3-60d1ddb0d9a3 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:23.015577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dee9f7-49dd-4c0e-8ab3-60d1ddb0d9a3 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:23.015709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dee9f7-49dd-4c0e-8ab3-60d1ddb0d9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:23.033182 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-46dee9f7-49dd-4c0e-8ab3-60d1ddb0d9a3 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:54:23.034371 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-46dee9f7-49dd-4c0e-8ab3-60d1ddb0d9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:54:23.050710 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 652/1295] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:54:23 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:54:23.073831 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b161df-77a2-4742-b19f-743f93ad3cc3 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:23.085478 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b161df-77a2-4742-b19f-743f93ad3cc3 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:23.090241 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc486293-021a-4e60-afc9-45a29e253a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:23.090994 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc486293-021a-4e60-afc9-45a29e253a03 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:23.091273 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc486293-021a-4e60-afc9-45a29e253a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:23.091545 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc486293-021a-4e60-afc9-45a29e253a03 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:23.092200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc486293-021a-4e60-afc9-45a29e253a03 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:23.093765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc486293-021a-4e60-afc9-45a29e253a03 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:23.105061 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-cc486293-021a-4e60-afc9-45a29e253a03 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 02:54:23.106181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 644/1296] 10.222.0.18 () {56 vars in 1138 bytes} [Wed Dec 15 02:54:23 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:23.112113 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dee9f7-49dd-4c0e-8ab3-60d1ddb0d9a3 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:23.120530 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dee9f7-49dd-4c0e-8ab3-60d1ddb0d9a3 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:23.125047 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4ef90-251b-4e4e-a59e-fbd655871d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:23.125668 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4ef90-251b-4e4e-a59e-fbd655871d3d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:23.125946 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4ef90-251b-4e4e-a59e-fbd655871d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:23.126249 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4ef90-251b-4e4e-a59e-fbd655871d3d admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:23.126944 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4ef90-251b-4e4e-a59e-fbd655871d3d admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:23.127244 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4ef90-251b-4e4e-a59e-fbd655871d3d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:23.128784 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4ef90-251b-4e4e-a59e-fbd655871d3d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:23.133935 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 653/1297] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Dec 15 02:54:23 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:23.139874 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc486293-021a-4e60-afc9-45a29e253a03 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:23.149392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc486293-021a-4e60-afc9-45a29e253a03 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:23.153750 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a453b-8c76-4dcc-9acd-17007d6b8f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:23.154376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a453b-8c76-4dcc-9acd-17007d6b8f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:23.154656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a453b-8c76-4dcc-9acd-17007d6b8f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:23.154932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a453b-8c76-4dcc-9acd-17007d6b8f22 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:23.155708 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a453b-8c76-4dcc-9acd-17007d6b8f22 admin admin] RBAC: Adding query filter params (interface=public, service_id=5b20331dbacd49bc96ca91f7c8db4828, region_id=RegionOne) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:23.156013 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a453b-8c76-4dcc-9acd-17007d6b8f22 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:23.157530 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a453b-8c76-4dcc-9acd-17007d6b8f22 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:23.162252 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 645/1298] 10.222.0.18 () {56 vars in 1272 bytes} [Wed Dec 15 02:54:23 2021] GET /identity/v3/endpoints?service_id=5b20331dbacd49bc96ca91f7c8db4828&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:23.168233 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4ef90-251b-4e4e-a59e-fbd655871d3d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:23.177151 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4ef90-251b-4e4e-a59e-fbd655871d3d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:23.181512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1ab93-bcf5-4b72-a526-2454c07bcd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:23.182148 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1ab93-bcf5-4b72-a526-2454c07bcd6a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:23.182429 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1ab93-bcf5-4b72-a526-2454c07bcd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:23.182701 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1ab93-bcf5-4b72-a526-2454c07bcd6a admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:23.183356 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1ab93-bcf5-4b72-a526-2454c07bcd6a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:23.184863 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1ab93-bcf5-4b72-a526-2454c07bcd6a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:23.191431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 654/1299] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Dec 15 02:54:23 2021] GET /identity/v3/services => generated 2191 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 02:54:25.546042 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeeac0-1406-4589-95b3-c5380054fc94 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:25.546568 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeeac0-1406-4589-95b3-c5380054fc94 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:25.546568 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeeac0-1406-4589-95b3-c5380054fc94 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:25.548313 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 646/1300] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:54:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:54:25.554001 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b98e2-c88a-44f9-9a26-30a9817c53b3 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:25.554403 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b98e2-c88a-44f9-9a26-30a9817c53b3 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:25.555054 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b98e2-c88a-44f9-9a26-30a9817c53b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:25.572583 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-c21b98e2-c88a-44f9-9a26-30a9817c53b3 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:54:25.573740 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c21b98e2-c88a-44f9-9a26-30a9817c53b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:54:25.581167 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 655/1301] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:54:25 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:54:25.605215 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eeeac0-1406-4589-95b3-c5380054fc94 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:25.617663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eeeac0-1406-4589-95b3-c5380054fc94 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:25.621962 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967befd-4083-42e1-a36e-f1e750a41f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:25.622751 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967befd-4083-42e1-a36e-f1e750a41f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:25.623031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967befd-4083-42e1-a36e-f1e750a41f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:25.623304 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967befd-4083-42e1-a36e-f1e750a41f43 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:25.623955 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967befd-4083-42e1-a36e-f1e750a41f43 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:25.625523 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967befd-4083-42e1-a36e-f1e750a41f43 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:25.636459 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-6967befd-4083-42e1-a36e-f1e750a41f43 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 02:54:25.637550 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 647/1302] 10.222.0.18 () {56 vars in 1138 bytes} [Wed Dec 15 02:54:25 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 02:54:25.643682 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b98e2-c88a-44f9-9a26-30a9817c53b3 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:25.652420 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b98e2-c88a-44f9-9a26-30a9817c53b3 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:25.656931 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba75fb-0aa2-4175-b76b-ec9167247aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:25.657568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba75fb-0aa2-4175-b76b-ec9167247aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:25.657852 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba75fb-0aa2-4175-b76b-ec9167247aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:25.658169 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba75fb-0aa2-4175-b76b-ec9167247aa8 admin admin] PATH_INFO: `/v3/services` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:25.658885 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba75fb-0aa2-4175-b76b-ec9167247aa8 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:54:25.659193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba75fb-0aa2-4175-b76b-ec9167247aa8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:25.660754 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba75fb-0aa2-4175-b76b-ec9167247aa8 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:25.667157 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 656/1303] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Dec 15 02:54:25 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:54:25.672673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967befd-4083-42e1-a36e-f1e750a41f43 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:54:25.682986 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967befd-4083-42e1-a36e-f1e750a41f43 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:54:25.687408 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff470d1-2db1-466a-9877-b1b66c3097a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:54:25.688011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff470d1-2db1-466a-9877-b1b66c3097a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:54:25.688290 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff470d1-2db1-466a-9877-b1b66c3097a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:54:25.688562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff470d1-2db1-466a-9877-b1b66c3097a0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:54:25.689303 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff470d1-2db1-466a-9877-b1b66c3097a0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:54:25.690878 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff470d1-2db1-466a-9877-b1b66c3097a0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:54:25.709029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 648/1304] 10.222.0.18 () {60 vars in 1165 bytes} [Wed Dec 15 02:54:25 2021] POST /identity/v3/endpoints => generated 331 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:55:27.986199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1ef0-23d5-4e4d-9363-0dd783d5531e None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:27.986651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1ef0-23d5-4e4d-9363-0dd783d5531e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:27.986651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1ef0-23d5-4e4d-9363-0dd783d5531e None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:27.988354 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 657/1305] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:55:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:55:27.996822 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b59857-ba29-4c38-a20c-51430ff4c135 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:27.996822 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b59857-ba29-4c38-a20c-51430ff4c135 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:27.996822 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b59857-ba29-4c38-a20c-51430ff4c135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:28.122487 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-e1b59857-ba29-4c38-a20c-51430ff4c135 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:55:28.124169 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e1b59857-ba29-4c38-a20c-51430ff4c135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:28.246023 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 649/1306] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:55:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:55:28.268169 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa1ef0-23d5-4e4d-9363-0dd783d5531e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:55:28.269868 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-21fa1ef0-23d5-4e4d-9363-0dd783d5531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:28.403216 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa1ef0-23d5-4e4d-9363-0dd783d5531e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:55:28.500389 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa8bd1-bfa8-498d-b780-c93edc41bcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:55:28.501044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa8bd1-bfa8-498d-b780-c93edc41bcde admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:28.501323 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa8bd1-bfa8-498d-b780-c93edc41bcde admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:28.501592 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa8bd1-bfa8-498d-b780-c93edc41bcde admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:28.502345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa8bd1-bfa8-498d-b780-c93edc41bcde admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:55:28.504161 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa8bd1-bfa8-498d-b780-c93edc41bcde admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:55:28.523416 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 658/1307] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Dec 15 02:55:28 2021] GET /identity/v3/projects => generated 2553 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 02:55:30.922143 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20419d60-04bd-41f1-8bf2-f14d0885622d None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:30.922672 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20419d60-04bd-41f1-8bf2-f14d0885622d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:30.922672 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20419d60-04bd-41f1-8bf2-f14d0885622d None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:30.924460 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 650/1308] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:55:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:55:30.930329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d246982-b37b-4d8a-b99b-9865515be9e5 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:30.930739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d246982-b37b-4d8a-b99b-9865515be9e5 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:30.930892 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d246982-b37b-4d8a-b99b-9865515be9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:31.009387 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-1d246982-b37b-4d8a-b99b-9865515be9e5 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:55:31.010554 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-1d246982-b37b-4d8a-b99b-9865515be9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:31.102383 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 659/1309] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:55:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:55:31.153700 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f213b6d-5a54-4fd8-9ad9-16735f8978f0 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:31.154038 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f213b6d-5a54-4fd8-9ad9-16735f8978f0 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:31.154322 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f213b6d-5a54-4fd8-9ad9-16735f8978f0 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:31.156106 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 651/1310] 10.222.0.18 () {54 vars in 964 bytes} [Wed Dec 15 02:55:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:55:31.162340 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b07da8-c322-46c2-b769-fbf46a636712 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:31.162630 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b07da8-c322-46c2-b769-fbf46a636712 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:31.162907 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b07da8-c322-46c2-b769-fbf46a636712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:31.239381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-e4b07da8-c322-46c2-b769-fbf46a636712 None None] MFA Rules not processed for user `eb120cde66b246909cf8e0b7b8d96ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:55:31.241052 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e4b07da8-c322-46c2-b769-fbf46a636712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:31.312143 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 660/1311] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Dec 15 02:55:31 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:55:31.322230 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f213b6d-5a54-4fd8-9ad9-16735f8978f0 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:55:31.323763 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-5f213b6d-5a54-4fd8-9ad9-16735f8978f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:31.422256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f213b6d-5a54-4fd8-9ad9-16735f8978f0 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:55:31.491262 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0db33-5602-471a-99fa-d15031f58ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:55:31.491817 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0db33-5602-471a-99fa-d15031f58ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:31.492095 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0db33-5602-471a-99fa-d15031f58ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:31.492366 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0db33-5602-471a-99fa-d15031f58ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:31.494004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8bf0db33-5602-471a-99fa-d15031f58ed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:31.599932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0db33-5602-471a-99fa-d15031f58ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:55:31.601374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0db33-5602-471a-99fa-d15031f58ed8 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:55:31.619103 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 652/1312] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:55:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 02:55:34.219488 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59590ab-fd87-41bc-94ef-1d9f33c42586 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:34.219976 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59590ab-fd87-41bc-94ef-1d9f33c42586 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:34.220073 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59590ab-fd87-41bc-94ef-1d9f33c42586 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:34.221795 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 661/1313] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:55:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:55:34.227330 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c2af3-60fc-4668-af29-1c1bf90f95b1 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:34.227728 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c2af3-60fc-4668-af29-1c1bf90f95b1 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:34.227883 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c2af3-60fc-4668-af29-1c1bf90f95b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:34.289347 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-4c8c2af3-60fc-4668-af29-1c1bf90f95b1 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:55:34.290482 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-4c8c2af3-60fc-4668-af29-1c1bf90f95b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:34.382561 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 653/1314] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:55:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:55:34.420957 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59590ab-fd87-41bc-94ef-1d9f33c42586 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:55:34.422490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f59590ab-fd87-41bc-94ef-1d9f33c42586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:34.521348 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59590ab-fd87-41bc-94ef-1d9f33c42586 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:55:34.591499 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b1864-4c12-457b-b091-f4f9edee1744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:55:34.592137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1864-4c12-457b-b091-f4f9edee1744 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:34.592417 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1864-4c12-457b-b091-f4f9edee1744 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:34.592689 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1864-4c12-457b-b091-f4f9edee1744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:34.594368 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-cb4b1864-4c12-457b-b091-f4f9edee1744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:34.704823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b1864-4c12-457b-b091-f4f9edee1744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:55:34.706274 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b1864-4c12-457b-b091-f4f9edee1744 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:55:34.723669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 662/1315] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:55:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:55:37.334712 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951684c1-ec0b-4182-96ac-612212fa1d84 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:37.335256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951684c1-ec0b-4182-96ac-612212fa1d84 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:37.335256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951684c1-ec0b-4182-96ac-612212fa1d84 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:37.337060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 654/1316] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:55:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:55:37.342679 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45dbc0-901d-4f82-b9c4-dc9498737005 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:37.343071 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45dbc0-901d-4f82-b9c4-dc9498737005 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:37.343235 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45dbc0-901d-4f82-b9c4-dc9498737005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:37.406519 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-2e45dbc0-901d-4f82-b9c4-dc9498737005 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:55:37.407706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-2e45dbc0-901d-4f82-b9c4-dc9498737005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:37.497612 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 663/1317] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:55:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:55:37.533235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951684c1-ec0b-4182-96ac-612212fa1d84 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:55:37.534745 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-951684c1-ec0b-4182-96ac-612212fa1d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:37.650634 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951684c1-ec0b-4182-96ac-612212fa1d84 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:55:37.737611 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc1ccc-1a5b-4ddd-8b3c-8183cd3f904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:55:37.738474 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc1ccc-1a5b-4ddd-8b3c-8183cd3f904d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:37.738755 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc1ccc-1a5b-4ddd-8b3c-8183cd3f904d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:37.739027 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc1ccc-1a5b-4ddd-8b3c-8183cd3f904d admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:37.748975 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc1ccc-1a5b-4ddd-8b3c-8183cd3f904d admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:55:37.750998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc1ccc-1a5b-4ddd-8b3c-8183cd3f904d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:55:37.752650 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 655/1318] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:55:37 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:55:37.765779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45dbc0-901d-4f82-b9c4-dc9498737005 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:55:37.767053 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-2e45dbc0-901d-4f82-b9c4-dc9498737005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:37.852746 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45dbc0-901d-4f82-b9c4-dc9498737005 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:55:37.920978 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb84d-72a8-4374-a2c8-d8d6a7d77993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:55:37.921603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb84d-72a8-4374-a2c8-d8d6a7d77993 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:37.921881 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb84d-72a8-4374-a2c8-d8d6a7d77993 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:37.922182 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb84d-72a8-4374-a2c8-d8d6a7d77993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:37.923781 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-425bb84d-72a8-4374-a2c8-d8d6a7d77993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:38.025250 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bb84d-72a8-4374-a2c8-d8d6a7d77993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:55:38.026633 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bb84d-72a8-4374-a2c8-d8d6a7d77993 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:55:38.043906 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 664/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:55:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:55:40.872251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf4ba0-a792-4833-8aa1-5bc014a0dcfe None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:40.872806 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf4ba0-a792-4833-8aa1-5bc014a0dcfe None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:40.872806 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf4ba0-a792-4833-8aa1-5bc014a0dcfe None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:40.874629 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 656/1320] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:55:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:55:40.880999 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3ab50-417c-47a0-9dee-07f6ed134692 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:40.881404 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3ab50-417c-47a0-9dee-07f6ed134692 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:40.881581 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3ab50-417c-47a0-9dee-07f6ed134692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:40.943854 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-6ff3ab50-417c-47a0-9dee-07f6ed134692 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:55:40.945028 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6ff3ab50-417c-47a0-9dee-07f6ed134692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:41.034652 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 665/1321] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:55:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:55:41.069555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf4ba0-a792-4833-8aa1-5bc014a0dcfe None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:55:41.071128 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-abaf4ba0-a792-4833-8aa1-5bc014a0dcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:41.189704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf4ba0-a792-4833-8aa1-5bc014a0dcfe None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:55:41.277404 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11d527-2c38-4bc9-b0bf-98f3686808a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:55:41.278259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11d527-2c38-4bc9-b0bf-98f3686808a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:41.278538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11d527-2c38-4bc9-b0bf-98f3686808a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:41.278807 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11d527-2c38-4bc9-b0bf-98f3686808a6 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:41.288021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11d527-2c38-4bc9-b0bf-98f3686808a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:55:41.290076 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11d527-2c38-4bc9-b0bf-98f3686808a6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:55:41.291760 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 657/1322] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:55:41 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:55:41.304342 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3ab50-417c-47a0-9dee-07f6ed134692 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:55:41.305522 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6ff3ab50-417c-47a0-9dee-07f6ed134692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:41.392978 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3ab50-417c-47a0-9dee-07f6ed134692 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:55:41.461301 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9daf0-d645-44e4-aad6-394ac53bac8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:55:41.461866 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9daf0-d645-44e4-aad6-394ac53bac8d service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:41.462175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9daf0-d645-44e4-aad6-394ac53bac8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:41.462444 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9daf0-d645-44e4-aad6-394ac53bac8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:41.464051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5cf9daf0-d645-44e4-aad6-394ac53bac8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:41.564877 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9daf0-d645-44e4-aad6-394ac53bac8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:55:41.566319 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9daf0-d645-44e4-aad6-394ac53bac8d service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:55:41.583038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 666/1323] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:55:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:55:44.563893 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316c798-16e0-4f13-ae84-0f69259fa465 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:44.564437 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316c798-16e0-4f13-ae84-0f69259fa465 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:44.564437 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316c798-16e0-4f13-ae84-0f69259fa465 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:44.566266 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 658/1324] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:55:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:55:44.572708 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d208db-e965-4816-98b8-8eef17dc617c None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:44.573136 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d208db-e965-4816-98b8-8eef17dc617c None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:44.573263 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d208db-e965-4816-98b8-8eef17dc617c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:44.637166 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-73d208db-e965-4816-98b8-8eef17dc617c None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:55:44.638414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-73d208db-e965-4816-98b8-8eef17dc617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:44.731431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 667/1325] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:55:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:55:44.770006 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316c798-16e0-4f13-ae84-0f69259fa465 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:55:44.771556 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0316c798-16e0-4f13-ae84-0f69259fa465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:44.869889 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316c798-16e0-4f13-ae84-0f69259fa465 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:55:44.939693 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417ad0e-3b2f-4c1a-8a1d-cbb080185257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:55:44.940344 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417ad0e-3b2f-4c1a-8a1d-cbb080185257 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:44.940608 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417ad0e-3b2f-4c1a-8a1d-cbb080185257 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:44.940876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417ad0e-3b2f-4c1a-8a1d-cbb080185257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:44.943170 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-3417ad0e-3b2f-4c1a-8a1d-cbb080185257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:45.044588 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417ad0e-3b2f-4c1a-8a1d-cbb080185257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:55:45.045940 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417ad0e-3b2f-4c1a-8a1d-cbb080185257 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:55:45.063434 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 659/1326] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:55:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:55:47.484540 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1eb95-295b-4d88-ba15-ce5d88a6d075 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:47.485077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1eb95-295b-4d88-ba15-ce5d88a6d075 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:47.485077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1eb95-295b-4d88-ba15-ce5d88a6d075 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:47.486887 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 668/1327] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:55:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:55:47.493197 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d966036-a9a8-4a9c-a199-ebb5ae5b110b None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:47.493620 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d966036-a9a8-4a9c-a199-ebb5ae5b110b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:47.493760 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d966036-a9a8-4a9c-a199-ebb5ae5b110b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:47.556365 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-2d966036-a9a8-4a9c-a199-ebb5ae5b110b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:55:47.557558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-2d966036-a9a8-4a9c-a199-ebb5ae5b110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:47.649879 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 660/1328] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:55:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:55:47.703434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85979ef2-be76-4073-9b63-5e837aee0ab4 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:47.703722 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85979ef2-be76-4073-9b63-5e837aee0ab4 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:47.703996 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85979ef2-be76-4073-9b63-5e837aee0ab4 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:47.705824 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 669/1329] 10.222.0.18 () {54 vars in 964 bytes} [Wed Dec 15 02:55:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:55:47.713307 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed326a13-a3f0-4933-99f7-43b07d66fb62 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:47.713588 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed326a13-a3f0-4933-99f7-43b07d66fb62 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:47.713860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed326a13-a3f0-4933-99f7-43b07d66fb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:47.787569 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-ed326a13-a3f0-4933-99f7-43b07d66fb62 None None] MFA Rules not processed for user `eb120cde66b246909cf8e0b7b8d96ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:55:47.788664 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-ed326a13-a3f0-4933-99f7-43b07d66fb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:47.859047 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 661/1330] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Dec 15 02:55:47 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:55:47.868222 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85979ef2-be76-4073-9b63-5e837aee0ab4 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:55:47.869706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-85979ef2-be76-4073-9b63-5e837aee0ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:47.967680 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85979ef2-be76-4073-9b63-5e837aee0ab4 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:55:48.037697 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc393a10-ffcc-4d4a-976c-4fcf2c5c00ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:55:48.038262 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc393a10-ffcc-4d4a-976c-4fcf2c5c00ab service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:48.038540 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc393a10-ffcc-4d4a-976c-4fcf2c5c00ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:48.038811 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc393a10-ffcc-4d4a-976c-4fcf2c5c00ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:48.040406 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-bc393a10-ffcc-4d4a-976c-4fcf2c5c00ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:48.144730 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc393a10-ffcc-4d4a-976c-4fcf2c5c00ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:55:48.146815 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc393a10-ffcc-4d4a-976c-4fcf2c5c00ab service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:55:48.163903 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 670/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:55:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:55:50.778992 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b4efd-4c1a-479a-94d9-dc063f65845f None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:50.779534 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b4efd-4c1a-479a-94d9-dc063f65845f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:50.779534 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b4efd-4c1a-479a-94d9-dc063f65845f None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:50.781489 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 662/1332] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:55:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:55:50.787309 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289e0ae-1a59-4be4-9d23-01386184ce59 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:50.787763 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289e0ae-1a59-4be4-9d23-01386184ce59 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:50.787872 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289e0ae-1a59-4be4-9d23-01386184ce59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:50.849697 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a289e0ae-1a59-4be4-9d23-01386184ce59 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:55:50.850917 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a289e0ae-1a59-4be4-9d23-01386184ce59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:50.945599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 671/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:55:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:55:50.978418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b4efd-4c1a-479a-94d9-dc063f65845f None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:55:50.979918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-985b4efd-4c1a-479a-94d9-dc063f65845f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:51.122026 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b4efd-4c1a-479a-94d9-dc063f65845f None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:55:51.212627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed253fb7-c89f-4e0f-91d6-6c5e16645898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:55:51.213463 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed253fb7-c89f-4e0f-91d6-6c5e16645898 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:51.213739 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed253fb7-c89f-4e0f-91d6-6c5e16645898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:51.214035 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed253fb7-c89f-4e0f-91d6-6c5e16645898 admin admin] PATH_INFO: `/v3/projects/4bec9401bcfa489d98020b66bccfa487` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:51.223650 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed253fb7-c89f-4e0f-91d6-6c5e16645898 admin admin] RBAC: Authorizing `identity:get_project(project_id=4bec9401bcfa489d98020b66bccfa487)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:55:51.225703 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed253fb7-c89f-4e0f-91d6-6c5e16645898 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:55:51.227436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 663/1334] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Dec 15 02:55:50 2021] GET /identity/v3/projects/4bec9401bcfa489d98020b66bccfa487 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:55:51.239625 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289e0ae-1a59-4be4-9d23-01386184ce59 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:55:51.240794 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a289e0ae-1a59-4be4-9d23-01386184ce59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:51.327674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289e0ae-1a59-4be4-9d23-01386184ce59 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:55:51.396866 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc91f81-58de-479a-b73a-9139799b0020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:55:51.397502 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc91f81-58de-479a-b73a-9139799b0020 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:51.397784 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc91f81-58de-479a-b73a-9139799b0020 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:51.398096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc91f81-58de-479a-b73a-9139799b0020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:51.399695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-1dc91f81-58de-479a-b73a-9139799b0020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:51.504449 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc91f81-58de-479a-b73a-9139799b0020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:55:51.506482 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc91f81-58de-479a-b73a-9139799b0020 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:55:51.523575 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 672/1335] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:55:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:55:54.290930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439726d4-526c-4f31-ba07-1efdffde120e None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:54.291469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439726d4-526c-4f31-ba07-1efdffde120e None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:54.291469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439726d4-526c-4f31-ba07-1efdffde120e None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:54.293244 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 664/1336] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:55:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:55:54.298857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fc5c9-35b2-4f5e-b977-c468a88f025f None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:54.299266 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fc5c9-35b2-4f5e-b977-c468a88f025f None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:54.299415 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fc5c9-35b2-4f5e-b977-c468a88f025f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:54.365412 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-2c2fc5c9-35b2-4f5e-b977-c468a88f025f None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:55:54.366715 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-2c2fc5c9-35b2-4f5e-b977-c468a88f025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:54.460431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 673/1337] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:55:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:55:54.498758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439726d4-526c-4f31-ba07-1efdffde120e None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:55:54.500265 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-439726d4-526c-4f31-ba07-1efdffde120e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:54.597814 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439726d4-526c-4f31-ba07-1efdffde120e None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:55:54.665239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d556a-9d42-476b-b648-6ec6d72d5a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:55:54.665860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d556a-9d42-476b-b648-6ec6d72d5a63 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:54.666171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d556a-9d42-476b-b648-6ec6d72d5a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:54.666443 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d556a-9d42-476b-b648-6ec6d72d5a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:54.668017 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-698d556a-9d42-476b-b648-6ec6d72d5a63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:54.769756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d556a-9d42-476b-b648-6ec6d72d5a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:55:54.771178 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d556a-9d42-476b-b648-6ec6d72d5a63 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:55:54.787947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 665/1338] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:55:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:55:57.169506 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3abc8-a29d-42d6-bb64-6e337100ab10 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:57.170042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3abc8-a29d-42d6-bb64-6e337100ab10 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:57.170138 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3abc8-a29d-42d6-bb64-6e337100ab10 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:57.171923 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 674/1339] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:55:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:55:57.177699 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6599702-fc0b-4c3b-b426-2666095bd92b None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:57.178149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6599702-fc0b-4c3b-b426-2666095bd92b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:57.178283 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6599702-fc0b-4c3b-b426-2666095bd92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:57.240473 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-e6599702-fc0b-4c3b-b426-2666095bd92b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:55:57.241656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e6599702-fc0b-4c3b-b426-2666095bd92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:57.333829 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 666/1340] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:55:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:55:57.374626 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3abc8-a29d-42d6-bb64-6e337100ab10 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:55:57.376158 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-89d3abc8-a29d-42d6-bb64-6e337100ab10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:57.474610 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3abc8-a29d-42d6-bb64-6e337100ab10 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:55:57.543215 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e0a9f-3db3-4d8e-93d6-48b3afa35015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:55:57.543849 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e0a9f-3db3-4d8e-93d6-48b3afa35015 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:55:57.544131 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e0a9f-3db3-4d8e-93d6-48b3afa35015 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:55:57.544407 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e0a9f-3db3-4d8e-93d6-48b3afa35015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:55:57.546037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-410e0a9f-3db3-4d8e-93d6-48b3afa35015 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:55:57.648013 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e0a9f-3db3-4d8e-93d6-48b3afa35015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:55:57.649425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e0a9f-3db3-4d8e-93d6-48b3afa35015 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:55:57.666293 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 675/1341] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:55:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:00.438978 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d146ff9-15b8-4fc7-90e9-86be3655f5b1 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:00.439524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d146ff9-15b8-4fc7-90e9-86be3655f5b1 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:00.439524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d146ff9-15b8-4fc7-90e9-86be3655f5b1 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:00.441271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 667/1342] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:00.447583 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82299c1-fba1-4250-a576-fddbb02bf39b None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:00.447965 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82299c1-fba1-4250-a576-fddbb02bf39b None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:00.448167 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82299c1-fba1-4250-a576-fddbb02bf39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:00.515648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a82299c1-fba1-4250-a576-fddbb02bf39b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:00.516796 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a82299c1-fba1-4250-a576-fddbb02bf39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:00.618063 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 676/1343] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:00.655253 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d146ff9-15b8-4fc7-90e9-86be3655f5b1 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:00.657360 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6d146ff9-15b8-4fc7-90e9-86be3655f5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:00.746318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d146ff9-15b8-4fc7-90e9-86be3655f5b1 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:00.749839 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a41e6e-369e-49a0-91f6-5d6e5c60645c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:00.750496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a41e6e-369e-49a0-91f6-5d6e5c60645c service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:00.750804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a41e6e-369e-49a0-91f6-5d6e5c60645c service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:00.751076 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a41e6e-369e-49a0-91f6-5d6e5c60645c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:00.760423 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a41e6e-369e-49a0-91f6-5d6e5c60645c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:00.761831 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a41e6e-369e-49a0-91f6-5d6e5c60645c service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:00.770934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 668/1344] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:05.084700 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c635a-9675-4ed7-acf9-aba2bb672824 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:05.085360 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c635a-9675-4ed7-acf9-aba2bb672824 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:05.085360 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c635a-9675-4ed7-acf9-aba2bb672824 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:05.087123 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 677/1345] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:05.092930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468580b-6003-437c-a7b4-4474a511d9c0 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:05.093374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468580b-6003-437c-a7b4-4474a511d9c0 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:05.093618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468580b-6003-437c-a7b4-4474a511d9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:05.111479 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-7468580b-6003-437c-a7b4-4474a511d9c0 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:05.112622 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-7468580b-6003-437c-a7b4-4474a511d9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:05.120137 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 669/1346] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:05.159883 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c635a-9675-4ed7-acf9-aba2bb672824 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:05.162163 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-be3c635a-9675-4ed7-acf9-aba2bb672824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:05.174655 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c635a-9675-4ed7-acf9-aba2bb672824 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:05.178116 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295327f5-97b8-4df1-9759-02ac21313c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:05.178775 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295327f5-97b8-4df1-9759-02ac21313c22 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:05.179051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295327f5-97b8-4df1-9759-02ac21313c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:05.179324 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295327f5-97b8-4df1-9759-02ac21313c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:05.188186 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295327f5-97b8-4df1-9759-02ac21313c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:05.189609 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295327f5-97b8-4df1-9759-02ac21313c22 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:05.198712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 678/1347] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:08.168564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b22fa-90cc-44de-852d-d163effa5ce1 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:08.169105 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b22fa-90cc-44de-852d-d163effa5ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:08.169105 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b22fa-90cc-44de-852d-d163effa5ce1 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:08.170910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 670/1348] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:08.176510 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93ccfd-38f4-42fa-aca2-6318a7363271 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:08.176898 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93ccfd-38f4-42fa-aca2-6318a7363271 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:08.177053 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93ccfd-38f4-42fa-aca2-6318a7363271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:08.194441 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-cc93ccfd-38f4-42fa-aca2-6318a7363271 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:08.195607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-cc93ccfd-38f4-42fa-aca2-6318a7363271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:08.208852 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 679/1349] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:08.247929 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b22fa-90cc-44de-852d-d163effa5ce1 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:08.258681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b22fa-90cc-44de-852d-d163effa5ce1 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:08.262133 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e092d11-4641-4aaf-9a62-54512d982475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:08.262759 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092d11-4641-4aaf-9a62-54512d982475 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:08.263037 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092d11-4641-4aaf-9a62-54512d982475 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:08.263310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092d11-4641-4aaf-9a62-54512d982475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:08.272596 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e092d11-4641-4aaf-9a62-54512d982475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:08.274032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e092d11-4641-4aaf-9a62-54512d982475 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:08.283132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 671/1350] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:12.903194 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf491f-8bb7-4cdb-a1cd-c823cec631ee None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:12.903662 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf491f-8bb7-4cdb-a1cd-c823cec631ee None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:12.903740 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf491f-8bb7-4cdb-a1cd-c823cec631ee None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:12.905504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 680/1351] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:12.911162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d73e83-76b1-4abf-a784-019cbddeba1d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:12.911684 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d73e83-76b1-4abf-a784-019cbddeba1d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:12.911764 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d73e83-76b1-4abf-a784-019cbddeba1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:12.930265 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-35d73e83-76b1-4abf-a784-019cbddeba1d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:12.931458 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-35d73e83-76b1-4abf-a784-019cbddeba1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:12.939536 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 672/1352] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:12.978647 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf491f-8bb7-4cdb-a1cd-c823cec631ee None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:12.989476 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf491f-8bb7-4cdb-a1cd-c823cec631ee None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:12.993323 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ee45-43f2-4445-9be0-3ba4ee5ebb56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:12.994087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ee45-43f2-4445-9be0-3ba4ee5ebb56 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:12.994475 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ee45-43f2-4445-9be0-3ba4ee5ebb56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:12.994827 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ee45-43f2-4445-9be0-3ba4ee5ebb56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:13.004601 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62ee45-43f2-4445-9be0-3ba4ee5ebb56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:13.006060 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62ee45-43f2-4445-9be0-3ba4ee5ebb56 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:13.015412 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 681/1353] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:17.914502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ecb1b-068e-453c-9d7e-1c1c05d883ae None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:17.917877 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ecb1b-068e-453c-9d7e-1c1c05d883ae None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:17.918364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ecb1b-068e-453c-9d7e-1c1c05d883ae None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:17.926954 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 673/1354] 10.222.0.18 () {54 vars in 921 bytes} [Wed Dec 15 02:56:17 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:17.929956 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d989476-9856-46e7-8b70-7ad0c8208ce3 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:17.930831 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d989476-9856-46e7-8b70-7ad0c8208ce3 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:17.931435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d989476-9856-46e7-8b70-7ad0c8208ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:18.053582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-4d989476-9856-46e7-8b70-7ad0c8208ce3 None None] MFA Rules not processed for user `93762c21f03d44d5bf3881d17e14ef90`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:18.055041 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4d989476-9856-46e7-8b70-7ad0c8208ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:18.148989 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 682/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Dec 15 02:56:17 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:22.394724 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa92f1-cbc3-4371-ba72-14df1c6212da None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:22.395237 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa92f1-cbc3-4371-ba72-14df1c6212da None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:22.395318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa92f1-cbc3-4371-ba72-14df1c6212da None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:22.397235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 674/1356] 10.222.0.18 () {54 vars in 921 bytes} [Wed Dec 15 02:56:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:22.402314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422ef90-b4db-4b8b-be47-cf9d53a3691c None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:22.403094 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422ef90-b4db-4b8b-be47-cf9d53a3691c None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:22.403571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422ef90-b4db-4b8b-be47-cf9d53a3691c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:22.423393 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-2422ef90-b4db-4b8b-be47-cf9d53a3691c None None] MFA Rules not processed for user `93762c21f03d44d5bf3881d17e14ef90`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:22.425830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-2422ef90-b4db-4b8b-be47-cf9d53a3691c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:22.435455 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 683/1357] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Dec 15 02:56:22 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:23.799812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5e2a4-4607-4737-8875-867bb97a54e7 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:23.800343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5e2a4-4607-4737-8875-867bb97a54e7 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:23.800434 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5e2a4-4607-4737-8875-867bb97a54e7 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:23.802441 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 675/1358] 10.222.0.18 () {54 vars in 921 bytes} [Wed Dec 15 02:56:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:23.807363 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52570c2c-45b8-47dc-b9ef-89807007afd2 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:23.807742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52570c2c-45b8-47dc-b9ef-89807007afd2 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:23.807914 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52570c2c-45b8-47dc-b9ef-89807007afd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:23.825291 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-52570c2c-45b8-47dc-b9ef-89807007afd2 None None] MFA Rules not processed for user `93762c21f03d44d5bf3881d17e14ef90`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:23.826689 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-52570c2c-45b8-47dc-b9ef-89807007afd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:23.835712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 684/1359] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Dec 15 02:56:23 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:27.679647 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819fa6e-f50b-4dac-a8c7-afa73178e3d8 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:27.680172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819fa6e-f50b-4dac-a8c7-afa73178e3d8 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:27.680172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819fa6e-f50b-4dac-a8c7-afa73178e3d8 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:27.682141 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 676/1360] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:27.687835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878bf1e-5141-484d-8962-68b03345351c None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:27.688275 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878bf1e-5141-484d-8962-68b03345351c None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:27.688377 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878bf1e-5141-484d-8962-68b03345351c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:27.710183 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-c878bf1e-5141-484d-8962-68b03345351c None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:27.711778 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c878bf1e-5141-484d-8962-68b03345351c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:27.719853 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 685/1361] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:27.770181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44999137-7e24-408e-b77b-3c9f46e62e73 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:27.770589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44999137-7e24-408e-b77b-3c9f46e62e73 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:27.770930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44999137-7e24-408e-b77b-3c9f46e62e73 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:27.772919 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 677/1362] 10.222.0.18 () {54 vars in 961 bytes} [Wed Dec 15 02:56:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:27.778823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610fd98-86d0-4c7a-ade7-ccbd3501ee75 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:27.779178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610fd98-86d0-4c7a-ade7-ccbd3501ee75 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:27.779525 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610fd98-86d0-4c7a-ade7-ccbd3501ee75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:27.829151 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-7610fd98-86d0-4c7a-ade7-ccbd3501ee75 None None] MFA Rules not processed for user `fcd50adcd390465ea6fc8582e1524909`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:27.830695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7610fd98-86d0-4c7a-ade7-ccbd3501ee75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:27.914689 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 686/1363] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Dec 15 02:56:27 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:56:27.923015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44999137-7e24-408e-b77b-3c9f46e62e73 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:27.937570 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44999137-7e24-408e-b77b-3c9f46e62e73 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:27.943966 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cea62-de8d-4a8f-867c-b054be2df1f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:27.944696 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cea62-de8d-4a8f-867c-b054be2df1f8 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:27.945037 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cea62-de8d-4a8f-867c-b054be2df1f8 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:27.945373 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cea62-de8d-4a8f-867c-b054be2df1f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:27.954519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cea62-de8d-4a8f-867c-b054be2df1f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:27.956828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cea62-de8d-4a8f-867c-b054be2df1f8 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:27.967867 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 678/1364] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:30.543044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea716c8b-9523-42b1-9d25-6a231c2d7c25 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:30.543578 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea716c8b-9523-42b1-9d25-6a231c2d7c25 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:30.543578 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea716c8b-9523-42b1-9d25-6a231c2d7c25 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:30.545332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 687/1365] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:30.551393 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2398e-a2c1-48ce-bfde-dc35fd5e3480 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:30.551924 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2398e-a2c1-48ce-bfde-dc35fd5e3480 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:30.551924 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2398e-a2c1-48ce-bfde-dc35fd5e3480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:30.569804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c5e2398e-a2c1-48ce-bfde-dc35fd5e3480 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:30.570990 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c5e2398e-a2c1-48ce-bfde-dc35fd5e3480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:30.578891 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 679/1366] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:56:30.625531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea716c8b-9523-42b1-9d25-6a231c2d7c25 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:30.641197 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea716c8b-9523-42b1-9d25-6a231c2d7c25 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:30.648493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912e9e3-83c2-4b6e-852b-ff7eb981eacb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:30.649264 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912e9e3-83c2-4b6e-852b-ff7eb981eacb service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:30.649527 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912e9e3-83c2-4b6e-852b-ff7eb981eacb service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:30.649803 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912e9e3-83c2-4b6e-852b-ff7eb981eacb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:30.660213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912e9e3-83c2-4b6e-852b-ff7eb981eacb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:30.661922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912e9e3-83c2-4b6e-852b-ff7eb981eacb service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:30.672187 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 688/1367] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:33.290571 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22f6bd-8267-4c6f-881c-434f654a7eec None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:33.291128 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22f6bd-8267-4c6f-881c-434f654a7eec None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:33.291128 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22f6bd-8267-4c6f-881c-434f654a7eec None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:33.292903 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 680/1368] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:33.298982 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6336b-5010-4dea-888e-369d74ecf267 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:33.299441 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6336b-5010-4dea-888e-369d74ecf267 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:33.299535 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6336b-5010-4dea-888e-369d74ecf267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:33.319203 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-6dd6336b-5010-4dea-888e-369d74ecf267 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:33.320532 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6dd6336b-5010-4dea-888e-369d74ecf267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:33.329084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 689/1369] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:33.376881 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbe910-6eac-418d-bdf1-281003094270 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:33.377290 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbe910-6eac-418d-bdf1-281003094270 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:33.377656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbe910-6eac-418d-bdf1-281003094270 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:33.380564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 681/1370] 10.222.0.18 () {54 vars in 961 bytes} [Wed Dec 15 02:56:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:33.386369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1cbc0-10b3-4b14-bd48-9ce7fb814e23 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:33.386654 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1cbc0-10b3-4b14-bd48-9ce7fb814e23 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:33.386925 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1cbc0-10b3-4b14-bd48-9ce7fb814e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:33.407568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a6e1cbc0-10b3-4b14-bd48-9ce7fb814e23 None None] MFA Rules not processed for user `fcd50adcd390465ea6fc8582e1524909`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:33.409118 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a6e1cbc0-10b3-4b14-bd48-9ce7fb814e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:33.418858 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 690/1371] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Dec 15 02:56:33 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:33.429690 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbe910-6eac-418d-bdf1-281003094270 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:33.451637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbe910-6eac-418d-bdf1-281003094270 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:33.457298 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f46369-ab9e-420f-8dfc-e0a332caee08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:33.457933 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f46369-ab9e-420f-8dfc-e0a332caee08 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:33.458410 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f46369-ab9e-420f-8dfc-e0a332caee08 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:33.458861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f46369-ab9e-420f-8dfc-e0a332caee08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:33.468919 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f46369-ab9e-420f-8dfc-e0a332caee08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:33.470488 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f46369-ab9e-420f-8dfc-e0a332caee08 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:33.480431 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 682/1372] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:35.680860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519548d0-abcd-4504-8a28-617f534b61ba None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:35.681448 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519548d0-abcd-4504-8a28-617f534b61ba None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:35.681448 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519548d0-abcd-4504-8a28-617f534b61ba None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:35.683437 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 691/1373] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:35.689577 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f9aca-3d28-48fb-a458-bb86c0a6fe21 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:35.690051 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f9aca-3d28-48fb-a458-bb86c0a6fe21 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:35.690218 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f9aca-3d28-48fb-a458-bb86c0a6fe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:35.709057 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-a45f9aca-3d28-48fb-a458-bb86c0a6fe21 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:35.710257 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-a45f9aca-3d28-48fb-a458-bb86c0a6fe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:35.718883 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 683/1374] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:35.772994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad044a-ba3a-4f6c-b982-e9dffee51f67 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:35.773274 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad044a-ba3a-4f6c-b982-e9dffee51f67 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:35.773742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad044a-ba3a-4f6c-b982-e9dffee51f67 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:35.775744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 692/1375] 10.222.0.18 () {54 vars in 963 bytes} [Wed Dec 15 02:56:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:35.781250 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ae796-9839-4107-890e-de1b01b3d235 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:35.781606 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ae796-9839-4107-890e-de1b01b3d235 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:35.782011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ae796-9839-4107-890e-de1b01b3d235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:35.829326 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-da6ae796-9839-4107-890e-de1b01b3d235 None None] MFA Rules not processed for user `d543ba91ee284c1384f15fb70910caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:35.830625 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-da6ae796-9839-4107-890e-de1b01b3d235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:35.887325 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 684/1376] 10.222.0.18 () {58 vars in 1060 bytes} [Wed Dec 15 02:56:35 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:35.895175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad044a-ba3a-4f6c-b982-e9dffee51f67 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:35.905433 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad044a-ba3a-4f6c-b982-e9dffee51f67 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:35.909038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c05f1-3d93-4c79-b778-70a96d03cda7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:35.909769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c05f1-3d93-4c79-b778-70a96d03cda7 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:35.910192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c05f1-3d93-4c79-b778-70a96d03cda7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:35.910562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c05f1-3d93-4c79-b778-70a96d03cda7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:35.918083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13758a46-8a37-4906-b01e-8a2db6c405c1 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:35.918482 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13758a46-8a37-4906-b01e-8a2db6c405c1 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:35.918858 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13758a46-8a37-4906-b01e-8a2db6c405c1 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:35.920739 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 685/1377] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:56:35.922282 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c05f1-3d93-4c79-b778-70a96d03cda7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:35.925224 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c05f1-3d93-4c79-b778-70a96d03cda7 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:35.927057 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf122fe0-a27c-471d-9421-819faecc0b37 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:35.927341 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf122fe0-a27c-471d-9421-819faecc0b37 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:35.927612 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf122fe0-a27c-471d-9421-819faecc0b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:35.938041 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 693/1378] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:35.949618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-bf122fe0-a27c-471d-9421-819faecc0b37 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:35.951096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-bf122fe0-a27c-471d-9421-819faecc0b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:35.959190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 686/1379] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:56:36.005944 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c05f1-3d93-4c79-b778-70a96d03cda7 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:36.018099 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c05f1-3d93-4c79-b778-70a96d03cda7 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:36.024036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba6538-900a-4ce4-90dd-1afc1f01f1f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:36.024803 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba6538-900a-4ce4-90dd-1afc1f01f1f6 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:36.025285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba6538-900a-4ce4-90dd-1afc1f01f1f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:36.025671 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba6538-900a-4ce4-90dd-1afc1f01f1f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:36.034042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba6538-900a-4ce4-90dd-1afc1f01f1f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:36.035738 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba6538-900a-4ce4-90dd-1afc1f01f1f6 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:36.045276 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 694/1380] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:38.443082 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fb6bd-3f29-4597-abce-c696311aea95 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:38.443934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fb6bd-3f29-4597-abce-c696311aea95 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:38.444377 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fb6bd-3f29-4597-abce-c696311aea95 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:38.446361 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 687/1381] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:38.452683 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f707e-24f6-4fc4-b6b1-2db0f2e1003b None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:38.453471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f707e-24f6-4fc4-b6b1-2db0f2e1003b None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:38.453944 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f707e-24f6-4fc4-b6b1-2db0f2e1003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:38.477357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-124f707e-24f6-4fc4-b6b1-2db0f2e1003b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:38.478792 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-124f707e-24f6-4fc4-b6b1-2db0f2e1003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:38.486501 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 695/1382] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:38.532099 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fb6bd-3f29-4597-abce-c696311aea95 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:38.546339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fb6bd-3f29-4597-abce-c696311aea95 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:38.552114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcb67a-faf9-45b2-a292-8967a095cc57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:38.552725 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcb67a-faf9-45b2-a292-8967a095cc57 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:38.553001 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcb67a-faf9-45b2-a292-8967a095cc57 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:38.553271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcb67a-faf9-45b2-a292-8967a095cc57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:38.560978 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcb67a-faf9-45b2-a292-8967a095cc57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:38.562571 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcb67a-faf9-45b2-a292-8967a095cc57 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:38.571444 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 688/1383] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:40.938557 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96916619-083c-4fd7-bd9a-77eed4bf1543 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:40.939091 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96916619-083c-4fd7-bd9a-77eed4bf1543 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:40.939091 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96916619-083c-4fd7-bd9a-77eed4bf1543 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:40.941348 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 696/1384] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:40.947211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7caa-6c6c-4187-a284-974912b64927 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:40.947612 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7caa-6c6c-4187-a284-974912b64927 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:40.947742 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7caa-6c6c-4187-a284-974912b64927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:40.965242 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-613e7caa-6c6c-4187-a284-974912b64927 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:40.966563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-613e7caa-6c6c-4187-a284-974912b64927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:40.974427 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 689/1385] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:41.020854 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96916619-083c-4fd7-bd9a-77eed4bf1543 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:41.035126 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96916619-083c-4fd7-bd9a-77eed4bf1543 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:41.040717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd16a5-1da7-4e65-8d4b-39e5a88b8b73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:41.041459 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd16a5-1da7-4e65-8d4b-39e5a88b8b73 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:41.041828 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd16a5-1da7-4e65-8d4b-39e5a88b8b73 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:41.042245 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd16a5-1da7-4e65-8d4b-39e5a88b8b73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:41.050958 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd16a5-1da7-4e65-8d4b-39e5a88b8b73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:41.052622 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd16a5-1da7-4e65-8d4b-39e5a88b8b73 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:41.062153 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 697/1386] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:43.544250 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecb6f1-5174-4c67-a2af-5df0722907a5 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:43.544810 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecb6f1-5174-4c67-a2af-5df0722907a5 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:43.544955 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecb6f1-5174-4c67-a2af-5df0722907a5 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:43.547301 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 690/1387] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:43.554710 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea2edd-eb48-49f6-bba8-6570f4588fdf None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:43.555120 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea2edd-eb48-49f6-bba8-6570f4588fdf None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:43.555272 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea2edd-eb48-49f6-bba8-6570f4588fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:43.573178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-4fea2edd-eb48-49f6-bba8-6570f4588fdf None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:43.574387 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4fea2edd-eb48-49f6-bba8-6570f4588fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:43.582249 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 698/1388] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:56:43.635223 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecb6f1-5174-4c67-a2af-5df0722907a5 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:43.653665 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecb6f1-5174-4c67-a2af-5df0722907a5 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:43.660471 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8389b92-0a6a-4952-ad02-9a915234be2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:43.661123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8389b92-0a6a-4952-ad02-9a915234be2d service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:43.661422 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8389b92-0a6a-4952-ad02-9a915234be2d service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:43.661716 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8389b92-0a6a-4952-ad02-9a915234be2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:43.673862 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8389b92-0a6a-4952-ad02-9a915234be2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:43.676144 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8389b92-0a6a-4952-ad02-9a915234be2d service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:43.686331 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 691/1389] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:46.642039 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8f237-711e-460b-b8b9-f72224884359 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:46.642605 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8f237-711e-460b-b8b9-f72224884359 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:46.642605 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8f237-711e-460b-b8b9-f72224884359 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:46.644988 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 699/1390] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:46.652171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48669ed0-ab2c-4e93-b38b-f2ea06251f68 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:46.652587 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48669ed0-ab2c-4e93-b38b-f2ea06251f68 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:46.652875 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48669ed0-ab2c-4e93-b38b-f2ea06251f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:46.671107 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-48669ed0-ab2c-4e93-b38b-f2ea06251f68 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:46.672344 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-48669ed0-ab2c-4e93-b38b-f2ea06251f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:46.680072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 692/1391] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:56:46.728078 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8f237-711e-460b-b8b9-f72224884359 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:46.744800 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8f237-711e-460b-b8b9-f72224884359 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:46.751693 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37efa34-fb50-4118-814d-e98750e0e578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:46.753356 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37efa34-fb50-4118-814d-e98750e0e578 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:46.753709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37efa34-fb50-4118-814d-e98750e0e578 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:46.754088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37efa34-fb50-4118-814d-e98750e0e578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:46.763954 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37efa34-fb50-4118-814d-e98750e0e578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:46.765952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37efa34-fb50-4118-814d-e98750e0e578 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:46.778404 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 700/1392] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:49.124947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f0365-bbfc-4ccb-8876-8967a4e06168 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:49.125624 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f0365-bbfc-4ccb-8876-8967a4e06168 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:49.125624 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f0365-bbfc-4ccb-8876-8967a4e06168 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:49.128082 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 693/1393] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:49.133695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db77f8-ccac-4ce8-b9f3-ec05cd6fb9a0 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:49.134164 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db77f8-ccac-4ce8-b9f3-ec05cd6fb9a0 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:49.134270 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db77f8-ccac-4ce8-b9f3-ec05cd6fb9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:49.152427 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-54db77f8-ccac-4ce8-b9f3-ec05cd6fb9a0 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:49.153651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-54db77f8-ccac-4ce8-b9f3-ec05cd6fb9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:49.162020 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 701/1394] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:49.208038 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f0365-bbfc-4ccb-8876-8967a4e06168 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:49.221951 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f0365-bbfc-4ccb-8876-8967a4e06168 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:49.227215 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18bd99-5344-4596-88cf-2acec441e46b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:49.227826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18bd99-5344-4596-88cf-2acec441e46b service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:49.228100 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18bd99-5344-4596-88cf-2acec441e46b service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:49.228369 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18bd99-5344-4596-88cf-2acec441e46b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:49.236060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18bd99-5344-4596-88cf-2acec441e46b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:49.238184 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18bd99-5344-4596-88cf-2acec441e46b service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:49.247288 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 694/1395] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:50.891490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137185c-7b25-4138-b8e8-c7b861a87962 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:50.892091 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137185c-7b25-4138-b8e8-c7b861a87962 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:50.892091 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137185c-7b25-4138-b8e8-c7b861a87962 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:50.894386 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 702/1396] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:50.900241 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ddc2c-f00d-459f-96ea-dc33d4c9622d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:50.900684 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ddc2c-f00d-459f-96ea-dc33d4c9622d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:50.900812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ddc2c-f00d-459f-96ea-dc33d4c9622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:50.918680 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-165ddc2c-f00d-459f-96ea-dc33d4c9622d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:50.919844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-165ddc2c-f00d-459f-96ea-dc33d4c9622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:50.927465 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 695/1397] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:50.983653 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2f1fb-cacc-408c-bb77-97d81200b142 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:50.984013 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2f1fb-cacc-408c-bb77-97d81200b142 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:50.984374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2f1fb-cacc-408c-bb77-97d81200b142 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:50.986239 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 703/1398] 10.222.0.18 () {54 vars in 962 bytes} [Wed Dec 15 02:56:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:50.991804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679a9cd-c4f5-4a5d-9e8a-3566271b1e7e None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:50.992113 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679a9cd-c4f5-4a5d-9e8a-3566271b1e7e None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:50.992575 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679a9cd-c4f5-4a5d-9e8a-3566271b1e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:51.039406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-2679a9cd-c4f5-4a5d-9e8a-3566271b1e7e None None] MFA Rules not processed for user `e48dcc22c7df4aed8fa6cf32e3c2ec51`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:51.040580 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-2679a9cd-c4f5-4a5d-9e8a-3566271b1e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:51.096969 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 696/1399] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Dec 15 02:56:50 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:51.104924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2f1fb-cacc-408c-bb77-97d81200b142 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:51.114979 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2f1fb-cacc-408c-bb77-97d81200b142 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:51.118390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab718ea-48f7-4527-9607-bce6562c9543 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48dcc22c7df4aed8fa6cf32e3c2ec51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:51.119007 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab718ea-48f7-4527-9607-bce6562c9543 service glance] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:51.119283 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab718ea-48f7-4527-9607-bce6562c9543 service glance] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:51.119554 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab718ea-48f7-4527-9607-bce6562c9543 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:51.128814 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab718ea-48f7-4527-9607-bce6562c9543 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:51.130238 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab718ea-48f7-4527-9607-bce6562c9543 service glance] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:51.139240 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 704/1400] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:51.574503 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e2683-cd2c-4814-853b-98138c97fc14 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:51.574853 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e2683-cd2c-4814-853b-98138c97fc14 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:51.575204 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e2683-cd2c-4814-853b-98138c97fc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:51.595115 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d41988-81ca-41a4-a514-277bac2a422e None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:51.595404 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d41988-81ca-41a4-a514-277bac2a422e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:51.595713 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d41988-81ca-41a4-a514-277bac2a422e None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:51.597539 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 705/1401] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:56:51.603598 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfc857-9cde-4d6e-9d11-ade551a40da7 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:51.603871 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfc857-9cde-4d6e-9d11-ade551a40da7 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:51.604149 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfc857-9cde-4d6e-9d11-ade551a40da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:51.621768 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-14bfc857-9cde-4d6e-9d11-ade551a40da7 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:51.622880 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-cb8e2683-cd2c-4814-853b-98138c97fc14 None None] MFA Rules not processed for user `39cddc4e2ea943cd882b6a1addd98e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:51.623038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-14bfc857-9cde-4d6e-9d11-ade551a40da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:51.624034 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-cb8e2683-cd2c-4814-853b-98138c97fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:51.631761 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 706/1402] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:56:51.676887 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfc857-9cde-4d6e-9d11-ade551a40da7 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:51.684796 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 697/1403] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Dec 15 02:56:51 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:51.688421 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfc857-9cde-4d6e-9d11-ade551a40da7 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:51.694310 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd09b4-45cf-4ed9-8987-e70edcb0e8ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:51.695279 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd09b4-45cf-4ed9-8987-e70edcb0e8ea service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:51.695279 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd09b4-45cf-4ed9-8987-e70edcb0e8ea service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:51.695779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd09b4-45cf-4ed9-8987-e70edcb0e8ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:51.704620 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd09b4-45cf-4ed9-8987-e70edcb0e8ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:51.706024 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd09b4-45cf-4ed9-8987-e70edcb0e8ea service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:51.715747 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 707/1404] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 02:56:51.730989 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abac36-37b6-45fc-9330-9ed969e7f91e None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:51.731264 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abac36-37b6-45fc-9330-9ed969e7f91e None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:51.731533 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abac36-37b6-45fc-9330-9ed969e7f91e None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:51.733338 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 698/1405] 10.222.0.18 () {54 vars in 942 bytes} [Wed Dec 15 02:56:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:51.742200 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403151a-1662-42eb-9498-bce683f109cd None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:51.742200 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403151a-1662-42eb-9498-bce683f109cd None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:51.742200 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403151a-1662-42eb-9498-bce683f109cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:51.798249 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-9403151a-1662-42eb-9498-bce683f109cd None None] MFA Rules not processed for user `beb0af7ac70d48989852c022c9f83848`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:51.799544 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-9403151a-1662-42eb-9498-bce683f109cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:51.874856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 708/1406] 10.222.0.18 () {58 vars in 1039 bytes} [Wed Dec 15 02:56:51 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:51.885502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abac36-37b6-45fc-9330-9ed969e7f91e None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:51.899632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abac36-37b6-45fc-9330-9ed969e7f91e None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:51.904811 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3dc46b-5491-4198-98dd-c9739c6f65c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb0af7ac70d48989852c022c9f83848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:51.905529 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dc46b-5491-4198-98dd-c9739c6f65c9 service swift] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:51.905731 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dc46b-5491-4198-98dd-c9739c6f65c9 service swift] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:51.906017 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dc46b-5491-4198-98dd-c9739c6f65c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:51.915019 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3dc46b-5491-4198-98dd-c9739c6f65c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:51.916628 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3dc46b-5491-4198-98dd-c9739c6f65c9 service swift] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:51.925317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 699/1407] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Dec 15 02:56:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 02:56:54.108090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27437e-2d0c-44d5-af1d-c2308dea83e7 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:54.108090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27437e-2d0c-44d5-af1d-c2308dea83e7 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:54.109018 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27437e-2d0c-44d5-af1d-c2308dea83e7 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:54.120072 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 709/1408] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:54.120385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c09b-6072-49b2-80ba-3dd65d5adbd6 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:54.120385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c09b-6072-49b2-80ba-3dd65d5adbd6 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:54.120385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c09b-6072-49b2-80ba-3dd65d5adbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:54.138163 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-0ac3c09b-6072-49b2-80ba-3dd65d5adbd6 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:54.139745 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0ac3c09b-6072-49b2-80ba-3dd65d5adbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:54.162623 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 700/1409] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:54.211255 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27437e-2d0c-44d5-af1d-c2308dea83e7 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:54.238180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27437e-2d0c-44d5-af1d-c2308dea83e7 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:54.246161 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d3785-88ad-45ae-ba0f-aaf0bd0cd219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:54.247033 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d3785-88ad-45ae-ba0f-aaf0bd0cd219 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:54.247318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d3785-88ad-45ae-ba0f-aaf0bd0cd219 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:54.247592 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d3785-88ad-45ae-ba0f-aaf0bd0cd219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:54.257239 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d3785-88ad-45ae-ba0f-aaf0bd0cd219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:54.258840 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d3785-88ad-45ae-ba0f-aaf0bd0cd219 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:54.269298 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 710/1410] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:56:56.665579 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c7327-d386-4aa0-a1ce-6d81fd6f119b None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:56.666176 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c7327-d386-4aa0-a1ce-6d81fd6f119b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:56.666176 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c7327-d386-4aa0-a1ce-6d81fd6f119b None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:56.667971 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 701/1411] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:56:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:56:56.674590 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb48bd-c33d-4823-9f1a-b59b485901bb None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:56.675053 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb48bd-c33d-4823-9f1a-b59b485901bb None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:56.675137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb48bd-c33d-4823-9f1a-b59b485901bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:56.693570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-fdfb48bd-c33d-4823-9f1a-b59b485901bb None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:56:56.694781 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-fdfb48bd-c33d-4823-9f1a-b59b485901bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:56:56.704696 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 711/1412] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:56:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:56:56.750906 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c7327-d386-4aa0-a1ce-6d81fd6f119b None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:56:56.766043 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c7327-d386-4aa0-a1ce-6d81fd6f119b None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:56:56.771567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf519d0-c30c-4d19-8a4d-c36fcc5ec8f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:56:56.772204 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf519d0-c30c-4d19-8a4d-c36fcc5ec8f6 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:56:56.772476 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf519d0-c30c-4d19-8a4d-c36fcc5ec8f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:56:56.772756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf519d0-c30c-4d19-8a4d-c36fcc5ec8f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:56:56.781208 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf519d0-c30c-4d19-8a4d-c36fcc5ec8f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:56:56.782812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf519d0-c30c-4d19-8a4d-c36fcc5ec8f6 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:56:56.792134 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 702/1413] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:56:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:14.703904 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942210c-9af2-4099-9d43-67831bf38012 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:14.704525 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942210c-9af2-4099-9d43-67831bf38012 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:14.704525 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942210c-9af2-4099-9d43-67831bf38012 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:14.706303 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 712/1414] 10.222.0.18 () {54 vars in 918 bytes} [Wed Dec 15 02:57:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:14.711986 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438544b-9037-4a0c-81f8-07676daba5ff None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:14.712428 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438544b-9037-4a0c-81f8-07676daba5ff None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:14.712614 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438544b-9037-4a0c-81f8-07676daba5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:14.729783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-1438544b-9037-4a0c-81f8-07676daba5ff None None] MFA Rules not processed for user `93762c21f03d44d5bf3881d17e14ef90`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:14.730970 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1438544b-9037-4a0c-81f8-07676daba5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:14.739857 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 703/1415] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Dec 15 02:57:14 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:57:14.755196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec9a2-0879-4887-bc31-15f752cc8f3a None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:14.755488 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec9a2-0879-4887-bc31-15f752cc8f3a None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:14.755770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec9a2-0879-4887-bc31-15f752cc8f3a None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:14.757540 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 713/1416] 10.222.0.18 () {54 vars in 918 bytes} [Wed Dec 15 02:57:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:14.762625 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30358f4b-a8af-48cd-9d41-8cd34361de9b None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:14.762919 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30358f4b-a8af-48cd-9d41-8cd34361de9b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:14.763198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30358f4b-a8af-48cd-9d41-8cd34361de9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:14.780292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-30358f4b-a8af-48cd-9d41-8cd34361de9b None None] MFA Rules not processed for user `fcd50adcd390465ea6fc8582e1524909`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:14.781445 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-30358f4b-a8af-48cd-9d41-8cd34361de9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:14.790223 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 704/1417] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Dec 15 02:57:14 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:57:17.534983 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea5cb-4a93-494d-a66a-383f3d2e90b5 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:17.535509 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea5cb-4a93-494d-a66a-383f3d2e90b5 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:17.535509 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea5cb-4a93-494d-a66a-383f3d2e90b5 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:17.537196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 714/1418] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 02:57:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:57:17.543235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27327740-3386-4872-900b-ca1506180cfc None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:17.543655 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27327740-3386-4872-900b-ca1506180cfc None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:17.543783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27327740-3386-4872-900b-ca1506180cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:17.561726 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-27327740-3386-4872-900b-ca1506180cfc None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:17.562934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-27327740-3386-4872-900b-ca1506180cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:17.570468 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 705/1419] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 02:57:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:57:17.614754 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dea5cb-4a93-494d-a66a-383f3d2e90b5 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:17.629049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dea5cb-4a93-494d-a66a-383f3d2e90b5 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:17.634511 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08708d-3228-4137-92af-e213ba1cfb98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:17.635135 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08708d-3228-4137-92af-e213ba1cfb98 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:17.635418 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08708d-3228-4137-92af-e213ba1cfb98 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:17.635695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08708d-3228-4137-92af-e213ba1cfb98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:17.643773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08708d-3228-4137-92af-e213ba1cfb98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:17.645347 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08708d-3228-4137-92af-e213ba1cfb98 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:17.654568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 715/1420] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:19.206013 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bac1d-f643-4d35-affb-f7f96574c54c None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:19.206573 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bac1d-f643-4d35-affb-f7f96574c54c None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:19.206573 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bac1d-f643-4d35-affb-f7f96574c54c None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:19.208355 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 706/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 02:57:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:19.213847 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2c240-91f3-4652-975e-3be4266a1ea8 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:19.214270 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2c240-91f3-4652-975e-3be4266a1ea8 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:19.214422 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2c240-91f3-4652-975e-3be4266a1ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:19.231789 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-e3d2c240-91f3-4652-975e-3be4266a1ea8 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:19.233031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e3d2c240-91f3-4652-975e-3be4266a1ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:19.241172 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 716/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 02:57:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:57:19.392894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bac1d-f643-4d35-affb-f7f96574c54c None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:19.406524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bac1d-f643-4d35-affb-f7f96574c54c None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:19.411743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fc14a-4e40-4d9c-8d1e-e9f2f8fedd27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:19.412382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fc14a-4e40-4d9c-8d1e-e9f2f8fedd27 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:19.412656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fc14a-4e40-4d9c-8d1e-e9f2f8fedd27 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:19.412925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fc14a-4e40-4d9c-8d1e-e9f2f8fedd27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:19.420572 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fc14a-4e40-4d9c-8d1e-e9f2f8fedd27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:19.422171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fc14a-4e40-4d9c-8d1e-e9f2f8fedd27 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:19.431516 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 707/1423] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:20.953141 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9751337-fc3e-48da-a95c-53bdb5a9dcb3 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:20.953717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9751337-fc3e-48da-a95c-53bdb5a9dcb3 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:20.953717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9751337-fc3e-48da-a95c-53bdb5a9dcb3 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:20.956034 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 717/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 02:57:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:20.961560 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eadfd4-a258-43bd-8ee2-117e93906f7f None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:20.961973 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eadfd4-a258-43bd-8ee2-117e93906f7f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:20.962150 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eadfd4-a258-43bd-8ee2-117e93906f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:20.980072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-f2eadfd4-a258-43bd-8ee2-117e93906f7f None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:20.981239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f2eadfd4-a258-43bd-8ee2-117e93906f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:20.988780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 708/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 02:57:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:57:21.139043 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9751337-fc3e-48da-a95c-53bdb5a9dcb3 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:21.153431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9751337-fc3e-48da-a95c-53bdb5a9dcb3 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:21.158800 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1799ce6-e607-4808-b4da-6fea9a941676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:21.159424 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1799ce6-e607-4808-b4da-6fea9a941676 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:21.159704 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1799ce6-e607-4808-b4da-6fea9a941676 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:21.159978 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1799ce6-e607-4808-b4da-6fea9a941676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:21.167843 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1799ce6-e607-4808-b4da-6fea9a941676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:21.169403 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1799ce6-e607-4808-b4da-6fea9a941676 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:21.178336 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 718/1426] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 02:57:22.684072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92911fca-4af9-49dd-b040-be7544d4e4ea None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:22.684639 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92911fca-4af9-49dd-b040-be7544d4e4ea None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:22.684639 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92911fca-4af9-49dd-b040-be7544d4e4ea None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:22.686429 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 709/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 02:57:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:22.691825 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c588e-1d87-449d-9a98-0ca61f4f6a4d None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:22.692272 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c588e-1d87-449d-9a98-0ca61f4f6a4d None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:22.692386 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c588e-1d87-449d-9a98-0ca61f4f6a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:22.710059 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-f34c588e-1d87-449d-9a98-0ca61f4f6a4d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:22.711247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f34c588e-1d87-449d-9a98-0ca61f4f6a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:22.718870 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 719/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 02:57:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:57:22.870390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92911fca-4af9-49dd-b040-be7544d4e4ea None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:22.885143 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92911fca-4af9-49dd-b040-be7544d4e4ea None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:22.890493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3275f-26c0-449e-8006-a97996d781d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:22.891115 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3275f-26c0-449e-8006-a97996d781d3 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:22.891397 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3275f-26c0-449e-8006-a97996d781d3 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:22.891672 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3275f-26c0-449e-8006-a97996d781d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:22.900342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3275f-26c0-449e-8006-a97996d781d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:22.901910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3275f-26c0-449e-8006-a97996d781d3 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:22.911032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 710/1429] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:24.425239 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d64ff-8222-494f-a62f-253fe1555c95 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:24.425733 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d64ff-8222-494f-a62f-253fe1555c95 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:24.425837 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d64ff-8222-494f-a62f-253fe1555c95 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:24.427587 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 720/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 02:57:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:24.433068 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577feb61-645e-4fd0-bc00-cd88fcf29edf None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:24.433489 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577feb61-645e-4fd0-bc00-cd88fcf29edf None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:24.433619 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577feb61-645e-4fd0-bc00-cd88fcf29edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:24.451437 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-577feb61-645e-4fd0-bc00-cd88fcf29edf None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:24.452592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-577feb61-645e-4fd0-bc00-cd88fcf29edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:24.460182 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 711/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 02:57:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:57:24.609956 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d64ff-8222-494f-a62f-253fe1555c95 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:24.624331 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d64ff-8222-494f-a62f-253fe1555c95 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:24.630551 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea48db-ac14-4b5d-adff-d0025c7e21b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:24.631175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea48db-ac14-4b5d-adff-d0025c7e21b0 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:24.631456 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea48db-ac14-4b5d-adff-d0025c7e21b0 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:24.631728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea48db-ac14-4b5d-adff-d0025c7e21b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:24.639864 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea48db-ac14-4b5d-adff-d0025c7e21b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:24.641413 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea48db-ac14-4b5d-adff-d0025c7e21b0 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:24.650400 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 721/1432] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:26.099056 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd934e2e-633c-488e-ac97-78dc596b38c1 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:26.099600 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd934e2e-633c-488e-ac97-78dc596b38c1 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:26.099600 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd934e2e-633c-488e-ac97-78dc596b38c1 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:26.101362 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 712/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 02:57:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:26.106838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac6b7c-6cbe-4975-9abc-3e83adef2d57 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:26.107263 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac6b7c-6cbe-4975-9abc-3e83adef2d57 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:26.107385 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac6b7c-6cbe-4975-9abc-3e83adef2d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:26.125561 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-57ac6b7c-6cbe-4975-9abc-3e83adef2d57 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:26.126781 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-57ac6b7c-6cbe-4975-9abc-3e83adef2d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:26.134636 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 722/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 02:57:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:57:26.285457 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd934e2e-633c-488e-ac97-78dc596b38c1 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:26.299113 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd934e2e-633c-488e-ac97-78dc596b38c1 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:26.304255 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f40f2-86bb-4a7c-929b-ab7446d6b1ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:26.304869 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f40f2-86bb-4a7c-929b-ab7446d6b1ab service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:26.305154 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f40f2-86bb-4a7c-929b-ab7446d6b1ab service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:26.305410 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f40f2-86bb-4a7c-929b-ab7446d6b1ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:26.313003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f40f2-86bb-4a7c-929b-ab7446d6b1ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:26.315096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f40f2-86bb-4a7c-929b-ab7446d6b1ab service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:26.323869 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 713/1435] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:27.796818 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9485b-d6eb-4bc8-8569-9db34ca1a6f5 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:27.797380 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9485b-d6eb-4bc8-8569-9db34ca1a6f5 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:27.797380 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9485b-d6eb-4bc8-8569-9db34ca1a6f5 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:27.799659 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 723/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 02:57:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:27.805128 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf959a27-4531-472f-8981-dc1bf87afae3 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:27.805577 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf959a27-4531-472f-8981-dc1bf87afae3 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:27.805686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf959a27-4531-472f-8981-dc1bf87afae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:27.823779 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-bf959a27-4531-472f-8981-dc1bf87afae3 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:27.824948 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-bf959a27-4531-472f-8981-dc1bf87afae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:27.832596 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 714/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 02:57:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:57:27.986380 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9485b-d6eb-4bc8-8569-9db34ca1a6f5 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:28.000029 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9485b-d6eb-4bc8-8569-9db34ca1a6f5 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:28.006109 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323cac0-161b-4eba-b601-47b040067233 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:28.006731 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323cac0-161b-4eba-b601-47b040067233 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:28.007012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323cac0-161b-4eba-b601-47b040067233 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:28.007288 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323cac0-161b-4eba-b601-47b040067233 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:28.015152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323cac0-161b-4eba-b601-47b040067233 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:28.016724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323cac0-161b-4eba-b601-47b040067233 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:28.027074 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 724/1438] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:29.480643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192db4d-31f0-4db2-9c93-1c8bde7783ed None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:29.481167 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192db4d-31f0-4db2-9c93-1c8bde7783ed None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:29.481167 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192db4d-31f0-4db2-9c93-1c8bde7783ed None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:29.482917 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 715/1439] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 02:57:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:29.488954 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ad23f-9aae-40f0-995b-a4319408ab1c None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:29.489378 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ad23f-9aae-40f0-995b-a4319408ab1c None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:29.489494 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ad23f-9aae-40f0-995b-a4319408ab1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:29.507448 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-fd8ad23f-9aae-40f0-995b-a4319408ab1c None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:29.508623 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-fd8ad23f-9aae-40f0-995b-a4319408ab1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:29.516243 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 725/1440] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 02:57:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:57:29.668220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192db4d-31f0-4db2-9c93-1c8bde7783ed None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:29.682518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192db4d-31f0-4db2-9c93-1c8bde7783ed None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:29.687747 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660239e-303d-4976-a723-92e3643fa4a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:29.688365 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660239e-303d-4976-a723-92e3643fa4a0 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:29.688637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660239e-303d-4976-a723-92e3643fa4a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:29.688934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660239e-303d-4976-a723-92e3643fa4a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:29.696733 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660239e-303d-4976-a723-92e3643fa4a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:29.698339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660239e-303d-4976-a723-92e3643fa4a0 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:29.707885 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 716/1441] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:31.151303 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf368fdc-6779-46a6-84f8-8c55db28d73b None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:31.151875 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf368fdc-6779-46a6-84f8-8c55db28d73b None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:31.151875 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf368fdc-6779-46a6-84f8-8c55db28d73b None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:31.153600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 726/1442] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 02:57:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:31.158967 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd107120-31ce-40de-9ba5-5048846b246f None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:31.159444 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd107120-31ce-40de-9ba5-5048846b246f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:31.159553 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd107120-31ce-40de-9ba5-5048846b246f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:31.177425 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-dd107120-31ce-40de-9ba5-5048846b246f None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:31.178609 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-dd107120-31ce-40de-9ba5-5048846b246f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:31.186010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 717/1443] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 02:57:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:57:31.335382 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf368fdc-6779-46a6-84f8-8c55db28d73b None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:31.348987 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf368fdc-6779-46a6-84f8-8c55db28d73b None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:31.354365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957df21-31f3-477b-9c9c-5b0d74ba31f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:31.354995 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957df21-31f3-477b-9c9c-5b0d74ba31f6 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:31.355274 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957df21-31f3-477b-9c9c-5b0d74ba31f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:31.355548 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957df21-31f3-477b-9c9c-5b0d74ba31f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:31.364213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957df21-31f3-477b-9c9c-5b0d74ba31f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:31.365868 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957df21-31f3-477b-9c9c-5b0d74ba31f6 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:31.375305 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 727/1444] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:33.605747 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f7148-f497-49dd-b833-c4dd8a0b856a None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:33.606310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f7148-f497-49dd-b833-c4dd8a0b856a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:33.606310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f7148-f497-49dd-b833-c4dd8a0b856a None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:33.608082 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 718/1445] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 02:57:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:33.614484 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26460b-b6f3-41c4-9ffd-0eb686409a6e None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:33.614917 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26460b-b6f3-41c4-9ffd-0eb686409a6e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:33.615014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26460b-b6f3-41c4-9ffd-0eb686409a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:33.633024 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-5f26460b-b6f3-41c4-9ffd-0eb686409a6e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:33.634209 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5f26460b-b6f3-41c4-9ffd-0eb686409a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:33.641638 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 728/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 02:57:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:57:33.680847 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f7148-f497-49dd-b833-c4dd8a0b856a None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:33.691744 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f7148-f497-49dd-b833-c4dd8a0b856a None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:33.695239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e668122-e1a6-41b6-bbdf-e3af7b608872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:33.695857 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e668122-e1a6-41b6-bbdf-e3af7b608872 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:33.696135 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e668122-e1a6-41b6-bbdf-e3af7b608872 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:33.696408 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e668122-e1a6-41b6-bbdf-e3af7b608872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:33.704955 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e668122-e1a6-41b6-bbdf-e3af7b608872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:33.706408 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e668122-e1a6-41b6-bbdf-e3af7b608872 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:33.715321 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 719/1447] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:36.188873 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdd24d-e891-492e-9cae-02adbc73e6a9 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:36.189513 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdd24d-e891-492e-9cae-02adbc73e6a9 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:36.189513 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdd24d-e891-492e-9cae-02adbc73e6a9 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:36.191236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 729/1448] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 02:57:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:36.197312 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d4150-2830-4617-a573-04f75a971859 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:36.197733 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d4150-2830-4617-a573-04f75a971859 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:36.197848 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d4150-2830-4617-a573-04f75a971859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:36.215999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-0b8d4150-2830-4617-a573-04f75a971859 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:36.217166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0b8d4150-2830-4617-a573-04f75a971859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:36.225256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 720/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 02:57:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:57:36.264546 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdd24d-e891-492e-9cae-02adbc73e6a9 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:36.274825 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdd24d-e891-492e-9cae-02adbc73e6a9 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:36.278309 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231de21a-aa57-493a-818a-6264b14a7a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:36.278931 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de21a-aa57-493a-818a-6264b14a7a94 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:36.279213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de21a-aa57-493a-818a-6264b14a7a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:36.279489 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de21a-aa57-493a-818a-6264b14a7a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:36.288660 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231de21a-aa57-493a-818a-6264b14a7a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:36.290160 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231de21a-aa57-493a-818a-6264b14a7a94 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:36.300002 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 730/1450] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:38.890993 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c8a1a-877e-4731-9bea-64477c51a4e0 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:38.891564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c8a1a-877e-4731-9bea-64477c51a4e0 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:38.891564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c8a1a-877e-4731-9bea-64477c51a4e0 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:38.893794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 721/1451] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 02:57:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:38.899592 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b1cc4-64c9-478c-a29c-a4080f15a159 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:38.900013 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b1cc4-64c9-478c-a29c-a4080f15a159 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:38.900131 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b1cc4-64c9-478c-a29c-a4080f15a159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:38.917770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-c41b1cc4-64c9-478c-a29c-a4080f15a159 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:38.918964 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c41b1cc4-64c9-478c-a29c-a4080f15a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:38.926410 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 731/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 02:57:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:57:38.965527 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c8a1a-877e-4731-9bea-64477c51a4e0 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:38.976214 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c8a1a-877e-4731-9bea-64477c51a4e0 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:38.979588 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8923408-7fd5-4180-a6cc-d007b5ea2444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:38.980197 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8923408-7fd5-4180-a6cc-d007b5ea2444 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:38.980471 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8923408-7fd5-4180-a6cc-d007b5ea2444 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:38.980738 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8923408-7fd5-4180-a6cc-d007b5ea2444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:38.989077 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8923408-7fd5-4180-a6cc-d007b5ea2444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:38.990524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8923408-7fd5-4180-a6cc-d007b5ea2444 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:38.999331 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 722/1453] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:41.416493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b069b-5080-47f6-915a-d168b877bfc4 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:41.417044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b069b-5080-47f6-915a-d168b877bfc4 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:41.417044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b069b-5080-47f6-915a-d168b877bfc4 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:41.418881 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 732/1454] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 02:57:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:41.425414 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebad3a-e33d-4735-a388-7775719706bd None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:41.425835 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebad3a-e33d-4735-a388-7775719706bd None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:41.425964 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebad3a-e33d-4735-a388-7775719706bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:41.443182 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-33ebad3a-e33d-4735-a388-7775719706bd None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:41.444345 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-33ebad3a-e33d-4735-a388-7775719706bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:41.451849 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 723/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 02:57:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:57:41.491572 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b069b-5080-47f6-915a-d168b877bfc4 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:41.501759 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b069b-5080-47f6-915a-d168b877bfc4 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:41.505441 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ced5e-f317-4181-aca1-53aeec09d897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:41.506087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ced5e-f317-4181-aca1-53aeec09d897 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:41.506368 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ced5e-f317-4181-aca1-53aeec09d897 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:41.506639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ced5e-f317-4181-aca1-53aeec09d897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:41.515136 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ced5e-f317-4181-aca1-53aeec09d897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:41.516541 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ced5e-f317-4181-aca1-53aeec09d897 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:41.525511 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 733/1456] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:43.903247 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c5e1a-db9b-4d17-9d00-d275b2b71003 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:43.903830 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c5e1a-db9b-4d17-9d00-d275b2b71003 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:43.903830 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c5e1a-db9b-4d17-9d00-d275b2b71003 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:43.905562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 724/1457] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 02:57:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:43.911986 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6263984-2504-45fa-b22f-fb6d4b7629d1 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:43.912383 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6263984-2504-45fa-b22f-fb6d4b7629d1 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:43.912541 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6263984-2504-45fa-b22f-fb6d4b7629d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:43.930696 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-b6263984-2504-45fa-b22f-fb6d4b7629d1 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:43.931890 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b6263984-2504-45fa-b22f-fb6d4b7629d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:43.939570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 734/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 02:57:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:57:43.983196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c5e1a-db9b-4d17-9d00-d275b2b71003 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:43.993695 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c5e1a-db9b-4d17-9d00-d275b2b71003 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:43.997133 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae2105-07f1-49bc-a35f-60333448870d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:43.997752 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae2105-07f1-49bc-a35f-60333448870d service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:43.998123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae2105-07f1-49bc-a35f-60333448870d service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:43.998396 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae2105-07f1-49bc-a35f-60333448870d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:44.007345 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae2105-07f1-49bc-a35f-60333448870d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:44.008758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae2105-07f1-49bc-a35f-60333448870d service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:44.018233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 725/1459] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:46.381052 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cb0fb-8716-44d7-872e-f9f8add55277 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:46.381608 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cb0fb-8716-44d7-872e-f9f8add55277 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:46.381608 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cb0fb-8716-44d7-872e-f9f8add55277 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:46.383387 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 735/1460] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 02:57:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:46.389233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2998bbb-a455-4fd2-aafd-d9ad9ac348e4 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:46.389686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2998bbb-a455-4fd2-aafd-d9ad9ac348e4 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:46.389796 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2998bbb-a455-4fd2-aafd-d9ad9ac348e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:46.408308 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c2998bbb-a455-4fd2-aafd-d9ad9ac348e4 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:46.409516 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c2998bbb-a455-4fd2-aafd-d9ad9ac348e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:46.417185 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 726/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 02:57:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:57:46.456463 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cb0fb-8716-44d7-872e-f9f8add55277 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:46.467118 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cb0fb-8716-44d7-872e-f9f8add55277 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:46.471111 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b5a16-097a-4519-8e7a-de946e19bfcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:46.471736 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b5a16-097a-4519-8e7a-de946e19bfcc service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:46.472014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b5a16-097a-4519-8e7a-de946e19bfcc service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:46.472287 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b5a16-097a-4519-8e7a-de946e19bfcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:46.480776 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b5a16-097a-4519-8e7a-de946e19bfcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:46.482262 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b5a16-097a-4519-8e7a-de946e19bfcc service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:46.491423 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 736/1462] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:48.855498 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e218434-0daf-4234-a9a4-a743e8887680 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:48.856033 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e218434-0daf-4234-a9a4-a743e8887680 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:48.856033 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e218434-0daf-4234-a9a4-a743e8887680 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:48.857862 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 727/1463] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 02:57:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:48.864382 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1dac7-fa7c-455c-86f6-d145a94f2d33 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:48.864844 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1dac7-fa7c-455c-86f6-d145a94f2d33 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:48.864980 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1dac7-fa7c-455c-86f6-d145a94f2d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:48.882403 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-49d1dac7-fa7c-455c-86f6-d145a94f2d33 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:48.883570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-49d1dac7-fa7c-455c-86f6-d145a94f2d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:48.891065 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 737/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 02:57:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:57:48.930256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e218434-0daf-4234-a9a4-a743e8887680 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:48.940489 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e218434-0daf-4234-a9a4-a743e8887680 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:48.943961 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc0c4a-6711-4aa7-ac6f-1ea83ddd9985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:48.944575 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc0c4a-6711-4aa7-ac6f-1ea83ddd9985 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:48.944850 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc0c4a-6711-4aa7-ac6f-1ea83ddd9985 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:48.945119 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc0c4a-6711-4aa7-ac6f-1ea83ddd9985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:48.953540 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc0c4a-6711-4aa7-ac6f-1ea83ddd9985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:48.954973 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc0c4a-6711-4aa7-ac6f-1ea83ddd9985 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:48.963908 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 728/1465] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:51.342483 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033d11f-8894-4c20-b011-6db5208169d2 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:51.343003 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033d11f-8894-4c20-b011-6db5208169d2 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:51.343122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033d11f-8894-4c20-b011-6db5208169d2 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:51.344851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 738/1466] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 02:57:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:51.350774 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f04774-d636-4cc8-bf71-09bd3bb592eb None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:51.351177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f04774-d636-4cc8-bf71-09bd3bb592eb None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:51.351327 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f04774-d636-4cc8-bf71-09bd3bb592eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:51.368728 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-24f04774-d636-4cc8-bf71-09bd3bb592eb None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:51.369915 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-24f04774-d636-4cc8-bf71-09bd3bb592eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:51.378349 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 729/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 02:57:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:57:51.416909 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033d11f-8894-4c20-b011-6db5208169d2 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:51.427767 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033d11f-8894-4c20-b011-6db5208169d2 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:51.431246 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee7413-e6ae-447e-8863-ed0e631de8e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:51.431864 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee7413-e6ae-447e-8863-ed0e631de8e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:51.432167 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee7413-e6ae-447e-8863-ed0e631de8e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:51.432415 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee7413-e6ae-447e-8863-ed0e631de8e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:51.441514 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee7413-e6ae-447e-8863-ed0e631de8e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:51.442961 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee7413-e6ae-447e-8863-ed0e631de8e0 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:51.451824 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 739/1468] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:53.790866 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc7e7f-6927-491c-8f12-8c84c050f72c None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:53.791447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc7e7f-6927-491c-8f12-8c84c050f72c None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:53.791447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc7e7f-6927-491c-8f12-8c84c050f72c None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:53.793225 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 730/1469] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 02:57:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:57:53.799799 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc1cef-32eb-4c01-b86d-85d458f48dd2 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:53.800229 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc1cef-32eb-4c01-b86d-85d458f48dd2 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:53.800355 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc1cef-32eb-4c01-b86d-85d458f48dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:53.817946 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-9cbc1cef-32eb-4c01-b86d-85d458f48dd2 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:53.819130 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-9cbc1cef-32eb-4c01-b86d-85d458f48dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:53.826879 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 740/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 02:57:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:57:53.865095 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc7e7f-6927-491c-8f12-8c84c050f72c None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:53.875323 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc7e7f-6927-491c-8f12-8c84c050f72c None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:53.879570 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ba9ae-500d-41f9-b186-b3799879c7d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:53.880186 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ba9ae-500d-41f9-b186-b3799879c7d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:53.880489 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ba9ae-500d-41f9-b186-b3799879c7d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:53.880762 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ba9ae-500d-41f9-b186-b3799879c7d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:53.889159 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ba9ae-500d-41f9-b186-b3799879c7d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:53.890607 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ba9ae-500d-41f9-b186-b3799879c7d2 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:53.899402 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 731/1471] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:56.219159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08a9e2-13a2-48b3-a7b5-ed7a551e71fb None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:56.219677 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08a9e2-13a2-48b3-a7b5-ed7a551e71fb None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:56.219775 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08a9e2-13a2-48b3-a7b5-ed7a551e71fb None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:56.221496 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 741/1472] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 02:57:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:57:56.227328 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8efa99-f4af-4d06-a722-9e8245d929bd None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:56.227783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8efa99-f4af-4d06-a722-9e8245d929bd None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:56.227880 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8efa99-f4af-4d06-a722-9e8245d929bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:56.245476 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-1e8efa99-f4af-4d06-a722-9e8245d929bd None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:57:56.246658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1e8efa99-f4af-4d06-a722-9e8245d929bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:57:56.255038 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 732/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 02:57:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:57:56.292070 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08a9e2-13a2-48b3-a7b5-ed7a551e71fb None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:57:56.303003 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08a9e2-13a2-48b3-a7b5-ed7a551e71fb None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:57:56.306545 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be5293-0ba9-496a-9e20-9381afaa449c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:57:56.307166 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be5293-0ba9-496a-9e20-9381afaa449c service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:57:56.307448 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be5293-0ba9-496a-9e20-9381afaa449c service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:57:56.307723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be5293-0ba9-496a-9e20-9381afaa449c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:57:56.316918 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be5293-0ba9-496a-9e20-9381afaa449c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:57:56.318396 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be5293-0ba9-496a-9e20-9381afaa449c service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:57:56.327562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 742/1474] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:57:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:58:13.256798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58472d12-eb9d-49fc-83ce-d654f09fb06f None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:13.257328 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58472d12-eb9d-49fc-83ce-d654f09fb06f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:13.257328 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58472d12-eb9d-49fc-83ce-d654f09fb06f None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:13.259132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 733/1475] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:58:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:58:13.264799 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a0d51-79c7-43ed-b384-a281d76972ee None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:13.265234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a0d51-79c7-43ed-b384-a281d76972ee None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:13.265337 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a0d51-79c7-43ed-b384-a281d76972ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:13.282760 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-322a0d51-79c7-43ed-b384-a281d76972ee None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:58:13.283909 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-322a0d51-79c7-43ed-b384-a281d76972ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:58:13.291397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 743/1476] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:58:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:58:13.339356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483324f6-08a6-41a5-a22f-797d2ee762cb None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:13.339673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483324f6-08a6-41a5-a22f-797d2ee762cb None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:13.339950 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483324f6-08a6-41a5-a22f-797d2ee762cb None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:13.341697 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 734/1477] 10.222.0.18 () {54 vars in 962 bytes} [Wed Dec 15 02:58:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:58:13.346856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff059211-fd4c-4416-b15a-c732852a38b3 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:13.347141 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff059211-fd4c-4416-b15a-c732852a38b3 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:13.347419 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff059211-fd4c-4416-b15a-c732852a38b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:13.365139 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-ff059211-fd4c-4416-b15a-c732852a38b3 None None] MFA Rules not processed for user `e48dcc22c7df4aed8fa6cf32e3c2ec51`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:58:13.366312 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-ff059211-fd4c-4416-b15a-c732852a38b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:58:13.372775 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 744/1478] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Dec 15 02:58:13 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:58:13.381162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483324f6-08a6-41a5-a22f-797d2ee762cb None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:58:13.391335 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483324f6-08a6-41a5-a22f-797d2ee762cb None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:58:13.394767 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa637b8-cffa-4530-829d-c91cf647f7e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48dcc22c7df4aed8fa6cf32e3c2ec51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:58:13.395376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa637b8-cffa-4530-829d-c91cf647f7e3 service glance] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:13.395651 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa637b8-cffa-4530-829d-c91cf647f7e3 service glance] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:13.395920 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa637b8-cffa-4530-829d-c91cf647f7e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:13.404687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa637b8-cffa-4530-829d-c91cf647f7e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:58:13.406123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa637b8-cffa-4530-829d-c91cf647f7e3 service glance] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:58:13.415224 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 735/1479] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:58:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:58:15.827931 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab06bb-65d1-457a-8400-1fb09bcda666 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:15.828531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab06bb-65d1-457a-8400-1fb09bcda666 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:15.828531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab06bb-65d1-457a-8400-1fb09bcda666 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:15.830393 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 745/1480] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:58:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:58:15.836393 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb7409-1acb-4d6f-8714-ab286184efa5 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:15.836822 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb7409-1acb-4d6f-8714-ab286184efa5 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:15.836931 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb7409-1acb-4d6f-8714-ab286184efa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:15.854638 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-bdcb7409-1acb-4d6f-8714-ab286184efa5 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:58:15.855803 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-bdcb7409-1acb-4d6f-8714-ab286184efa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:58:15.864031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 736/1481] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:58:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:58:15.888158 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab06bb-65d1-457a-8400-1fb09bcda666 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:58:15.900163 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab06bb-65d1-457a-8400-1fb09bcda666 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:58:15.904541 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ca378-16da-4dd5-85d6-7c4bb892fb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:58:15.905173 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ca378-16da-4dd5-85d6-7c4bb892fb0c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:15.905457 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ca378-16da-4dd5-85d6-7c4bb892fb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:15.905735 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ca378-16da-4dd5-85d6-7c4bb892fb0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:15.907023 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ca378-16da-4dd5-85d6-7c4bb892fb0c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:58:15.908838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ca378-16da-4dd5-85d6-7c4bb892fb0c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:58:15.922907 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 746/1482] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Dec 15 02:58:15 2021] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 02:58:18.312861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a85ea-f778-475b-bbad-4c89d974ad44 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:18.313388 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a85ea-f778-475b-bbad-4c89d974ad44 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:18.313388 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a85ea-f778-475b-bbad-4c89d974ad44 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:18.315198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 737/1483] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:58:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:58:18.320974 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b521a-9603-4481-83a7-f1a33b97ebbd None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:18.321395 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b521a-9603-4481-83a7-f1a33b97ebbd None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:18.321504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b521a-9603-4481-83a7-f1a33b97ebbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:18.338521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-d09b521a-9603-4481-83a7-f1a33b97ebbd None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:58:18.339672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d09b521a-9603-4481-83a7-f1a33b97ebbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:58:18.347693 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 747/1484] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:58:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:58:18.391648 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a85ea-f778-475b-bbad-4c89d974ad44 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:58:18.406112 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a85ea-f778-475b-bbad-4c89d974ad44 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:58:18.411890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173c2e6-81f6-472e-acbe-22dbbc9f42bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:58:18.412504 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173c2e6-81f6-472e-acbe-22dbbc9f42bb service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:18.412780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173c2e6-81f6-472e-acbe-22dbbc9f42bb service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:18.413050 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173c2e6-81f6-472e-acbe-22dbbc9f42bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:18.421019 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173c2e6-81f6-472e-acbe-22dbbc9f42bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:58:18.423121 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173c2e6-81f6-472e-acbe-22dbbc9f42bb service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:58:18.432087 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 738/1485] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:58:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:58:20.948813 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7704c84-8eba-4c5f-8447-a454c04dd773 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:20.949376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7704c84-8eba-4c5f-8447-a454c04dd773 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:20.949376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7704c84-8eba-4c5f-8447-a454c04dd773 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:20.951195 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 748/1486] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:58:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:58:20.956965 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50a45b-5c70-45b3-ade0-c8f9c9b85cb2 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:20.957391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50a45b-5c70-45b3-ade0-c8f9c9b85cb2 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:20.957499 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50a45b-5c70-45b3-ade0-c8f9c9b85cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:20.974501 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-9e50a45b-5c70-45b3-ade0-c8f9c9b85cb2 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:58:20.975655 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9e50a45b-5c70-45b3-ade0-c8f9c9b85cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:58:20.983115 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 739/1487] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:58:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:58:21.021618 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7704c84-8eba-4c5f-8447-a454c04dd773 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:58:21.032046 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7704c84-8eba-4c5f-8447-a454c04dd773 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:58:21.035483 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41133064-aad1-472b-9ab7-39685d245646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:58:21.036100 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41133064-aad1-472b-9ab7-39685d245646 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:21.036383 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41133064-aad1-472b-9ab7-39685d245646 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:21.036659 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41133064-aad1-472b-9ab7-39685d245646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:21.045075 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41133064-aad1-472b-9ab7-39685d245646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:58:21.046529 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41133064-aad1-472b-9ab7-39685d245646 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:58:21.055890 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 749/1488] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:58:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:58:23.433581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5981c-44ea-47ba-8895-9432813cc016 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:23.434153 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5981c-44ea-47ba-8895-9432813cc016 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:23.434153 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5981c-44ea-47ba-8895-9432813cc016 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:23.435931 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 740/1489] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:58:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:58:23.442054 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4364813-e250-4618-8e5c-e49750818ba0 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:23.442514 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4364813-e250-4618-8e5c-e49750818ba0 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:23.442629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4364813-e250-4618-8e5c-e49750818ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:23.460662 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-d4364813-e250-4618-8e5c-e49750818ba0 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:58:23.461750 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d4364813-e250-4618-8e5c-e49750818ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:58:23.469297 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 750/1490] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:58:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:58:23.507832 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5981c-44ea-47ba-8895-9432813cc016 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:58:23.518660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5981c-44ea-47ba-8895-9432813cc016 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:58:23.522118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ea514-f381-474b-953c-ecfa21aec918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:58:23.522735 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ea514-f381-474b-953c-ecfa21aec918 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:23.523010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ea514-f381-474b-953c-ecfa21aec918 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:23.523281 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ea514-f381-474b-953c-ecfa21aec918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:23.531747 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ea514-f381-474b-953c-ecfa21aec918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:58:23.533153 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ea514-f381-474b-953c-ecfa21aec918 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:58:23.542050 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 741/1491] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:58:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:58:26.023103 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa778b-91aa-4bf3-bdb4-aa0e0ccee128 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:26.023670 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa778b-91aa-4bf3-bdb4-aa0e0ccee128 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:26.023670 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa778b-91aa-4bf3-bdb4-aa0e0ccee128 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:26.025439 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 751/1492] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:58:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:58:26.031913 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6500294-2ec8-4137-8c17-a7bb054f0d7f None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:26.032383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6500294-2ec8-4137-8c17-a7bb054f0d7f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:26.032491 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6500294-2ec8-4137-8c17-a7bb054f0d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:26.049637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-e6500294-2ec8-4137-8c17-a7bb054f0d7f None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:58:26.050829 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e6500294-2ec8-4137-8c17-a7bb054f0d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:58:26.058332 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 742/1493] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:58:26.099692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa778b-91aa-4bf3-bdb4-aa0e0ccee128 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:58:26.109999 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa778b-91aa-4bf3-bdb4-aa0e0ccee128 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:58:26.113458 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186bb86-eb0c-43d3-80d8-29b40e03285e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:58:26.114113 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186bb86-eb0c-43d3-80d8-29b40e03285e service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:26.114396 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186bb86-eb0c-43d3-80d8-29b40e03285e service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:26.114673 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186bb86-eb0c-43d3-80d8-29b40e03285e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:26.123207 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186bb86-eb0c-43d3-80d8-29b40e03285e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:58:26.124628 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186bb86-eb0c-43d3-80d8-29b40e03285e service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:58:26.134205 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 752/1494] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:58:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:58:28.667101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9462f2-69bf-4e1c-9a47-72e19d5c6d89 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:28.667655 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9462f2-69bf-4e1c-9a47-72e19d5c6d89 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:28.667655 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9462f2-69bf-4e1c-9a47-72e19d5c6d89 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:28.669415 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 743/1495] 10.222.0.18 () {54 vars in 926 bytes} [Wed Dec 15 02:58:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 02:58:28.675933 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27823864-8b8a-4025-b28a-16e24c4f244f None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:28.676342 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27823864-8b8a-4025-b28a-16e24c4f244f None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:28.676440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27823864-8b8a-4025-b28a-16e24c4f244f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:28.693639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-27823864-8b8a-4025-b28a-16e24c4f244f None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:58:28.694838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-27823864-8b8a-4025-b28a-16e24c4f244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:58:28.702442 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 753/1496] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Dec 15 02:58:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:58:28.742872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9462f2-69bf-4e1c-9a47-72e19d5c6d89 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:58:28.753524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9462f2-69bf-4e1c-9a47-72e19d5c6d89 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:58:28.756930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d45d0d-f29e-4c64-805b-806bae545e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:58:28.757543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d45d0d-f29e-4c64-805b-806bae545e35 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:58:28.757820 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d45d0d-f29e-4c64-805b-806bae545e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:58:28.758125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d45d0d-f29e-4c64-805b-806bae545e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:58:28.766593 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d45d0d-f29e-4c64-805b-806bae545e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:58:28.767999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d45d0d-f29e-4c64-805b-806bae545e35 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:58:28.777037 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 744/1497] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:58:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 02:59:45.633336 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5193a7-9328-45ee-b166-7f02f1410e67 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:59:45.633941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5193a7-9328-45ee-b166-7f02f1410e67 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:59:45.633941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5193a7-9328-45ee-b166-7f02f1410e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:59:45.652494 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-0f5193a7-9328-45ee-b166-7f02f1410e67 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:59:45.653666 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-0f5193a7-9328-45ee-b166-7f02f1410e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:59:45.661870 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 754/1498] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 02:59:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:59:45.669648 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ea48-6795-4105-b45b-3cb498ac37f5 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:59:45.670127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ea48-6795-4105-b45b-3cb498ac37f5 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:59:45.670230 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ea48-6795-4105-b45b-3cb498ac37f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:59:45.687199 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-b018ea48-6795-4105-b45b-3cb498ac37f5 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:59:45.688373 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b018ea48-6795-4105-b45b-3cb498ac37f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:59:45.695821 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 745/1499] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 02:59:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:59:45.700136 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5193a7-9328-45ee-b166-7f02f1410e67 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:59:45.709822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5193a7-9328-45ee-b166-7f02f1410e67 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:59:45.714318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5ca25-9540-4a37-b375-6107b9e79acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:59:45.714943 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5ca25-9540-4a37-b375-6107b9e79acd admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:59:45.715224 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5ca25-9540-4a37-b375-6107b9e79acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:59:45.715499 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5ca25-9540-4a37-b375-6107b9e79acd admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:59:45.716229 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5ca25-9540-4a37-b375-6107b9e79acd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 02:59:45.716533 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5ca25-9540-4a37-b375-6107b9e79acd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:59:45.718707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5ca25-9540-4a37-b375-6107b9e79acd admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:59:45.729782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 755/1500] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 02:59:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 02:59:45.737752 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018ea48-6795-4105-b45b-3cb498ac37f5 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:59:45.746478 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018ea48-6795-4105-b45b-3cb498ac37f5 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:59:45.750915 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abb732-46b2-453d-b3f1-eeb802725d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:59:45.751786 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abb732-46b2-453d-b3f1-eeb802725d78 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:59:45.752058 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abb732-46b2-453d-b3f1-eeb802725d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:59:45.752323 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abb732-46b2-453d-b3f1-eeb802725d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:59:45.753012 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abb732-46b2-453d-b3f1-eeb802725d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:59:45.754901 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abb732-46b2-453d-b3f1-eeb802725d78 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:59:45.789843 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 746/1501] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 02:59:45 2021] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 02:59:45.793949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5ca25-9540-4a37-b375-6107b9e79acd admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:59:45.803763 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5ca25-9540-4a37-b375-6107b9e79acd admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:59:45.857225 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae28b41-986c-4314-8442-ad4ce080455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:59:45.857904 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae28b41-986c-4314-8442-ad4ce080455b admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:59:45.858214 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae28b41-986c-4314-8442-ad4ce080455b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:59:45.858488 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae28b41-986c-4314-8442-ad4ce080455b admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:59:45.859253 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae28b41-986c-4314-8442-ad4ce080455b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:59:45.861317 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae28b41-986c-4314-8442-ad4ce080455b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:59:45.881173 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 756/1502] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 02:59:45 2021] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 02:59:45.885234 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abb732-46b2-453d-b3f1-eeb802725d78 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:59:45.895508 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abb732-46b2-453d-b3f1-eeb802725d78 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:59:45.900203 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdef62-653e-4c7a-a661-48de7dfb61dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:59:45.900853 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdef62-653e-4c7a-a661-48de7dfb61dc admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:59:45.901137 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdef62-653e-4c7a-a661-48de7dfb61dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:59:45.901413 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdef62-653e-4c7a-a661-48de7dfb61dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:59:45.902227 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdef62-653e-4c7a-a661-48de7dfb61dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:59:45.903841 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdef62-653e-4c7a-a661-48de7dfb61dc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:59:45.917136 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 747/1503] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 02:59:45 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 02:59:45.921643 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae28b41-986c-4314-8442-ad4ce080455b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:59:45.931018 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae28b41-986c-4314-8442-ad4ce080455b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:59:45.935495 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c68f26-eef8-4e43-b66e-1482fa509a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:59:45.936155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c68f26-eef8-4e43-b66e-1482fa509a75 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:59:45.936434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c68f26-eef8-4e43-b66e-1482fa509a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:59:45.936707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c68f26-eef8-4e43-b66e-1482fa509a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:59:45.937435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c68f26-eef8-4e43-b66e-1482fa509a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:59:45.939038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c68f26-eef8-4e43-b66e-1482fa509a75 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:59:45.951985 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 757/1504] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 02:59:45 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 02:59:45.955870 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdef62-653e-4c7a-a661-48de7dfb61dc admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:59:45.965275 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdef62-653e-4c7a-a661-48de7dfb61dc admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:59:45.970363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12954c9f-8298-443c-8fbd-9b5f96348132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:59:45.971237 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12954c9f-8298-443c-8fbd-9b5f96348132 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:59:45.971498 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12954c9f-8298-443c-8fbd-9b5f96348132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:59:45.971770 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12954c9f-8298-443c-8fbd-9b5f96348132 admin admin] PATH_INFO: `/v3/projects/9e7606612e6642dc834b96afa9ac3c97/users/91554362380844769cfec2cc30f55ff4/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:59:45.986272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12954c9f-8298-443c-8fbd-9b5f96348132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7606612e6642dc834b96afa9ac3c97, user_id=91554362380844769cfec2cc30f55ff4, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:59:45.988907 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12954c9f-8298-443c-8fbd-9b5f96348132 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:59:46.001137 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 748/1505] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 02:59:45 2021] PUT /identity/v3/projects/9e7606612e6642dc834b96afa9ac3c97/users/91554362380844769cfec2cc30f55ff4/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:59:46.012430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792e469-2cc9-449d-892d-76de4ed4b642 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:59:46.012712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792e469-2cc9-449d-892d-76de4ed4b642 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:59:46.012985 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792e469-2cc9-449d-892d-76de4ed4b642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:59:46.038748 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-6792e469-2cc9-449d-892d-76de4ed4b642 None None] MFA Rules not processed for user `91554362380844769cfec2cc30f55ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:59:46.039938 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6792e469-2cc9-449d-892d-76de4ed4b642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:59:46.100946 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 758/1506] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 02:59:46 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 02:59:46.113791 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12954c9f-8298-443c-8fbd-9b5f96348132 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:59:46.180845 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12954c9f-8298-443c-8fbd-9b5f96348132 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:59:46.186248 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d2584-8221-4835-a2a7-0bd2908c7467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:59:46.186875 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d2584-8221-4835-a2a7-0bd2908c7467 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:59:46.187157 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d2584-8221-4835-a2a7-0bd2908c7467 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:59:46.187433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d2584-8221-4835-a2a7-0bd2908c7467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:59:46.194909 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d2584-8221-4835-a2a7-0bd2908c7467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:59:46.196484 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d2584-8221-4835-a2a7-0bd2908c7467 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:59:46.205880 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 749/1507] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:59:46 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:59:46.272203 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d14dd2-07c2-4abf-aed0-7471c5037be7 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:59:46.272488 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d14dd2-07c2-4abf-aed0-7471c5037be7 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:59:46.272763 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d14dd2-07c2-4abf-aed0-7471c5037be7 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:59:46.274495 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 759/1508] 10.222.0.18 () {52 vars in 829 bytes} [Wed Dec 15 02:59:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 02:59:46.277972 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d2584-8221-4835-a2a7-0bd2908c7467 service nova] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:59:46.335887 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d2584-8221-4835-a2a7-0bd2908c7467 service nova] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:59:46.340356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26f298-b22a-406f-a594-4676d390a5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:59:46.341189 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26f298-b22a-406f-a594-4676d390a5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:59:46.341475 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26f298-b22a-406f-a594-4676d390a5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:59:46.342337 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26f298-b22a-406f-a594-4676d390a5a4 admin admin] PATH_INFO: `/v3/users/91554362380844769cfec2cc30f55ff4` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:59:46.343518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26f298-b22a-406f-a594-4676d390a5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91554362380844769cfec2cc30f55ff4)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:59:46.344537 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-4e26f298-b22a-406f-a594-4676d390a5a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:59:46.344537 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 02:59:46.344537 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 02:59:46.345713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26f298-b22a-406f-a594-4676d390a5a4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:59:46.410036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4e26f298-b22a-406f-a594-4676d390a5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91554362380844769cfec2cc30f55ff4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 02:59:46.428822 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4e26f298-b22a-406f-a594-4676d390a5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91554362380844769cfec2cc30f55ff4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 02:59:46.437780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4e26f298-b22a-406f-a594-4676d390a5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91554362380844769cfec2cc30f55ff4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 02:59:46.449811 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4e26f298-b22a-406f-a594-4676d390a5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91554362380844769cfec2cc30f55ff4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 02:59:46.450498 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4e26f298-b22a-406f-a594-4676d390a5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91554362380844769cfec2cc30f55ff4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 02:59:46.456874 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 750/1509] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 02:59:46 2021] DELETE /identity/v3/users/91554362380844769cfec2cc30f55ff4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 02:59:46.461343 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f441ca-db5f-4e04-b1ad-ad9fbdfd9edd None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:59:46.461653 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f441ca-db5f-4e04-b1ad-ad9fbdfd9edd None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:59:46.461937 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f441ca-db5f-4e04-b1ad-ad9fbdfd9edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:59:46.479551 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-50f441ca-db5f-4e04-b1ad-ad9fbdfd9edd None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 02:59:46.480727 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-50f441ca-db5f-4e04-b1ad-ad9fbdfd9edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:59:46.535884 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 760/1510] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 02:59:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 02:59:46.545481 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26f298-b22a-406f-a594-4676d390a5a4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:59:46.546892 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-4e26f298-b22a-406f-a594-4676d390a5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:59:46.600835 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26f298-b22a-406f-a594-4676d390a5a4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:59:46.604380 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5d3de-235c-4fe6-a441-1d4e5d3d7b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:59:46.605012 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d3de-235c-4fe6-a441-1d4e5d3d7b84 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:59:46.605293 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d3de-235c-4fe6-a441-1d4e5d3d7b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:59:46.605563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d3de-235c-4fe6-a441-1d4e5d3d7b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:59:46.614125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5d3de-235c-4fe6-a441-1d4e5d3d7b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:59:46.615552 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5d3de-235c-4fe6-a441-1d4e5d3d7b84 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:59:46.625114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 751/1511] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 02:59:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 02:59:46.938382 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f441ca-db5f-4e04-b1ad-ad9fbdfd9edd None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 02:59:46.939821 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-50f441ca-db5f-4e04-b1ad-ad9fbdfd9edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 02:59:46.951863 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f441ca-db5f-4e04-b1ad-ad9fbdfd9edd None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 02:59:46.956760 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45edb1c-5430-4f3d-9b9e-aa56d5ef33c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 02:59:46.957609 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45edb1c-5430-4f3d-9b9e-aa56d5ef33c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 02:59:46.957892 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45edb1c-5430-4f3d-9b9e-aa56d5ef33c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 02:59:46.958217 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45edb1c-5430-4f3d-9b9e-aa56d5ef33c6 admin admin] PATH_INFO: `/v3/projects/9e7606612e6642dc834b96afa9ac3c97` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 02:59:46.959465 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45edb1c-5430-4f3d-9b9e-aa56d5ef33c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e7606612e6642dc834b96afa9ac3c97)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 02:59:46.960543 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-c45edb1c-5430-4f3d-9b9e-aa56d5ef33c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:59:46.960543 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 02:59:46.960543 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 02:59:46.961774 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45edb1c-5430-4f3d-9b9e-aa56d5ef33c6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 02:59:47.019356 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c45edb1c-5430-4f3d-9b9e-aa56d5ef33c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7606612e6642dc834b96afa9ac3c97', 'request_id': 'req-c45edb1c-5430-4f3d-9b9e-aa56d5ef33c6'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 02:59:47.028892 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c45edb1c-5430-4f3d-9b9e-aa56d5ef33c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7606612e6642dc834b96afa9ac3c97', 'request_id': 'req-c45edb1c-5430-4f3d-9b9e-aa56d5ef33c6'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 02:59:47.042251 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c45edb1c-5430-4f3d-9b9e-aa56d5ef33c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7606612e6642dc834b96afa9ac3c97', 'request_id': 'req-c45edb1c-5430-4f3d-9b9e-aa56d5ef33c6'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 02:59:47.052982 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c45edb1c-5430-4f3d-9b9e-aa56d5ef33c6 admin admin] The token cache is being invalidate because project 9e7606612e6642dc834b96afa9ac3c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 02:59:47.053265 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c45edb1c-5430-4f3d-9b9e-aa56d5ef33c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 02:59:47.053902 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c45edb1c-5430-4f3d-9b9e-aa56d5ef33c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 02:59:47.055544 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 761/1512] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 02:59:46 2021] DELETE /identity/v3/projects/9e7606612e6642dc834b96afa9ac3c97 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:01:11.930729 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377601c-14b5-44d3-b158-49c065db82ab None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:11.931331 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377601c-14b5-44d3-b158-49c065db82ab None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:11.931331 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377601c-14b5-44d3-b158-49c065db82ab None None] PATH_INFO: `/v3` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:11.932658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 752/1513] 10.222.0.31 () {54 vars in 925 bytes} [Wed Dec 15 03:01:11 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:01:11.940653 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4ca24-a355-4350-bc9a-a01194ef712a None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:11.941075 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4ca24-a355-4350-bc9a-a01194ef712a None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:11.941231 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4ca24-a355-4350-bc9a-a01194ef712a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:11.959450 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-d6c4ca24-a355-4350-bc9a-a01194ef712a None None] MFA Rules not processed for user `93762c21f03d44d5bf3881d17e14ef90`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:01:11.960628 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d6c4ca24-a355-4350-bc9a-a01194ef712a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:01:12.022196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 762/1514] 10.222.0.31 () {58 vars in 1015 bytes} [Wed Dec 15 03:01:11 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:01:12.423398 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4fc7-b7ea-4068-987d-49149fcb9d4b None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:12.423676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4fc7-b7ea-4068-987d-49149fcb9d4b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:12.423946 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4fc7-b7ea-4068-987d-49149fcb9d4b None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:12.425705 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 753/1515] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 03:01:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:01:12.431019 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d630173-820a-4815-81d0-953ef7c33af0 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:12.431305 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d630173-820a-4815-81d0-953ef7c33af0 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:12.431580 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d630173-820a-4815-81d0-953ef7c33af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:12.451076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-5d630173-820a-4815-81d0-953ef7c33af0 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:01:12.452249 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5d630173-820a-4815-81d0-953ef7c33af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:01:12.506681 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 763/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 03:01:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:01:12.658492 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e4fc7-b7ea-4068-987d-49149fcb9d4b None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:01:12.660149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-dc8e4fc7-b7ea-4068-987d-49149fcb9d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:01:12.729608 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e4fc7-b7ea-4068-987d-49149fcb9d4b None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:01:12.735392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a94d9-8371-4264-9c6e-6e75a5c05ab1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:01:12.736016 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a94d9-8371-4264-9c6e-6e75a5c05ab1 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:12.736298 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a94d9-8371-4264-9c6e-6e75a5c05ab1 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:12.736570 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a94d9-8371-4264-9c6e-6e75a5c05ab1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:12.744257 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a94d9-8371-4264-9c6e-6e75a5c05ab1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:01:12.745894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a94d9-8371-4264-9c6e-6e75a5c05ab1 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:01:12.755686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 754/1517] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:01:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:01:14.236838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa44096-7343-465b-9386-a561755093cf None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:14.237243 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa44096-7343-465b-9386-a561755093cf None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:14.237390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa44096-7343-465b-9386-a561755093cf None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:14.239203 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 764/1518] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 03:01:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:01:14.244380 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66707ab-ba8e-48a0-b0c8-e1d8f795ef6c None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:14.244783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66707ab-ba8e-48a0-b0c8-e1d8f795ef6c None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:14.244927 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66707ab-ba8e-48a0-b0c8-e1d8f795ef6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:14.263360 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-b66707ab-ba8e-48a0-b0c8-e1d8f795ef6c None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:01:14.264529 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b66707ab-ba8e-48a0-b0c8-e1d8f795ef6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:01:14.272063 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 755/1519] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 03:01:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:01:14.425398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa44096-7343-465b-9386-a561755093cf None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:01:14.439187 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa44096-7343-465b-9386-a561755093cf None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:01:14.444423 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74928548-2a26-4779-9b8e-5b3583961e7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:01:14.445065 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74928548-2a26-4779-9b8e-5b3583961e7e service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:14.445342 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74928548-2a26-4779-9b8e-5b3583961e7e service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:14.445613 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74928548-2a26-4779-9b8e-5b3583961e7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:14.453398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74928548-2a26-4779-9b8e-5b3583961e7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:01:14.454997 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74928548-2a26-4779-9b8e-5b3583961e7e service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:01:14.463951 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 765/1520] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:01:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:01:21.110977 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bb35a-c344-4de6-b1bb-038b157fb13e None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:21.111434 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bb35a-c344-4de6-b1bb-038b157fb13e None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:21.111550 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bb35a-c344-4de6-b1bb-038b157fb13e None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:21.113356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 756/1521] 10.222.0.18 () {54 vars in 960 bytes} [Wed Dec 15 03:01:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:01:21.118780 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfae24-a570-4fc2-8a91-77b48ec2bc80 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:21.120064 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfae24-a570-4fc2-8a91-77b48ec2bc80 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:21.120341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfae24-a570-4fc2-8a91-77b48ec2bc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:21.138793 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-2ddfae24-a570-4fc2-8a91-77b48ec2bc80 None None] MFA Rules not processed for user `93762c21f03d44d5bf3881d17e14ef90`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:01:21.139982 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-2ddfae24-a570-4fc2-8a91-77b48ec2bc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:01:21.149874 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 766/1522] 10.222.0.18 () {58 vars in 1057 bytes} [Wed Dec 15 03:01:21 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:01:21.157401 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bb35a-c344-4de6-b1bb-038b157fb13e None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:01:21.170205 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bb35a-c344-4de6-b1bb-038b157fb13e None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:01:21.174986 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c245968-8175-4cfb-8a09-51afe79d8124 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93762c21f03d44d5bf3881d17e14ef90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:01:21.175601 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c245968-8175-4cfb-8a09-51afe79d8124 service placement] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:21.175880 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c245968-8175-4cfb-8a09-51afe79d8124 service placement] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:21.176153 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c245968-8175-4cfb-8a09-51afe79d8124 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:21.184011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c245968-8175-4cfb-8a09-51afe79d8124 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:01:21.185596 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c245968-8175-4cfb-8a09-51afe79d8124 service placement] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:01:21.195340 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 757/1523] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:01:21 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:01:26.383117 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f98a2d-3fa4-4ea4-91c9-d15be66358bc None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:26.383690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f98a2d-3fa4-4ea4-91c9-d15be66358bc None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:26.383690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f98a2d-3fa4-4ea4-91c9-d15be66358bc None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:26.385475 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 767/1524] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 03:01:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:01:26.390625 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e1bf9-722d-4c65-9033-3872de0eee1a None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:26.391066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e1bf9-722d-4c65-9033-3872de0eee1a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:26.391173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e1bf9-722d-4c65-9033-3872de0eee1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:26.409020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c46e1bf9-722d-4c65-9033-3872de0eee1a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:01:26.410210 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c46e1bf9-722d-4c65-9033-3872de0eee1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:01:26.417640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 758/1525] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 03:01:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:01:26.573232 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f98a2d-3fa4-4ea4-91c9-d15be66358bc None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:01:26.587543 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f98a2d-3fa4-4ea4-91c9-d15be66358bc None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:01:26.592815 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8f9c6-0d75-4947-b621-1a32fd61cf23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:01:26.593439 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f9c6-0d75-4947-b621-1a32fd61cf23 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:26.593717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f9c6-0d75-4947-b621-1a32fd61cf23 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:26.594608 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f9c6-0d75-4947-b621-1a32fd61cf23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:26.602434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8f9c6-0d75-4947-b621-1a32fd61cf23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:01:26.603994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8f9c6-0d75-4947-b621-1a32fd61cf23 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:01:26.612991 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 768/1526] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:01:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:01:28.073952 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a18fc8-7298-4b69-98d4-c7b7557371f4 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:28.074558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a18fc8-7298-4b69-98d4-c7b7557371f4 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:28.074558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a18fc8-7298-4b69-98d4-c7b7557371f4 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:28.076343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 759/1527] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 03:01:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:01:28.082189 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcae454-e0ef-485c-a217-fac3c7c2524a None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:28.082621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcae454-e0ef-485c-a217-fac3c7c2524a None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:28.082803 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcae454-e0ef-485c-a217-fac3c7c2524a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:28.101085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-8dcae454-e0ef-485c-a217-fac3c7c2524a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:01:28.102279 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-8dcae454-e0ef-485c-a217-fac3c7c2524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:01:28.109865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 769/1528] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 03:01:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:01:28.262245 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a18fc8-7298-4b69-98d4-c7b7557371f4 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:01:28.276947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a18fc8-7298-4b69-98d4-c7b7557371f4 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:01:28.282985 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2313f40-e063-4ef8-ad12-c2d4eb135735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:01:28.283598 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2313f40-e063-4ef8-ad12-c2d4eb135735 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:28.283876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2313f40-e063-4ef8-ad12-c2d4eb135735 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:28.284144 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2313f40-e063-4ef8-ad12-c2d4eb135735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:28.291898 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2313f40-e063-4ef8-ad12-c2d4eb135735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:01:28.293465 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2313f40-e063-4ef8-ad12-c2d4eb135735 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:01:28.302427 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 760/1529] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:01:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:01:32.579040 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05895a3-0d72-4b93-a60c-fa211226bfab None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:32.580066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05895a3-0d72-4b93-a60c-fa211226bfab None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:32.580066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05895a3-0d72-4b93-a60c-fa211226bfab None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:32.581901 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 770/1530] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 03:01:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:01:32.587650 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2974f7-069a-45ed-ac00-450690485b3a None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:32.588044 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2974f7-069a-45ed-ac00-450690485b3a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:32.588221 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2974f7-069a-45ed-ac00-450690485b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:32.606467 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-1b2974f7-069a-45ed-ac00-450690485b3a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:01:32.607635 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1b2974f7-069a-45ed-ac00-450690485b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:01:32.615180 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 761/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 03:01:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:01:32.653132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05895a3-0d72-4b93-a60c-fa211226bfab None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:01:32.654802 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a05895a3-0d72-4b93-a60c-fa211226bfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:01:32.709196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05895a3-0d72-4b93-a60c-fa211226bfab None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:01:32.712693 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ee263-7220-4cec-83e8-e8bdda440d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:01:32.713320 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ee263-7220-4cec-83e8-e8bdda440d64 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:32.713598 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ee263-7220-4cec-83e8-e8bdda440d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:32.713875 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ee263-7220-4cec-83e8-e8bdda440d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:32.723037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ee263-7220-4cec-83e8-e8bdda440d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:01:32.724447 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ee263-7220-4cec-83e8-e8bdda440d64 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:01:32.733684 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 771/1532] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:01:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:01:35.038104 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ffe65-6861-43ab-a552-4bd5c4d54387 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:35.038675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ffe65-6861-43ab-a552-4bd5c4d54387 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:35.038791 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ffe65-6861-43ab-a552-4bd5c4d54387 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:35.040604 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 762/1533] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 03:01:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:01:35.046591 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01471614-296b-476b-b97b-416bb8da56f6 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:35.047044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01471614-296b-476b-b97b-416bb8da56f6 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:35.047151 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01471614-296b-476b-b97b-416bb8da56f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:35.064681 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-01471614-296b-476b-b97b-416bb8da56f6 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:01:35.065848 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-01471614-296b-476b-b97b-416bb8da56f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:01:35.073379 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 772/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 03:01:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:01:35.111259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ffe65-6861-43ab-a552-4bd5c4d54387 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:01:35.121493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ffe65-6861-43ab-a552-4bd5c4d54387 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:01:35.125167 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab012ad-d1fb-4c29-b53f-5e9cf90fc2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:01:35.125782 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab012ad-d1fb-4c29-b53f-5e9cf90fc2bc service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:35.126090 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab012ad-d1fb-4c29-b53f-5e9cf90fc2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:35.126414 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab012ad-d1fb-4c29-b53f-5e9cf90fc2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:35.134816 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab012ad-d1fb-4c29-b53f-5e9cf90fc2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:01:35.136233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab012ad-d1fb-4c29-b53f-5e9cf90fc2bc service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:01:35.145630 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 763/1535] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:01:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:01:38.850642 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd0a8-32cd-4c00-b022-403a8d643102 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:38.851197 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd0a8-32cd-4c00-b022-403a8d643102 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:38.851313 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd0a8-32cd-4c00-b022-403a8d643102 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:38.853054 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 773/1536] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 03:01:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:01:38.858784 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd438e0e-bb60-48fd-906c-25f677e05fc2 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:38.859223 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd438e0e-bb60-48fd-906c-25f677e05fc2 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:38.859333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd438e0e-bb60-48fd-906c-25f677e05fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:38.880352 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-fd438e0e-bb60-48fd-906c-25f677e05fc2 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:01:38.881562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-fd438e0e-bb60-48fd-906c-25f677e05fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:01:38.889252 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 764/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 03:01:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:01:38.945119 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dd0a8-32cd-4c00-b022-403a8d643102 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:01:38.946774 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-097dd0a8-32cd-4c00-b022-403a8d643102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:01:39.001053 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dd0a8-32cd-4c00-b022-403a8d643102 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:01:39.004616 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c175fda-2938-467c-a4a8-dd45fbd9647e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:01:39.005238 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c175fda-2938-467c-a4a8-dd45fbd9647e service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:39.005519 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c175fda-2938-467c-a4a8-dd45fbd9647e service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:39.005795 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c175fda-2938-467c-a4a8-dd45fbd9647e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:39.014618 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c175fda-2938-467c-a4a8-dd45fbd9647e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:01:39.016029 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c175fda-2938-467c-a4a8-dd45fbd9647e service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:01:39.025084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 774/1538] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:01:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:01:41.356806 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba261c-3fe7-4f6a-887a-88c47aa0ce2b None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:41.357329 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba261c-3fe7-4f6a-887a-88c47aa0ce2b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:41.357329 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba261c-3fe7-4f6a-887a-88c47aa0ce2b None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:41.359140 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 765/1539] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 03:01:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:01:41.365395 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33cb30-874c-4cea-8479-db1d6c309ae1 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:41.365851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33cb30-874c-4cea-8479-db1d6c309ae1 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:41.365949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33cb30-874c-4cea-8479-db1d6c309ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:41.384330 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-bc33cb30-874c-4cea-8479-db1d6c309ae1 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:01:41.385487 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-bc33cb30-874c-4cea-8479-db1d6c309ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:01:41.394681 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 775/1540] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 03:01:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:01:41.444014 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbb45c-8e9f-47d6-a517-8cbfb6b9067e None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:41.444295 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbb45c-8e9f-47d6-a517-8cbfb6b9067e None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:41.444595 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbb45c-8e9f-47d6-a517-8cbfb6b9067e None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:41.446416 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 766/1541] 10.222.0.18 () {54 vars in 963 bytes} [Wed Dec 15 03:01:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:01:41.451464 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0eab9-6a69-413c-941b-28ac64cc29c3 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:41.451753 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0eab9-6a69-413c-941b-28ac64cc29c3 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:41.452033 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0eab9-6a69-413c-941b-28ac64cc29c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:41.470985 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-b8c0eab9-6a69-413c-941b-28ac64cc29c3 None None] MFA Rules not processed for user `d543ba91ee284c1384f15fb70910caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:01:41.472077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b8c0eab9-6a69-413c-941b-28ac64cc29c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:01:41.478365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 776/1542] 10.222.0.18 () {58 vars in 1060 bytes} [Wed Dec 15 03:01:41 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:01:41.486491 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbb45c-8e9f-47d6-a517-8cbfb6b9067e None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:01:41.496742 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbb45c-8e9f-47d6-a517-8cbfb6b9067e None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:01:41.500481 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d02c4-8815-4253-8a80-ea3bbe37e6cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:01:41.501128 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d02c4-8815-4253-8a80-ea3bbe37e6cb service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:01:41.501415 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d02c4-8815-4253-8a80-ea3bbe37e6cb service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:01:41.501688 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d02c4-8815-4253-8a80-ea3bbe37e6cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:01:41.510295 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d02c4-8815-4253-8a80-ea3bbe37e6cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:01:41.511703 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d02c4-8815-4253-8a80-ea3bbe37e6cb service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:01:41.521374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 767/1543] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:01:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:01.996768 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cded770-bbf1-4f49-aa9c-407bc3d5a9f8 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.012035 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cded770-bbf1-4f49-aa9c-407bc3d5a9f8 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.012035 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cded770-bbf1-4f49-aa9c-407bc3d5a9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.012255 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b52201-1d2f-4547-94cd-7b1006f95965 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.012255 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b52201-1d2f-4547-94cd-7b1006f95965 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.012255 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b52201-1d2f-4547-94cd-7b1006f95965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.022399 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-5cded770-bbf1-4f49-aa9c-407bc3d5a9f8 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:02.023594 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5cded770-bbf1-4f49-aa9c-407bc3d5a9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:02.037710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-47b52201-1d2f-4547-94cd-7b1006f95965 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:02.039228 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-47b52201-1d2f-4547-94cd-7b1006f95965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:02.040510 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 777/1544] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:02.049553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ded6b-ccad-4065-848b-fe1e8d2127c4 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.049843 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ded6b-ccad-4065-848b-fe1e8d2127c4 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.050153 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ded6b-ccad-4065-848b-fe1e8d2127c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.056627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 768/1545] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:02.065822 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f0a83-fb38-4aa4-849a-47f840a0b1c7 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.074116 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f0a83-fb38-4aa4-849a-47f840a0b1c7 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.074116 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f0a83-fb38-4aa4-849a-47f840a0b1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.083220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-8f9ded6b-ccad-4065-848b-fe1e8d2127c4 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:02.084417 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-8f9ded6b-ccad-4065-848b-fe1e8d2127c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:02.098705 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-b44f0a83-fb38-4aa4-849a-47f840a0b1c7 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:02.100288 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b44f0a83-fb38-4aa4-849a-47f840a0b1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:02.103403 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 778/1546] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:02.112048 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ded6b-ccad-4065-848b-fe1e8d2127c4 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.116309 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 769/1547] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:03:02.121651 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f0a83-fb38-4aa4-849a-47f840a0b1c7 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.128770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ded6b-ccad-4065-848b-fe1e8d2127c4 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.137143 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f0a83-fb38-4aa4-849a-47f840a0b1c7 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.142792 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c223da-f6a0-4f9b-a098-989aaaf7f250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.143604 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c223da-f6a0-4f9b-a098-989aaaf7f250 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.143890 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c223da-f6a0-4f9b-a098-989aaaf7f250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.144166 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c223da-f6a0-4f9b-a098-989aaaf7f250 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.144912 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c223da-f6a0-4f9b-a098-989aaaf7f250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:02.145225 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c223da-f6a0-4f9b-a098-989aaaf7f250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.145883 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de5b3d-60a1-48da-a351-bb8b04953ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.146579 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de5b3d-60a1-48da-a351-bb8b04953ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.149206 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c223da-f6a0-4f9b-a098-989aaaf7f250 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.149320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de5b3d-60a1-48da-a351-bb8b04953ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.149320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de5b3d-60a1-48da-a351-bb8b04953ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.149320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de5b3d-60a1-48da-a351-bb8b04953ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:02.149320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de5b3d-60a1-48da-a351-bb8b04953ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.149908 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de5b3d-60a1-48da-a351-bb8b04953ec7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.174035 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 770/1548] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 03:03:02.175206 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae68f2-9679-47a6-839c-c5f20a43f721 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.175495 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae68f2-9679-47a6-839c-c5f20a43f721 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.175778 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae68f2-9679-47a6-839c-c5f20a43f721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.179173 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 779/1549] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 03:03:02.180466 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea80e4f-0cb5-473c-8070-c50703b66a9c None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.180751 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea80e4f-0cb5-473c-8070-c50703b66a9c None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.181028 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea80e4f-0cb5-473c-8070-c50703b66a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.228001 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-eea80e4f-0cb5-473c-8070-c50703b66a9c None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:02.229219 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-eea80e4f-0cb5-473c-8070-c50703b66a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:02.231123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-9cae68f2-9679-47a6-839c-c5f20a43f721 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:02.232480 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9cae68f2-9679-47a6-839c-c5f20a43f721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:02.244304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 780/1550] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:02.245092 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea80e4f-0cb5-473c-8070-c50703b66a9c None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.252021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 771/1551] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:02.252810 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae68f2-9679-47a6-839c-c5f20a43f721 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.263718 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea80e4f-0cb5-473c-8070-c50703b66a9c None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.270257 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae68f2-9679-47a6-839c-c5f20a43f721 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.277428 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b296483-4d8d-43d3-b4f2-34a97bb21fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.278119 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b296483-4d8d-43d3-b4f2-34a97bb21fbe admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.278405 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b296483-4d8d-43d3-b4f2-34a97bb21fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.278680 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b296483-4d8d-43d3-b4f2-34a97bb21fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.279395 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b296483-4d8d-43d3-b4f2-34a97bb21fbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.280999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b87db7-7f10-49d6-ae00-c8b5dd3e986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.281681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b87db7-7f10-49d6-ae00-c8b5dd3e986c admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.281877 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b296483-4d8d-43d3-b4f2-34a97bb21fbe admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.282010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b87db7-7f10-49d6-ae00-c8b5dd3e986c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.282251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b87db7-7f10-49d6-ae00-c8b5dd3e986c admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.282962 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b87db7-7f10-49d6-ae00-c8b5dd3e986c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.285224 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b87db7-7f10-49d6-ae00-c8b5dd3e986c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.313814 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 781/1552] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:02.315289 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9da6cf-2d2e-4ffb-924b-0652e04a0b1d None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.315713 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9da6cf-2d2e-4ffb-924b-0652e04a0b1d None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.316150 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9da6cf-2d2e-4ffb-924b-0652e04a0b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.318814 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 772/1553] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:02.320602 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2ed10-e04e-44e3-b165-33d43047dad1 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.320998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2ed10-e04e-44e3-b165-33d43047dad1 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.321639 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2ed10-e04e-44e3-b165-33d43047dad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.348358 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-5d9da6cf-2d2e-4ffb-924b-0652e04a0b1d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:02.348574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c7a2ed10-e04e-44e3-b165-33d43047dad1 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:02.349565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5d9da6cf-2d2e-4ffb-924b-0652e04a0b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:02.350157 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c7a2ed10-e04e-44e3-b165-33d43047dad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:02.411889 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 773/1554] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:02.413327 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57725718-bb18-4dd5-93c8-75454a5835fa None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.413671 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57725718-bb18-4dd5-93c8-75454a5835fa None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.413896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57725718-bb18-4dd5-93c8-75454a5835fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.421253 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 782/1555] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:02.421253 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ce468-206b-4409-abb4-9d09d57f4650 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.421253 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ce468-206b-4409-abb4-9d09d57f4650 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.421253 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ce468-206b-4409-abb4-9d09d57f4650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.437635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-846ce468-206b-4409-abb4-9d09d57f4650 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:02.437942 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-57725718-bb18-4dd5-93c8-75454a5835fa None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:02.438954 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-846ce468-206b-4409-abb4-9d09d57f4650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:02.439094 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-57725718-bb18-4dd5-93c8-75454a5835fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:02.446795 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 774/1556] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:02.446977 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 783/1557] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:02.447535 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57725718-bb18-4dd5-93c8-75454a5835fa None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.448092 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ce468-206b-4409-abb4-9d09d57f4650 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.457687 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ce468-206b-4409-abb4-9d09d57f4650 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.462277 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b6057-ecce-461c-a8fa-d0f51cf8f31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.462507 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57725718-bb18-4dd5-93c8-75454a5835fa None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.462924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b6057-ecce-461c-a8fa-d0f51cf8f31d admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.463212 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b6057-ecce-461c-a8fa-d0f51cf8f31d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.463489 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b6057-ecce-461c-a8fa-d0f51cf8f31d admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.464228 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b6057-ecce-461c-a8fa-d0f51cf8f31d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.466099 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b6057-ecce-461c-a8fa-d0f51cf8f31d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.466972 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d239c58-83d2-4f4a-ba55-f7eabe95bc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.468144 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d239c58-83d2-4f4a-ba55-f7eabe95bc22 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.468418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d239c58-83d2-4f4a-ba55-f7eabe95bc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.468686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d239c58-83d2-4f4a-ba55-f7eabe95bc22 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.469364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d239c58-83d2-4f4a-ba55-f7eabe95bc22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.471273 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d239c58-83d2-4f4a-ba55-f7eabe95bc22 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.486953 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 784/1558] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/users => generated 283 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:02.488177 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d8808-560b-4c8a-9aa8-208bf9cb75e2 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.488468 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d8808-560b-4c8a-9aa8-208bf9cb75e2 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.488748 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d8808-560b-4c8a-9aa8-208bf9cb75e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.490527 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 775/1559] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/users => generated 284 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:02.491760 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbcafc-9221-4625-b4f2-dbfa9e645faa None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.492090 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbcafc-9221-4625-b4f2-dbfa9e645faa None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.492311 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbcafc-9221-4625-b4f2-dbfa9e645faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.507029 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-3e6d8808-560b-4c8a-9aa8-208bf9cb75e2 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:02.508141 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3e6d8808-560b-4c8a-9aa8-208bf9cb75e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:02.509690 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-42cbcafc-9221-4625-b4f2-dbfa9e645faa None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:02.510890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-42cbcafc-9221-4625-b4f2-dbfa9e645faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:02.516397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 785/1560] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:02.517155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d8808-560b-4c8a-9aa8-208bf9cb75e2 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.522217 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 776/1561] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:02.522217 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0956465-97fb-4e85-8284-f0d9d22bd374 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.522217 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0956465-97fb-4e85-8284-f0d9d22bd374 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.522217 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0956465-97fb-4e85-8284-f0d9d22bd374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.527171 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d8808-560b-4c8a-9aa8-208bf9cb75e2 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.532250 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3c528-7458-44f8-82b1-d9a9733a1e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.532881 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3c528-7458-44f8-82b1-d9a9733a1e2b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.533160 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3c528-7458-44f8-82b1-d9a9733a1e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.533429 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3c528-7458-44f8-82b1-d9a9733a1e2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.534190 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3c528-7458-44f8-82b1-d9a9733a1e2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:02.534489 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3c528-7458-44f8-82b1-d9a9733a1e2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.536067 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3c528-7458-44f8-82b1-d9a9733a1e2b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.542392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-a0956465-97fb-4e85-8284-f0d9d22bd374 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:02.543680 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-a0956465-97fb-4e85-8284-f0d9d22bd374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:02.547433 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 786/1562] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:02.548220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3c528-7458-44f8-82b1-d9a9733a1e2b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.555003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 777/1563] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:02.555003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cb2d7-7877-4791-a1c6-7bab4cd933c2 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.555003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cb2d7-7877-4791-a1c6-7bab4cd933c2 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.555003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cb2d7-7877-4791-a1c6-7bab4cd933c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.559965 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3c528-7458-44f8-82b1-d9a9733a1e2b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.565088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c5897-67e4-4904-b4e7-dc6fb0a4b8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.565425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c5897-67e4-4904-b4e7-dc6fb0a4b8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.565714 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c5897-67e4-4904-b4e7-dc6fb0a4b8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.566277 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c5897-67e4-4904-b4e7-dc6fb0a4b8b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.566950 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c5897-67e4-4904-b4e7-dc6fb0a4b8b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:02.567237 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c5897-67e4-4904-b4e7-dc6fb0a4b8b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.568841 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c5897-67e4-4904-b4e7-dc6fb0a4b8b6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.571127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-d25cb2d7-7877-4791-a1c6-7bab4cd933c2 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:02.572278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d25cb2d7-7877-4791-a1c6-7bab4cd933c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:02.580618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 778/1564] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:02.581404 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 787/1565] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:02.582115 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cb2d7-7877-4791-a1c6-7bab4cd933c2 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.582298 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c5897-67e4-4904-b4e7-dc6fb0a4b8b6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.591873 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cb2d7-7877-4791-a1c6-7bab4cd933c2 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.593788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c5897-67e4-4904-b4e7-dc6fb0a4b8b6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.596824 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac73599-1f9b-45b5-b4f5-464ec793530e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.597454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac73599-1f9b-45b5-b4f5-464ec793530e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.597732 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac73599-1f9b-45b5-b4f5-464ec793530e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.598019 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac73599-1f9b-45b5-b4f5-464ec793530e admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.598493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92593b2e-a1a9-4720-9dc8-24371d7c465f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.598745 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac73599-1f9b-45b5-b4f5-464ec793530e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.599287 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92593b2e-a1a9-4720-9dc8-24371d7c465f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.599641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92593b2e-a1a9-4720-9dc8-24371d7c465f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.599993 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92593b2e-a1a9-4720-9dc8-24371d7c465f admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.600326 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac73599-1f9b-45b5-b4f5-464ec793530e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.600858 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92593b2e-a1a9-4720-9dc8-24371d7c465f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.602588 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92593b2e-a1a9-4720-9dc8-24371d7c465f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.610220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 779/1566] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:02.611392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae0923-d5cc-4af3-91c8-f0713b189acf None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.611673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae0923-d5cc-4af3-91c8-f0713b189acf None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.611943 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae0923-d5cc-4af3-91c8-f0713b189acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.612505 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 788/1567] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:02.615437 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399039-09f8-4d6f-ac24-e8c2201295a1 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.615726 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399039-09f8-4d6f-ac24-e8c2201295a1 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.616007 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399039-09f8-4d6f-ac24-e8c2201295a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.630580 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-b2ae0923-d5cc-4af3-91c8-f0713b189acf None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:02.631756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b2ae0923-d5cc-4af3-91c8-f0713b189acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:02.633572 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-9f399039-09f8-4d6f-ac24-e8c2201295a1 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:02.634769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-9f399039-09f8-4d6f-ac24-e8c2201295a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:02.640028 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 780/1568] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:02.640580 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae0923-d5cc-4af3-91c8-f0713b189acf None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.645162 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 789/1569] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:02.645162 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f399039-09f8-4d6f-ac24-e8c2201295a1 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.649460 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae0923-d5cc-4af3-91c8-f0713b189acf None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.653772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f399039-09f8-4d6f-ac24-e8c2201295a1 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.653914 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f9ccb-306c-4d93-a923-bb2bb08b71b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.654538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f9ccb-306c-4d93-a923-bb2bb08b71b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.654882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f9ccb-306c-4d93-a923-bb2bb08b71b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.655652 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f9ccb-306c-4d93-a923-bb2bb08b71b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.656333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f9ccb-306c-4d93-a923-bb2bb08b71b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.658264 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f9ccb-306c-4d93-a923-bb2bb08b71b8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.659082 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed800b-9052-4210-9f8f-2405632d2846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.659709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed800b-9052-4210-9f8f-2405632d2846 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.659991 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed800b-9052-4210-9f8f-2405632d2846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.660266 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed800b-9052-4210-9f8f-2405632d2846 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.660987 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed800b-9052-4210-9f8f-2405632d2846 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:02.661295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed800b-9052-4210-9f8f-2405632d2846 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.662885 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed800b-9052-4210-9f8f-2405632d2846 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.674534 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 790/1570] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:02.675331 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed800b-9052-4210-9f8f-2405632d2846 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.683690 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 781/1571] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/projects => generated 393 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:02.684608 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed800b-9052-4210-9f8f-2405632d2846 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.684770 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f9ccb-306c-4d93-a923-bb2bb08b71b8 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.738004 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261432f0-593e-41b4-94ca-7da0b7cca3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.738667 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261432f0-593e-41b4-94ca-7da0b7cca3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.738950 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261432f0-593e-41b4-94ca-7da0b7cca3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.739231 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261432f0-593e-41b4-94ca-7da0b7cca3b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.739959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261432f0-593e-41b4-94ca-7da0b7cca3b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:02.740267 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261432f0-593e-41b4-94ca-7da0b7cca3b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.741860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261432f0-593e-41b4-94ca-7da0b7cca3b0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.742768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f9ccb-306c-4d93-a923-bb2bb08b71b8 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.747314 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd195cc-1736-42f7-9f89-83b28948d966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.747957 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd195cc-1736-42f7-9f89-83b28948d966 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.748238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd195cc-1736-42f7-9f89-83b28948d966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.748769 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd195cc-1736-42f7-9f89-83b28948d966 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.749458 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd195cc-1736-42f7-9f89-83b28948d966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.751390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd195cc-1736-42f7-9f89-83b28948d966 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.753371 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 791/1572] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:02.754349 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261432f0-593e-41b4-94ca-7da0b7cca3b0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.763496 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261432f0-593e-41b4-94ca-7da0b7cca3b0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.768469 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c69f0-ff0b-4b03-a968-05010dc4fe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.769126 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c69f0-ff0b-4b03-a968-05010dc4fe01 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.769459 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c69f0-ff0b-4b03-a968-05010dc4fe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.769673 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c69f0-ff0b-4b03-a968-05010dc4fe01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.770431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c69f0-ff0b-4b03-a968-05010dc4fe01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.772026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c69f0-ff0b-4b03-a968-05010dc4fe01 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.778557 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 782/1573] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/projects => generated 393 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:02.779930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd195cc-1736-42f7-9f89-83b28948d966 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.783529 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 792/1574] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:02.784269 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c69f0-ff0b-4b03-a968-05010dc4fe01 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.793665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c69f0-ff0b-4b03-a968-05010dc4fe01 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.838858 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd195cc-1736-42f7-9f89-83b28948d966 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.843863 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef68350-9d37-446b-aca0-948cdd7df653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.844507 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef68350-9d37-446b-aca0-948cdd7df653 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.844786 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef68350-9d37-446b-aca0-948cdd7df653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.845060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef68350-9d37-446b-aca0-948cdd7df653 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.845783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef68350-9d37-446b-aca0-948cdd7df653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.846425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b069f51-3789-46fe-8483-829404e2ec20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.847070 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069f51-3789-46fe-8483-829404e2ec20 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.847356 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069f51-3789-46fe-8483-829404e2ec20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.847465 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef68350-9d37-446b-aca0-948cdd7df653 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.847637 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069f51-3789-46fe-8483-829404e2ec20 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.848367 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b069f51-3789-46fe-8483-829404e2ec20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:02.848672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b069f51-3789-46fe-8483-829404e2ec20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.850268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b069f51-3789-46fe-8483-829404e2ec20 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.857586 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 783/1575] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:02 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:02.857586 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef68350-9d37-446b-aca0-948cdd7df653 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.864405 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 793/1576] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:02.865180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b069f51-3789-46fe-8483-829404e2ec20 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.867391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef68350-9d37-446b-aca0-948cdd7df653 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.871880 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab61251-a627-4c47-9051-b5e466f8a6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.872510 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab61251-a627-4c47-9051-b5e466f8a6da admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.872790 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab61251-a627-4c47-9051-b5e466f8a6da admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.873064 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab61251-a627-4c47-9051-b5e466f8a6da admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.874564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab61251-a627-4c47-9051-b5e466f8a6da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:02.874870 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab61251-a627-4c47-9051-b5e466f8a6da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.876449 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab61251-a627-4c47-9051-b5e466f8a6da admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.877270 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b069f51-3789-46fe-8483-829404e2ec20 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.881762 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdc4c1-fb23-431e-97a9-34534c74837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.882412 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdc4c1-fb23-431e-97a9-34534c74837c admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.882687 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdc4c1-fb23-431e-97a9-34534c74837c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.882956 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdc4c1-fb23-431e-97a9-34534c74837c admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.883639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdc4c1-fb23-431e-97a9-34534c74837c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.885476 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdc4c1-fb23-431e-97a9-34534c74837c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.895149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 784/1577] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:02.895149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab61251-a627-4c47-9051-b5e466f8a6da admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.898502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab61251-a627-4c47-9051-b5e466f8a6da admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.903616 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5c194-73d0-4aec-9a55-62b54458b719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.904253 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c194-73d0-4aec-9a55-62b54458b719 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.904536 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c194-73d0-4aec-9a55-62b54458b719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.904837 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c194-73d0-4aec-9a55-62b54458b719 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.905743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5c194-73d0-4aec-9a55-62b54458b719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.907695 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5c194-73d0-4aec-9a55-62b54458b719 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.914374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 794/1578] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:02.914374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdc4c1-fb23-431e-97a9-34534c74837c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.927714 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 785/1579] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/users => generated 297 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:02.928614 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5c194-73d0-4aec-9a55-62b54458b719 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:02.939043 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5c194-73d0-4aec-9a55-62b54458b719 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.971286 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdc4c1-fb23-431e-97a9-34534c74837c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:02.975838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbccc9-5aeb-4617-8920-8004a3a71348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.976485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbccc9-5aeb-4617-8920-8004a3a71348 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.976766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbccc9-5aeb-4617-8920-8004a3a71348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.977042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbccc9-5aeb-4617-8920-8004a3a71348 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.977736 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbccc9-5aeb-4617-8920-8004a3a71348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.979674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbccc9-5aeb-4617-8920-8004a3a71348 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:02.991217 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32031ce2-bd5d-429a-92aa-b2eee1badb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:02.991882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32031ce2-bd5d-429a-92aa-b2eee1badb2f admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:02.992162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32031ce2-bd5d-429a-92aa-b2eee1badb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:02.992437 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32031ce2-bd5d-429a-92aa-b2eee1badb2f admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:02.993166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32031ce2-bd5d-429a-92aa-b2eee1badb2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:02.995345 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32031ce2-bd5d-429a-92aa-b2eee1badb2f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.004507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 795/1580] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:03.005135 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbccc9-5aeb-4617-8920-8004a3a71348 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.024567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 786/1581] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:02 2021] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:03.024567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32031ce2-bd5d-429a-92aa-b2eee1badb2f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.031622 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32031ce2-bd5d-429a-92aa-b2eee1badb2f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.069559 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbccc9-5aeb-4617-8920-8004a3a71348 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.074255 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc24cd-185d-45fc-ab1d-6392816ddc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.075135 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc24cd-185d-45fc-ab1d-6392816ddc64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.075414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc24cd-185d-45fc-ab1d-6392816ddc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.075689 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc24cd-185d-45fc-ab1d-6392816ddc64 admin admin] PATH_INFO: `/v3/projects/7b807e9c11e54d378da0f2662cba831e/users/e0a65f212e9a4ae5a4aa8e7b020d52ac/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.085743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a9c7f-d68e-49d0-84ed-5bbeff0969e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.086714 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9c7f-d68e-49d0-84ed-5bbeff0969e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.086995 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9c7f-d68e-49d0-84ed-5bbeff0969e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.087272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9c7f-d68e-49d0-84ed-5bbeff0969e3 admin admin] PATH_INFO: `/v3/projects/18d37b4bb54a44adb94a88be4573899c/users/05b7cb1174744379a22820fd06e7c99b/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.090899 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc24cd-185d-45fc-ab1d-6392816ddc64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b807e9c11e54d378da0f2662cba831e, user_id=e0a65f212e9a4ae5a4aa8e7b020d52ac, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.093573 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc24cd-185d-45fc-ab1d-6392816ddc64 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.101072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a9c7f-d68e-49d0-84ed-5bbeff0969e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d37b4bb54a44adb94a88be4573899c, user_id=05b7cb1174744379a22820fd06e7c99b, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.103747 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a9c7f-d68e-49d0-84ed-5bbeff0969e3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.106118 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 796/1582] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:03 2021] PUT /identity/v3/projects/7b807e9c11e54d378da0f2662cba831e/users/e0a65f212e9a4ae5a4aa8e7b020d52ac/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:03.107049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc24cd-185d-45fc-ab1d-6392816ddc64 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.127643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 787/1583] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:03 2021] PUT /identity/v3/projects/18d37b4bb54a44adb94a88be4573899c/users/05b7cb1174744379a22820fd06e7c99b/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:03.128369 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a9c7f-d68e-49d0-84ed-5bbeff0969e3 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.166874 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc24cd-185d-45fc-ab1d-6392816ddc64 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.194820 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a9c7f-d68e-49d0-84ed-5bbeff0969e3 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.199540 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127676d4-4c4e-459b-a20f-ac0a998e0b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.200202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127676d4-4c4e-459b-a20f-ac0a998e0b64 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.200486 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127676d4-4c4e-459b-a20f-ac0a998e0b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.200766 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127676d4-4c4e-459b-a20f-ac0a998e0b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.201468 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127676d4-4c4e-459b-a20f-ac0a998e0b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.203990 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127676d4-4c4e-459b-a20f-ac0a998e0b64 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.219709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05414b7-5c16-4639-802e-d4279cd63812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.220409 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05414b7-5c16-4639-802e-d4279cd63812 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.220735 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05414b7-5c16-4639-802e-d4279cd63812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.221010 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05414b7-5c16-4639-802e-d4279cd63812 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.221743 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05414b7-5c16-4639-802e-d4279cd63812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.223664 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05414b7-5c16-4639-802e-d4279cd63812 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.228707 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 788/1584] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:03 2021] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:03.229580 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127676d4-4c4e-459b-a20f-ac0a998e0b64 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.249466 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 797/1585] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:03 2021] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:03.250435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05414b7-5c16-4639-802e-d4279cd63812 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.288745 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127676d4-4c4e-459b-a20f-ac0a998e0b64 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.312141 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05414b7-5c16-4639-802e-d4279cd63812 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.316785 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53081884-e8b3-4df8-a9fa-d555f06fc285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.317442 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53081884-e8b3-4df8-a9fa-d555f06fc285 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.317717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53081884-e8b3-4df8-a9fa-d555f06fc285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.318036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53081884-e8b3-4df8-a9fa-d555f06fc285 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.318796 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53081884-e8b3-4df8-a9fa-d555f06fc285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.320361 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53081884-e8b3-4df8-a9fa-d555f06fc285 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.329867 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 798/1586] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:03 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:03.330825 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53081884-e8b3-4df8-a9fa-d555f06fc285 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.339876 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53081884-e8b3-4df8-a9fa-d555f06fc285 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.343172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a94b45-d55a-439e-b47d-80f8bbd5292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.343850 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a94b45-d55a-439e-b47d-80f8bbd5292a admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.344119 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a94b45-d55a-439e-b47d-80f8bbd5292a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.344389 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a94b45-d55a-439e-b47d-80f8bbd5292a admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.344533 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28675c91-6954-4f00-99fb-80a851da81ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.345109 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a94b45-d55a-439e-b47d-80f8bbd5292a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.345206 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28675c91-6954-4f00-99fb-80a851da81ed admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.345414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28675c91-6954-4f00-99fb-80a851da81ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.345689 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28675c91-6954-4f00-99fb-80a851da81ed admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.346402 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28675c91-6954-4f00-99fb-80a851da81ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.347071 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a94b45-d55a-439e-b47d-80f8bbd5292a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.348266 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28675c91-6954-4f00-99fb-80a851da81ed admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.367864 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 789/1587] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:03 2021] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:03.371867 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 799/1588] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:03 2021] POST /identity/v3/users => generated 293 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:03.372025 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a94b45-d55a-439e-b47d-80f8bbd5292a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.372124 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead8111-c079-4987-874b-6af5e75d4118 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.372124 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead8111-c079-4987-874b-6af5e75d4118 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.372124 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead8111-c079-4987-874b-6af5e75d4118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.381535 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a94b45-d55a-439e-b47d-80f8bbd5292a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.386230 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ded685-b7c3-41bb-a125-8043c09ba772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.386877 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ded685-b7c3-41bb-a125-8043c09ba772 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.387164 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ded685-b7c3-41bb-a125-8043c09ba772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.387448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ded685-b7c3-41bb-a125-8043c09ba772 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.388183 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ded685-b7c3-41bb-a125-8043c09ba772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.390124 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ded685-b7c3-41bb-a125-8043c09ba772 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.396077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-cead8111-c079-4987-874b-6af5e75d4118 None None] MFA Rules not processed for user `e0a65f212e9a4ae5a4aa8e7b020d52ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:03.397303 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-cead8111-c079-4987-874b-6af5e75d4118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:03.400758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 790/1589] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:03 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:03.402208 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00dc0b-7dc1-4bd8-b737-9b3715b0faf2 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.402502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00dc0b-7dc1-4bd8-b737-9b3715b0faf2 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.402783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00dc0b-7dc1-4bd8-b737-9b3715b0faf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.428317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-0c00dc0b-7dc1-4bd8-b737-9b3715b0faf2 None None] MFA Rules not processed for user `05b7cb1174744379a22820fd06e7c99b`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:03.429481 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0c00dc0b-7dc1-4bd8-b737-9b3715b0faf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:03.460038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 800/1590] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:03 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:03.460846 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead8111-c079-4987-874b-6af5e75d4118 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.471818 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead8111-c079-4987-874b-6af5e75d4118 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.476396 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01a7d2-2a2a-4e48-a692-5371e24e02f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.477145 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01a7d2-2a2a-4e48-a692-5371e24e02f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.477525 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01a7d2-2a2a-4e48-a692-5371e24e02f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.477913 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01a7d2-2a2a-4e48-a692-5371e24e02f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.478754 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01a7d2-2a2a-4e48-a692-5371e24e02f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.480667 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01a7d2-2a2a-4e48-a692-5371e24e02f6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.492046 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 791/1591] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:03 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:03.492997 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00dc0b-7dc1-4bd8-b737-9b3715b0faf2 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.502918 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 801/1592] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:03 2021] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:03.503733 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01a7d2-2a2a-4e48-a692-5371e24e02f6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.506718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00dc0b-7dc1-4bd8-b737-9b3715b0faf2 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.511472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5fc6b-515a-4052-bf34-e0fd3a529a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.512118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5fc6b-515a-4052-bf34-e0fd3a529a86 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.512394 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5fc6b-515a-4052-bf34-e0fd3a529a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.512657 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5fc6b-515a-4052-bf34-e0fd3a529a86 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.512773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01a7d2-2a2a-4e48-a692-5371e24e02f6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.513344 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5fc6b-515a-4052-bf34-e0fd3a529a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.515349 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5fc6b-515a-4052-bf34-e0fd3a529a86 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.517455 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27acaa2-3ae8-4616-a276-dcf026234e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.518318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27acaa2-3ae8-4616-a276-dcf026234e9d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.518607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27acaa2-3ae8-4616-a276-dcf026234e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.518904 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27acaa2-3ae8-4616-a276-dcf026234e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.519634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27acaa2-3ae8-4616-a276-dcf026234e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.521228 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27acaa2-3ae8-4616-a276-dcf026234e9d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.531099 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 802/1593] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:03 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:03.531886 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27acaa2-3ae8-4616-a276-dcf026234e9d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.534778 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 792/1594] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:03 2021] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:03.535577 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5fc6b-515a-4052-bf34-e0fd3a529a86 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.544178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27acaa2-3ae8-4616-a276-dcf026234e9d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.544713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5fc6b-515a-4052-bf34-e0fd3a529a86 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.549059 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf2d3a-0b8b-434c-ae5c-955e61845296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.549692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf2d3a-0b8b-434c-ae5c-955e61845296 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.549802 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28cd70-46a6-4f6f-a821-1ca42220a5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.549970 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf2d3a-0b8b-434c-ae5c-955e61845296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.550272 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf2d3a-0b8b-434c-ae5c-955e61845296 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.550433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28cd70-46a6-4f6f-a821-1ca42220a5aa admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.550711 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28cd70-46a6-4f6f-a821-1ca42220a5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.550977 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28cd70-46a6-4f6f-a821-1ca42220a5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.551074 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf2d3a-0b8b-434c-ae5c-955e61845296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.551695 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28cd70-46a6-4f6f-a821-1ca42220a5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.552551 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf2d3a-0b8b-434c-ae5c-955e61845296 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.553258 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28cd70-46a6-4f6f-a821-1ca42220a5aa admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.566289 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 803/1595] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:03 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:03.566580 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 793/1596] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:03 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:03.566690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf2d3a-0b8b-434c-ae5c-955e61845296 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.566785 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28cd70-46a6-4f6f-a821-1ca42220a5aa admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.574827 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28cd70-46a6-4f6f-a821-1ca42220a5aa admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.575656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf2d3a-0b8b-434c-ae5c-955e61845296 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.579319 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610cb73-fcff-4362-9847-8cdcdc04ec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.579927 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610cb73-fcff-4362-9847-8cdcdc04ec00 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.580099 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426386b-66f0-40c3-8c5f-7566e97a22aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.580233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610cb73-fcff-4362-9847-8cdcdc04ec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.580459 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610cb73-fcff-4362-9847-8cdcdc04ec00 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.580725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426386b-66f0-40c3-8c5f-7566e97a22aa admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.581021 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426386b-66f0-40c3-8c5f-7566e97a22aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.581117 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610cb73-fcff-4362-9847-8cdcdc04ec00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.581277 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426386b-66f0-40c3-8c5f-7566e97a22aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.582014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426386b-66f0-40c3-8c5f-7566e97a22aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.584588 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610cb73-fcff-4362-9847-8cdcdc04ec00 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.584721 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426386b-66f0-40c3-8c5f-7566e97a22aa admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.593902 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 804/1597] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:03 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:03.594893 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426386b-66f0-40c3-8c5f-7566e97a22aa admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.605770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426386b-66f0-40c3-8c5f-7566e97a22aa admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.611227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a8b28-542a-4378-98d1-33b3a9149f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.611990 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a8b28-542a-4378-98d1-33b3a9149f66 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.612271 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a8b28-542a-4378-98d1-33b3a9149f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.612487 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 794/1598] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:03 2021] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:03.612891 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a8b28-542a-4378-98d1-33b3a9149f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.613449 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610cb73-fcff-4362-9847-8cdcdc04ec00 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.613698 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a8b28-542a-4378-98d1-33b3a9149f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.615468 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a8b28-542a-4378-98d1-33b3a9149f66 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.628077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 805/1599] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:03 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:03.628984 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a8b28-542a-4378-98d1-33b3a9149f66 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.645229 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a8b28-542a-4378-98d1-33b3a9149f66 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.686851 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610cb73-fcff-4362-9847-8cdcdc04ec00 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.690927 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803cc62-9bfd-45f9-b7d9-de1ca526f002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.691936 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803cc62-9bfd-45f9-b7d9-de1ca526f002 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.692220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803cc62-9bfd-45f9-b7d9-de1ca526f002 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.692499 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803cc62-9bfd-45f9-b7d9-de1ca526f002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.708815 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41daff-c336-433c-a9b4-feada4a7aae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.709741 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41daff-c336-433c-a9b4-feada4a7aae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.710081 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41daff-c336-433c-a9b4-feada4a7aae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.710327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41daff-c336-433c-a9b4-feada4a7aae6 admin admin] PATH_INFO: `/v3/projects/f5e8a958d4bf43868502b13728b9583b/users/6ea02b6e8f1548a1bd78952cb7337403/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.728001 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41daff-c336-433c-a9b4-feada4a7aae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e8a958d4bf43868502b13728b9583b, user_id=6ea02b6e8f1548a1bd78952cb7337403, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.730687 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41daff-c336-433c-a9b4-feada4a7aae6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.753599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 806/1600] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:03 2021] PUT /identity/v3/projects/f5e8a958d4bf43868502b13728b9583b/users/6ea02b6e8f1548a1bd78952cb7337403/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:03.758234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41daff-c336-433c-a9b4-feada4a7aae6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.762658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803cc62-9bfd-45f9-b7d9-de1ca526f002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.764263 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803cc62-9bfd-45f9-b7d9-de1ca526f002 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.773015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 795/1601] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:03 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:03.773856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803cc62-9bfd-45f9-b7d9-de1ca526f002 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.784217 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803cc62-9bfd-45f9-b7d9-de1ca526f002 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.820498 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41daff-c336-433c-a9b4-feada4a7aae6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.825388 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1b306-5bc4-48a2-aeea-6773c5f69ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.826641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1b306-5bc4-48a2-aeea-6773c5f69ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.826641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1b306-5bc4-48a2-aeea-6773c5f69ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.826641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1b306-5bc4-48a2-aeea-6773c5f69ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.827399 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1b306-5bc4-48a2-aeea-6773c5f69ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.829024 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1b306-5bc4-48a2-aeea-6773c5f69ab2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.844471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 807/1602] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:03 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:03.845454 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1b306-5bc4-48a2-aeea-6773c5f69ab2 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.865435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1b306-5bc4-48a2-aeea-6773c5f69ab2 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.868472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a26461-f69d-4c7a-8828-6084fdbd93b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.869258 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a26461-f69d-4c7a-8828-6084fdbd93b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.869536 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a26461-f69d-4c7a-8828-6084fdbd93b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.869812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a26461-f69d-4c7a-8828-6084fdbd93b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.870587 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a26461-f69d-4c7a-8828-6084fdbd93b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.874555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a26461-f69d-4c7a-8828-6084fdbd93b0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.875471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cc23f-ac2c-4756-bf11-afbd2d211501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.876147 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cc23f-ac2c-4756-bf11-afbd2d211501 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.876578 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cc23f-ac2c-4756-bf11-afbd2d211501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.876865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cc23f-ac2c-4756-bf11-afbd2d211501 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.877609 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cc23f-ac2c-4756-bf11-afbd2d211501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.879222 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cc23f-ac2c-4756-bf11-afbd2d211501 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.884484 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 796/1603] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:03 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:03.885280 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a26461-f69d-4c7a-8828-6084fdbd93b0 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.898838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 808/1604] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:03 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:03.898838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cc23f-ac2c-4756-bf11-afbd2d211501 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.899144 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a26461-f69d-4c7a-8828-6084fdbd93b0 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.907697 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed178e8-5f9c-4a45-93f6-bbed32d97466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.908592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed178e8-5f9c-4a45-93f6-bbed32d97466 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.908874 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed178e8-5f9c-4a45-93f6-bbed32d97466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.909152 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed178e8-5f9c-4a45-93f6-bbed32d97466 admin admin] PATH_INFO: `/v3/projects/9b042c269cdd44ff92b3ec9661ab1f3d/users/e29a665906e24d078297b673d7cc8667/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.909339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cc23f-ac2c-4756-bf11-afbd2d211501 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.916444 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abcd10-110f-48b0-9b5d-58fe88c98249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:03.917321 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abcd10-110f-48b0-9b5d-58fe88c98249 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.917778 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abcd10-110f-48b0-9b5d-58fe88c98249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.918256 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abcd10-110f-48b0-9b5d-58fe88c98249 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.919622 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abcd10-110f-48b0-9b5d-58fe88c98249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.923019 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abcd10-110f-48b0-9b5d-58fe88c98249 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.932266 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed178e8-5f9c-4a45-93f6-bbed32d97466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b042c269cdd44ff92b3ec9661ab1f3d, user_id=e29a665906e24d078297b673d7cc8667, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:03.935031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed178e8-5f9c-4a45-93f6-bbed32d97466 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:03.946947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 809/1605] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:03 2021] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:03.948049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abcd10-110f-48b0-9b5d-58fe88c98249 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:03.955406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 797/1606] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:03 2021] PUT /identity/v3/projects/9b042c269cdd44ff92b3ec9661ab1f3d/users/e29a665906e24d078297b673d7cc8667/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:03.956878 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e02cc-ca55-4bfc-b9bc-8cccd5648873 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:03.957249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e02cc-ca55-4bfc-b9bc-8cccd5648873 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:03.957523 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e02cc-ca55-4bfc-b9bc-8cccd5648873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:03.970044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abcd10-110f-48b0-9b5d-58fe88c98249 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:03.976224 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-894e02cc-ca55-4bfc-b9bc-8cccd5648873 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:03.977481 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-894e02cc-ca55-4bfc-b9bc-8cccd5648873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:04.037488 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69f5c3-0a9a-445b-8dfb-0c63a56e052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.038339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69f5c3-0a9a-445b-8dfb-0c63a56e052f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.038740 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69f5c3-0a9a-445b-8dfb-0c63a56e052f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.039026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69f5c3-0a9a-445b-8dfb-0c63a56e052f admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.039834 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 798/1607] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:04.040891 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e02cc-ca55-4bfc-b9bc-8cccd5648873 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:04.043405 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69f5c3-0a9a-445b-8dfb-0c63a56e052f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.045139 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69f5c3-0a9a-445b-8dfb-0c63a56e052f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.052113 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e02cc-ca55-4bfc-b9bc-8cccd5648873 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:04.057097 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26909fae-c903-4934-91d6-c2d96ad32fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.060661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 810/1608] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:03 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:04.060798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26909fae-c903-4934-91d6-c2d96ad32fcc admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.060798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26909fae-c903-4934-91d6-c2d96ad32fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.061026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69f5c3-0a9a-445b-8dfb-0c63a56e052f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:04.061133 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26909fae-c903-4934-91d6-c2d96ad32fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.061133 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26909fae-c903-4934-91d6-c2d96ad32fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.061133 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26909fae-c903-4934-91d6-c2d96ad32fcc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.072271 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69f5c3-0a9a-445b-8dfb-0c63a56e052f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:04.074547 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 799/1609] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:04 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:04.075644 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26909fae-c903-4934-91d6-c2d96ad32fcc admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:04.081655 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed628af2-2500-4ef9-8883-065f3fa7db11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.082707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed628af2-2500-4ef9-8883-065f3fa7db11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.083096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed628af2-2500-4ef9-8883-065f3fa7db11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.083378 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed628af2-2500-4ef9-8883-065f3fa7db11 admin admin] PATH_INFO: `/v3/projects/409b41637da94c469444954258444b4b/users/35d37a3d8e504b8186182468b77dd114/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.089337 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26909fae-c903-4934-91d6-c2d96ad32fcc admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:04.095192 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e22d14-1c6e-45d3-beba-0413e4d11e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.096411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e22d14-1c6e-45d3-beba-0413e4d11e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.096907 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e22d14-1c6e-45d3-beba-0413e4d11e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.097406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e22d14-1c6e-45d3-beba-0413e4d11e3d admin admin] PATH_INFO: `/v3/projects/df4897d6c77544acaa0ad144e70cb582/users/d2f15941036a490ea7842433a24a7029/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.099948 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed628af2-2500-4ef9-8883-065f3fa7db11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=409b41637da94c469444954258444b4b, user_id=35d37a3d8e504b8186182468b77dd114, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.102873 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed628af2-2500-4ef9-8883-065f3fa7db11 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.115071 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e22d14-1c6e-45d3-beba-0413e4d11e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4897d6c77544acaa0ad144e70cb582, user_id=d2f15941036a490ea7842433a24a7029, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.116817 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 811/1610] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:04 2021] PUT /identity/v3/projects/409b41637da94c469444954258444b4b/users/35d37a3d8e504b8186182468b77dd114/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:04.117400 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed628af2-2500-4ef9-8883-065f3fa7db11 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:04.119372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e22d14-1c6e-45d3-beba-0413e4d11e3d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.136279 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 800/1611] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:04 2021] PUT /identity/v3/projects/df4897d6c77544acaa0ad144e70cb582/users/d2f15941036a490ea7842433a24a7029/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:04.137779 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30778175-5666-4289-9cae-6539f54144f0 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.138242 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30778175-5666-4289-9cae-6539f54144f0 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.138662 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30778175-5666-4289-9cae-6539f54144f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.173085 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-30778175-5666-4289-9cae-6539f54144f0 None None] MFA Rules not processed for user `e29a665906e24d078297b673d7cc8667`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:04.174858 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-30778175-5666-4289-9cae-6539f54144f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:04.185454 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed628af2-2500-4ef9-8883-065f3fa7db11 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:04.247274 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 801/1612] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:04 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:04.247274 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30778175-5666-4289-9cae-6539f54144f0 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:04.257685 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697aa872-c062-4de2-9391-cfe26db312e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.258864 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa872-c062-4de2-9391-cfe26db312e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.259144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa872-c062-4de2-9391-cfe26db312e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.259566 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa872-c062-4de2-9391-cfe26db312e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.260314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697aa872-c062-4de2-9391-cfe26db312e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.261896 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697aa872-c062-4de2-9391-cfe26db312e6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.272680 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 812/1613] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:04 2021] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:04.276327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697aa872-c062-4de2-9391-cfe26db312e6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:04.286434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697aa872-c062-4de2-9391-cfe26db312e6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:04.291559 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ee37c-5eac-4bea-b49b-01dab3cdea72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.292445 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ee37c-5eac-4bea-b49b-01dab3cdea72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.292723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ee37c-5eac-4bea-b49b-01dab3cdea72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.292998 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ee37c-5eac-4bea-b49b-01dab3cdea72 admin admin] PATH_INFO: `/v3/projects/9b91f7569f3f490f92d6d9a6c404af21/users/6b7268a5072b49628d28d6412a1cda8c/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.309266 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ee37c-5eac-4bea-b49b-01dab3cdea72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b91f7569f3f490f92d6d9a6c404af21, user_id=6b7268a5072b49628d28d6412a1cda8c, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.310381 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30778175-5666-4289-9cae-6539f54144f0 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:04.312779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ee37c-5eac-4bea-b49b-01dab3cdea72 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.314748 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37970259-39c4-4f7a-b8fd-42cd3b311b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.315388 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37970259-39c4-4f7a-b8fd-42cd3b311b90 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.315669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37970259-39c4-4f7a-b8fd-42cd3b311b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.315944 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37970259-39c4-4f7a-b8fd-42cd3b311b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.326861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37970259-39c4-4f7a-b8fd-42cd3b311b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.328415 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37970259-39c4-4f7a-b8fd-42cd3b311b90 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.343712 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 802/1615] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:04.343712 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37970259-39c4-4f7a-b8fd-42cd3b311b90 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:04.344045 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 813/1615] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:04 2021] PUT /identity/v3/projects/9b91f7569f3f490f92d6d9a6c404af21/users/6b7268a5072b49628d28d6412a1cda8c/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:04.346088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e2900-0fa3-4323-af8e-4c651ec58050 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.346843 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e2900-0fa3-4323-af8e-4c651ec58050 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.347520 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e2900-0fa3-4323-af8e-4c651ec58050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.355503 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37970259-39c4-4f7a-b8fd-42cd3b311b90 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:04.367721 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-276e2900-0fa3-4323-af8e-4c651ec58050 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:04.369178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-276e2900-0fa3-4323-af8e-4c651ec58050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:04.421802 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01de91-1214-42fb-ae43-d041ba70351e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.423087 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01de91-1214-42fb-ae43-d041ba70351e admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.423377 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01de91-1214-42fb-ae43-d041ba70351e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.423992 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01de91-1214-42fb-ae43-d041ba70351e admin admin] PATH_INFO: `/v3/projects/bb933fa80ed94ce5b6828e48e86a21c7/users/28384f466c3541358ecea856650f008c/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.432061 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 814/1616] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:04.433313 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e839de7-47c9-457c-9e69-6df1f8c6b3e2 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.433595 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e839de7-47c9-457c-9e69-6df1f8c6b3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.433870 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e839de7-47c9-457c-9e69-6df1f8c6b3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.450863 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01de91-1214-42fb-ae43-d041ba70351e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb933fa80ed94ce5b6828e48e86a21c7, user_id=28384f466c3541358ecea856650f008c, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.450863 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01de91-1214-42fb-ae43-d041ba70351e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.462155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-6e839de7-47c9-457c-9e69-6df1f8c6b3e2 None None] MFA Rules not processed for user `d2f15941036a490ea7842433a24a7029`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:04.462389 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 803/1617] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:04 2021] PUT /identity/v3/projects/bb933fa80ed94ce5b6828e48e86a21c7/users/28384f466c3541358ecea856650f008c/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:04.463366 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6e839de7-47c9-457c-9e69-6df1f8c6b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:04.468147 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01de91-1214-42fb-ae43-d041ba70351e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:04.538936 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01de91-1214-42fb-ae43-d041ba70351e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:04.539526 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 815/1618] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:04 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:04.540287 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e839de7-47c9-457c-9e69-6df1f8c6b3e2 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:04.543922 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b1381-4c2c-4314-928e-16d85337e84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.544565 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b1381-4c2c-4314-928e-16d85337e84a admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.544843 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b1381-4c2c-4314-928e-16d85337e84a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.545116 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b1381-4c2c-4314-928e-16d85337e84a admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.546468 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b1381-4c2c-4314-928e-16d85337e84a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.548445 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b1381-4c2c-4314-928e-16d85337e84a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.551125 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e839de7-47c9-457c-9e69-6df1f8c6b3e2 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:04.557553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3c0c3-a96e-4e57-b151-2985985ccaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.558951 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3c0c3-a96e-4e57-b151-2985985ccaa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.559212 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3c0c3-a96e-4e57-b151-2985985ccaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.559498 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3c0c3-a96e-4e57-b151-2985985ccaa2 admin admin] PATH_INFO: `/v3/projects/d788925bf2f4432ab15aec2f385e9c26/users/a0748aee42d3492599f7320f84562a9d/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.577812 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3c0c3-a96e-4e57-b151-2985985ccaa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d788925bf2f4432ab15aec2f385e9c26, user_id=a0748aee42d3492599f7320f84562a9d, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.580970 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3c0c3-a96e-4e57-b151-2985985ccaa2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.587271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 804/1619] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:04 2021] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:04.587271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ab569-472f-4682-9d52-7ca705f28297 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.587271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ab569-472f-4682-9d52-7ca705f28297 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.587271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ab569-472f-4682-9d52-7ca705f28297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.602087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 816/1620] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:04 2021] PUT /identity/v3/projects/d788925bf2f4432ab15aec2f385e9c26/users/a0748aee42d3492599f7320f84562a9d/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:04.603306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3c0c3-a96e-4e57-b151-2985985ccaa2 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:04.605193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5bf3c0c3-a96e-4e57-b151-2985985ccaa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:04.617140 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-d29ab569-472f-4682-9d52-7ca705f28297 None None] MFA Rules not processed for user `6b7268a5072b49628d28d6412a1cda8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:04.618371 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d29ab569-472f-4682-9d52-7ca705f28297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:04.678955 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3c0c3-a96e-4e57-b151-2985985ccaa2 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:04.683428 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fd5b0-135b-4d87-b427-825de08862a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.684593 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fd5b0-135b-4d87-b427-825de08862a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.684869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fd5b0-135b-4d87-b427-825de08862a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.685147 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fd5b0-135b-4d87-b427-825de08862a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.697446 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 805/1621] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:04 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:04.699349 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878e445-c8b6-4338-9e9d-5fbb8f4ad4e2 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.699735 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878e445-c8b6-4338-9e9d-5fbb8f4ad4e2 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.700176 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878e445-c8b6-4338-9e9d-5fbb8f4ad4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.731000 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-0878e445-c8b6-4338-9e9d-5fbb8f4ad4e2 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:04.731921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0878e445-c8b6-4338-9e9d-5fbb8f4ad4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:04.757111 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210fd5b0-135b-4d87-b427-825de08862a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.758773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210fd5b0-135b-4d87-b427-825de08862a6 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.770719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 817/1622] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:04.771634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fd5b0-135b-4d87-b427-825de08862a6 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:04.782186 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fd5b0-135b-4d87-b427-825de08862a6 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:04.789162 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81c15e-d348-47ad-bb22-2f6c9675e2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.789998 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81c15e-d348-47ad-bb22-2f6c9675e2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.790408 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81c15e-d348-47ad-bb22-2f6c9675e2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.790849 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81c15e-d348-47ad-bb22-2f6c9675e2b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.791669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81c15e-d348-47ad-bb22-2f6c9675e2b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.793892 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81c15e-d348-47ad-bb22-2f6c9675e2b6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.800846 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 806/1623] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:04.802736 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878e445-c8b6-4338-9e9d-5fbb8f4ad4e2 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:04.818517 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878e445-c8b6-4338-9e9d-5fbb8f4ad4e2 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:04.824930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820fe28-4197-4d78-8a5a-aa69b83842d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.825614 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820fe28-4197-4d78-8a5a-aa69b83842d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.825898 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820fe28-4197-4d78-8a5a-aa69b83842d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.826218 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820fe28-4197-4d78-8a5a-aa69b83842d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.827697 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820fe28-4197-4d78-8a5a-aa69b83842d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.833679 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820fe28-4197-4d78-8a5a-aa69b83842d1 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.833805 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 818/1624] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:04 2021] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:04.833805 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81c15e-d348-47ad-bb22-2f6c9675e2b6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:04.861180 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 807/1625] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:04 2021] POST /identity/v3/users => generated 301 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:04.862621 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8879c1-e817-49b4-9958-789a29a9a88d None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.862910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8879c1-e817-49b4-9958-789a29a9a88d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.863192 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8879c1-e817-49b4-9958-789a29a9a88d None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.865964 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 808/1626] 10.222.0.18 () {54 vars in 961 bytes} [Wed Dec 15 03:03:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:03:04.866734 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8879c1-e817-49b4-9958-789a29a9a88d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:04.931937 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8879c1-e817-49b4-9958-789a29a9a88d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:04.935631 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81c15e-d348-47ad-bb22-2f6c9675e2b6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:04.935771 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc76240-49b3-4619-b10b-3b8182972aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.936475 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc76240-49b3-4619-b10b-3b8182972aae service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.936785 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc76240-49b3-4619-b10b-3b8182972aae service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.937034 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc76240-49b3-4619-b10b-3b8182972aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.942836 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250c448-e3e2-41bb-849d-60ddfd4dc001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.943496 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250c448-e3e2-41bb-849d-60ddfd4dc001 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.943775 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250c448-e3e2-41bb-849d-60ddfd4dc001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.944050 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250c448-e3e2-41bb-849d-60ddfd4dc001 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.944788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250c448-e3e2-41bb-849d-60ddfd4dc001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.946923 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250c448-e3e2-41bb-849d-60ddfd4dc001 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.947289 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc76240-49b3-4619-b10b-3b8182972aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.948788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc76240-49b3-4619-b10b-3b8182972aae service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.958616 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 819/1627] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:04 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:04.960681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 809/1628] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:04.961561 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc76240-49b3-4619-b10b-3b8182972aae service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:04.962336 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250c448-e3e2-41bb-849d-60ddfd4dc001 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:04.973383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc76240-49b3-4619-b10b-3b8182972aae service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:04.974752 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250c448-e3e2-41bb-849d-60ddfd4dc001 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:04.978989 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d16bde-9daf-492d-b367-fdfaa7aec9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.979795 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d16bde-9daf-492d-b367-fdfaa7aec9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.980136 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d16bde-9daf-492d-b367-fdfaa7aec9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.980471 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d16bde-9daf-492d-b367-fdfaa7aec9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.980580 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231712d2-88aa-4bc3-9783-f7a4b831d78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:04.981312 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231712d2-88aa-4bc3-9783-f7a4b831d78c admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.981641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231712d2-88aa-4bc3-9783-f7a4b831d78c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.981922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231712d2-88aa-4bc3-9783-f7a4b831d78c admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:04.982059 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d16bde-9daf-492d-b367-fdfaa7aec9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.982838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231712d2-88aa-4bc3-9783-f7a4b831d78c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:04.983926 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d16bde-9daf-492d-b367-fdfaa7aec9b6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.985160 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231712d2-88aa-4bc3-9783-f7a4b831d78c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:04.996450 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 810/1629] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:04 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:04.997878 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a4687-974e-44d2-b053-2dd11cd66010 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:04.999179 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a4687-974e-44d2-b053-2dd11cd66010 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:04.999313 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a4687-974e-44d2-b053-2dd11cd66010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:05.014020 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 820/1630] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:04 2021] POST /identity/v3/users => generated 293 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:05.015668 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231712d2-88aa-4bc3-9783-f7a4b831d78c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:05.026396 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-f65a4687-974e-44d2-b053-2dd11cd66010 None None] MFA Rules not processed for user `fcd50adcd390465ea6fc8582e1524909`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:05.027981 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f65a4687-974e-44d2-b053-2dd11cd66010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:05.032863 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231712d2-88aa-4bc3-9783-f7a4b831d78c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:05.039376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e36a5-6dc0-4fc4-b4dd-79a21ce74d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:05.040485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e36a5-6dc0-4fc4-b4dd-79a21ce74d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:05.041241 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e36a5-6dc0-4fc4-b4dd-79a21ce74d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:05.041533 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e36a5-6dc0-4fc4-b4dd-79a21ce74d2b admin admin] PATH_INFO: `/v3/projects/d788925bf2f4432ab15aec2f385e9c26/users/a0748aee42d3492599f7320f84562a9d/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:05.044765 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e36a5-6dc0-4fc4-b4dd-79a21ce74d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d788925bf2f4432ab15aec2f385e9c26, user_id=a0748aee42d3492599f7320f84562a9d, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:05.048706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e36a5-6dc0-4fc4-b4dd-79a21ce74d2b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:05.064054 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 821/1631] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:05 2021] PUT /identity/v3/projects/d788925bf2f4432ab15aec2f385e9c26/users/a0748aee42d3492599f7320f84562a9d/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:05.064943 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e36a5-6dc0-4fc4-b4dd-79a21ce74d2b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:05.118332 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 811/1632] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Dec 15 03:03:04 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:05.119127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a4687-974e-44d2-b053-2dd11cd66010 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:05.131664 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a4687-974e-44d2-b053-2dd11cd66010 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:05.154140 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e36a5-6dc0-4fc4-b4dd-79a21ce74d2b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:05.161507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8c7e5-bdf2-4b3d-a9bd-cb9375acf7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:05.163007 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8c7e5-bdf2-4b3d-a9bd-cb9375acf7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:05.163265 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8c7e5-bdf2-4b3d-a9bd-cb9375acf7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:05.163647 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8c7e5-bdf2-4b3d-a9bd-cb9375acf7fb admin admin] PATH_INFO: `/v3/projects/14d65b8acb3a427ebba7da91d76c215a/users/6fe9b8cd54a74bc8bed61a4428bb3e01/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:05.185327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8c7e5-bdf2-4b3d-a9bd-cb9375acf7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d65b8acb3a427ebba7da91d76c215a, user_id=6fe9b8cd54a74bc8bed61a4428bb3e01, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:05.190440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8c7e5-bdf2-4b3d-a9bd-cb9375acf7fb admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:05.220051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 822/1633] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:05 2021] PUT /identity/v3/projects/14d65b8acb3a427ebba7da91d76c215a/users/6fe9b8cd54a74bc8bed61a4428bb3e01/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:05.220051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5070a70-a1c5-4a13-9bd0-4fef71a48e16 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:05.220501 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5070a70-a1c5-4a13-9bd0-4fef71a48e16 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:05.220977 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5070a70-a1c5-4a13-9bd0-4fef71a48e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:05.251278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae0583-fbc0-4f7a-acb2-9587ef268680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:05.253013 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae0583-fbc0-4f7a-acb2-9587ef268680 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:05.253933 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae0583-fbc0-4f7a-acb2-9587ef268680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:05.254828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae0583-fbc0-4f7a-acb2-9587ef268680 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:05.255937 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae0583-fbc0-4f7a-acb2-9587ef268680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:05.259245 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae0583-fbc0-4f7a-acb2-9587ef268680 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:05.262562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-b5070a70-a1c5-4a13-9bd0-4fef71a48e16 None None] MFA Rules not processed for user `a0748aee42d3492599f7320f84562a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:05.264134 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b5070a70-a1c5-4a13-9bd0-4fef71a48e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:05.277039 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 812/1634] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:05 2021] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:05.278791 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae0583-fbc0-4f7a-acb2-9587ef268680 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:05.381394 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 823/1635] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:05 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:05.382104 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5070a70-a1c5-4a13-9bd0-4fef71a48e16 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:05.427924 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae0583-fbc0-4f7a-acb2-9587ef268680 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:05.513479 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5070a70-a1c5-4a13-9bd0-4fef71a48e16 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:05.525303 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09778147-44c3-47b6-9bbf-73c881f4bba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:05.527419 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09778147-44c3-47b6-9bbf-73c881f4bba9 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:05.529611 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09778147-44c3-47b6-9bbf-73c881f4bba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:05.530138 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09778147-44c3-47b6-9bbf-73c881f4bba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:05.532716 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09778147-44c3-47b6-9bbf-73c881f4bba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:05.535474 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09778147-44c3-47b6-9bbf-73c881f4bba9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:05.551177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baaec2-83aa-4975-9c24-ca7f19fb42ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:05.551947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baaec2-83aa-4975-9c24-ca7f19fb42ce service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:05.552172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baaec2-83aa-4975-9c24-ca7f19fb42ce service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:05.552443 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baaec2-83aa-4975-9c24-ca7f19fb42ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:05.557406 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 824/1636] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:05 2021] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:05.559073 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09778147-44c3-47b6-9bbf-73c881f4bba9 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:05.570800 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09778147-44c3-47b6-9bbf-73c881f4bba9 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:05.576961 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a38f31-c39a-4213-94d7-6fa93a605289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:05.578418 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a38f31-c39a-4213-94d7-6fa93a605289 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:05.578918 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a38f31-c39a-4213-94d7-6fa93a605289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:05.579402 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a38f31-c39a-4213-94d7-6fa93a605289 admin admin] PATH_INFO: `/v3/projects/2cc4607857704d06b713aa2e2986e048/users/d8445a12034943e689101c1848347bb2/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:05.604530 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a38f31-c39a-4213-94d7-6fa93a605289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc4607857704d06b713aa2e2986e048, user_id=d8445a12034943e689101c1848347bb2, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:05.607660 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a38f31-c39a-4213-94d7-6fa93a605289 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:05.633695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 825/1637] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:05 2021] PUT /identity/v3/projects/2cc4607857704d06b713aa2e2986e048/users/d8445a12034943e689101c1848347bb2/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:05.634592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baaec2-83aa-4975-9c24-ca7f19fb42ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:05.634834 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a38f31-c39a-4213-94d7-6fa93a605289 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:05.637422 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baaec2-83aa-4975-9c24-ca7f19fb42ce service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:05.652425 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 813/1638] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:05 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:05.655688 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baaec2-83aa-4975-9c24-ca7f19fb42ce service nova] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:05.671029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baaec2-83aa-4975-9c24-ca7f19fb42ce service nova] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:05.744640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48958aad-642a-4acf-90e4-695472294f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:05.746145 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48958aad-642a-4acf-90e4-695472294f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:05.746676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48958aad-642a-4acf-90e4-695472294f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:05.747229 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48958aad-642a-4acf-90e4-695472294f15 admin admin] PATH_INFO: `/v3/projects/14d65b8acb3a427ebba7da91d76c215a/users/6fe9b8cd54a74bc8bed61a4428bb3e01/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:05.751057 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48958aad-642a-4acf-90e4-695472294f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d65b8acb3a427ebba7da91d76c215a, user_id=6fe9b8cd54a74bc8bed61a4428bb3e01, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:05.754878 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48958aad-642a-4acf-90e4-695472294f15 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:05.767023 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 814/1639] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:05 2021] PUT /identity/v3/projects/14d65b8acb3a427ebba7da91d76c215a/users/6fe9b8cd54a74bc8bed61a4428bb3e01/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:05.768418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48958aad-642a-4acf-90e4-695472294f15 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:05.771854 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a38f31-c39a-4213-94d7-6fa93a605289 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:05.890133 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a6002-d23c-4048-a8c8-be1b49ce10c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:05.890896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48958aad-642a-4acf-90e4-695472294f15 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:05.891282 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a6002-d23c-4048-a8c8-be1b49ce10c0 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:05.891724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a6002-d23c-4048-a8c8-be1b49ce10c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:05.892157 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a6002-d23c-4048-a8c8-be1b49ce10c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:05.897248 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a9faa-e2ee-455f-a867-38fe2b49a9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:05.898148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a9faa-e2ee-455f-a867-38fe2b49a9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:05.898536 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a9faa-e2ee-455f-a867-38fe2b49a9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:05.898913 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a9faa-e2ee-455f-a867-38fe2b49a9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:05.899779 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a9faa-e2ee-455f-a867-38fe2b49a9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:05.901498 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a9faa-e2ee-455f-a867-38fe2b49a9d5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:05.927426 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 815/1640] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:05 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:05.928775 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6028c2-ea6e-42e7-934f-d3378d782853 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:05.929728 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6028c2-ea6e-42e7-934f-d3378d782853 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:05.930195 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6028c2-ea6e-42e7-934f-d3378d782853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:05.979240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-9c6028c2-ea6e-42e7-934f-d3378d782853 None None] MFA Rules not processed for user `6fe9b8cd54a74bc8bed61a4428bb3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:05.980695 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9c6028c2-ea6e-42e7-934f-d3378d782853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:06.042893 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a6002-d23c-4048-a8c8-be1b49ce10c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:06.046162 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a6002-d23c-4048-a8c8-be1b49ce10c0 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:06.089966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 826/1641] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:05 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:06.091175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a6002-d23c-4048-a8c8-be1b49ce10c0 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:06.099838 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 816/1642] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:05 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:06.109517 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015f1f3-862c-445e-9ba3-efb7dacd5169 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:06.109840 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015f1f3-862c-445e-9ba3-efb7dacd5169 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:06.110647 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015f1f3-862c-445e-9ba3-efb7dacd5169 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:06.112788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 817/1643] 10.222.0.18 () {54 vars in 961 bytes} [Wed Dec 15 03:03:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 03:03:06.113597 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015f1f3-862c-445e-9ba3-efb7dacd5169 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:06.125088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a6002-d23c-4048-a8c8-be1b49ce10c0 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:06.134911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015f1f3-862c-445e-9ba3-efb7dacd5169 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:06.136189 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4290b3-d21e-4ddb-aebb-78ab01211a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:06.137464 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4290b3-d21e-4ddb-aebb-78ab01211a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:06.138418 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4290b3-d21e-4ddb-aebb-78ab01211a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:06.139290 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4290b3-d21e-4ddb-aebb-78ab01211a50 admin admin] PATH_INFO: `/v3/projects/2cc4607857704d06b713aa2e2986e048/users/d8445a12034943e689101c1848347bb2/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:06.139572 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b522b-8204-446c-9b9f-91597da8a2a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:06.140378 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b522b-8204-446c-9b9f-91597da8a2a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:06.140656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b522b-8204-446c-9b9f-91597da8a2a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:06.141090 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b522b-8204-446c-9b9f-91597da8a2a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:06.146176 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4290b3-d21e-4ddb-aebb-78ab01211a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc4607857704d06b713aa2e2986e048, user_id=d8445a12034943e689101c1848347bb2, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:06.154205 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b522b-8204-446c-9b9f-91597da8a2a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:06.157173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b522b-8204-446c-9b9f-91597da8a2a9 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:06.157729 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4290b3-d21e-4ddb-aebb-78ab01211a50 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:06.172829 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 818/1644] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:06 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:06.174802 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15b45a-54b5-43bb-8c3f-322fbe9b6332 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:06.175026 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15b45a-54b5-43bb-8c3f-322fbe9b6332 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:06.175296 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15b45a-54b5-43bb-8c3f-322fbe9b6332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:06.204439 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 827/1645] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:06 2021] PUT /identity/v3/projects/2cc4607857704d06b713aa2e2986e048/users/d8445a12034943e689101c1848347bb2/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:06.205192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68710108-a250-446a-b72a-7508969531b3 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:06.205725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68710108-a250-446a-b72a-7508969531b3 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:06.205725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68710108-a250-446a-b72a-7508969531b3 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:06.218338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 828/1646] 10.222.0.18 () {54 vars in 912 bytes} [Wed Dec 15 03:03:06 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:03:06.219971 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc50bd1-58c7-4c62-97cd-77bb9d397015 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:06.223648 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-4e15b45a-54b5-43bb-8c3f-322fbe9b6332 None None] MFA Rules not processed for user `fcd50adcd390465ea6fc8582e1524909`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:06.225271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-4e15b45a-54b5-43bb-8c3f-322fbe9b6332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:06.227565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc50bd1-58c7-4c62-97cd-77bb9d397015 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:06.227932 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc50bd1-58c7-4c62-97cd-77bb9d397015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:06.314284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-5cc50bd1-58c7-4c62-97cd-77bb9d397015 None None] MFA Rules not processed for user `d8445a12034943e689101c1848347bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:06.315717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5cc50bd1-58c7-4c62-97cd-77bb9d397015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:06.393110 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 819/1647] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Dec 15 03:03:06 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:06.393777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360b4a5-52be-469a-94c1-0a4c77ced945 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:06.393777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360b4a5-52be-469a-94c1-0a4c77ced945 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:06.394537 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360b4a5-52be-469a-94c1-0a4c77ced945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:06.420108 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-3360b4a5-52be-469a-94c1-0a4c77ced945 None None] MFA Rules not processed for user `fcd50adcd390465ea6fc8582e1524909`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:06.421754 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-3360b4a5-52be-469a-94c1-0a4c77ced945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:06.437042 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 820/1648] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Dec 15 03:03:06 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:06.438391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180a805-7eb7-4915-96e8-54ed7f148c11 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:06.439246 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180a805-7eb7-4915-96e8-54ed7f148c11 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:06.439539 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180a805-7eb7-4915-96e8-54ed7f148c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:06.463218 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 829/1649] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:06 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:06.464142 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc50bd1-58c7-4c62-97cd-77bb9d397015 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:06.483092 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-e180a805-7eb7-4915-96e8-54ed7f148c11 None None] MFA Rules not processed for user `28384f466c3541358ecea856650f008c`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:06.484547 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e180a805-7eb7-4915-96e8-54ed7f148c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:06.536334 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc50bd1-58c7-4c62-97cd-77bb9d397015 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:06.542891 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fe328-e761-4852-8a1f-26fc6782c7bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:06.543769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fe328-e761-4852-8a1f-26fc6782c7bd service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:06.544242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fe328-e761-4852-8a1f-26fc6782c7bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:06.544795 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fe328-e761-4852-8a1f-26fc6782c7bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:06.563575 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 821/1650] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:06 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:06.565277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee896e0a-be1c-407e-bac7-06131d580a53 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:06.572021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee896e0a-be1c-407e-bac7-06131d580a53 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:06.572615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee896e0a-be1c-407e-bac7-06131d580a53 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:06.583939 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 822/1651] 10.222.0.18 () {54 vars in 912 bytes} [Wed Dec 15 03:03:06 2021] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:03:06.585822 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee896e0a-be1c-407e-bac7-06131d580a53 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:06.606569 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee896e0a-be1c-407e-bac7-06131d580a53 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:06.613763 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc54519-8377-4c20-8347-22d30a7d1279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:06.615185 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc54519-8377-4c20-8347-22d30a7d1279 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:06.615560 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fe328-e761-4852-8a1f-26fc6782c7bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:06.615890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc54519-8377-4c20-8347-22d30a7d1279 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:06.616353 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc54519-8377-4c20-8347-22d30a7d1279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:06.617011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fe328-e761-4852-8a1f-26fc6782c7bd service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:06.630651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 830/1652] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:06 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:06.631981 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e067f3c-cdd8-4b9a-8d9d-ae13b2a6346b None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:06.632329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e067f3c-cdd8-4b9a-8d9d-ae13b2a6346b None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:06.632628 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e067f3c-cdd8-4b9a-8d9d-ae13b2a6346b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:06.635283 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc54519-8377-4c20-8347-22d30a7d1279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:06.636728 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc54519-8377-4c20-8347-22d30a7d1279 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:06.658127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 823/1653] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:06 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:06.659708 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546c81e-d676-4def-88b3-2e531fe1b613 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:06.660102 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546c81e-d676-4def-88b3-2e531fe1b613 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:06.660226 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-7e067f3c-cdd8-4b9a-8d9d-ae13b2a6346b None None] MFA Rules not processed for user `28384f466c3541358ecea856650f008c`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:06.660406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546c81e-d676-4def-88b3-2e531fe1b613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:06.661450 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7e067f3c-cdd8-4b9a-8d9d-ae13b2a6346b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:06.674595 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 831/1654] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:06 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:06.687080 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-d546c81e-d676-4def-88b3-2e531fe1b613 None None] MFA Rules not processed for user `fcd50adcd390465ea6fc8582e1524909`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:06.689577 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d546c81e-d676-4def-88b3-2e531fe1b613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:06.702285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 824/1655] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Dec 15 03:03:06 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:06.735246 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f077e-e97e-4f92-96e4-676381fbf667 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:06.735566 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f077e-e97e-4f92-96e4-676381fbf667 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:06.735807 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f077e-e97e-4f92-96e4-676381fbf667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:06.795823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-295f077e-e97e-4f92-96e4-676381fbf667 None None] MFA Rules not processed for user `35d37a3d8e504b8186182468b77dd114`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:06.799107 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-295f077e-e97e-4f92-96e4-676381fbf667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:06.911607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 832/1656] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:06 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:03:06.922479 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f53c3-e9f6-4dd9-8b4d-1f6a3cc9bbcf None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:06.923330 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f53c3-e9f6-4dd9-8b4d-1f6a3cc9bbcf None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:06.923330 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f53c3-e9f6-4dd9-8b4d-1f6a3cc9bbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:06.943123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-867f53c3-e9f6-4dd9-8b4d-1f6a3cc9bbcf None None] MFA Rules not processed for user `35d37a3d8e504b8186182468b77dd114`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:06.944411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-867f53c3-e9f6-4dd9-8b4d-1f6a3cc9bbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:06.951557 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 825/1657] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:06 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:07.010886 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f077e-e97e-4f92-96e4-676381fbf667 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:07.017247 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f53c3-e9f6-4dd9-8b4d-1f6a3cc9bbcf None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:07.029368 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f53c3-e9f6-4dd9-8b4d-1f6a3cc9bbcf None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:07.038647 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa6f44-327c-41f9-bf60-dd79940188fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:07.039558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa6f44-327c-41f9-bf60-dd79940188fb service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:07.040134 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa6f44-327c-41f9-bf60-dd79940188fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:07.040828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa6f44-327c-41f9-bf60-dd79940188fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:07.054155 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa6f44-327c-41f9-bf60-dd79940188fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:07.057200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa6f44-327c-41f9-bf60-dd79940188fb service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:07.075014 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 826/1658] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:07 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:03:07.103400 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f077e-e97e-4f92-96e4-676381fbf667 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:07.110056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2ef0e-7aeb-42e9-9968-c024a7a02c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:07.111088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2ef0e-7aeb-42e9-9968-c024a7a02c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:07.111339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2ef0e-7aeb-42e9-9968-c024a7a02c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:07.111650 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2ef0e-7aeb-42e9-9968-c024a7a02c03 admin admin] PATH_INFO: `/v3/users/e0a65f212e9a4ae5a4aa8e7b020d52ac` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:07.113026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2ef0e-7aeb-42e9-9968-c024a7a02c03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a65f212e9a4ae5a4aa8e7b020d52ac)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:07.114120 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: WARNING py.warnings [None req-5af2ef0e-7aeb-42e9-9968-c024a7a02c03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:03:07.114120 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: warnings.warn(msg) Dec 15 03:03:07.114120 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: Dec 15 03:03:07.115517 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2ef0e-7aeb-42e9-9968-c024a7a02c03 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:07.120195 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa6f44-327c-41f9-bf60-dd79940188fb service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:07.131619 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa6f44-327c-41f9-bf60-dd79940188fb service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:07.136493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933adf6-c9df-48fe-95c6-18287872f084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:07.138251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933adf6-c9df-48fe-95c6-18287872f084 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:07.138765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933adf6-c9df-48fe-95c6-18287872f084 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:07.139302 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933adf6-c9df-48fe-95c6-18287872f084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:07.154487 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933adf6-c9df-48fe-95c6-18287872f084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:07.157398 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933adf6-c9df-48fe-95c6-18287872f084 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:07.175303 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 827/1659] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:03:07.203523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5af2ef0e-7aeb-42e9-9968-c024a7a02c03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a65f212e9a4ae5a4aa8e7b020d52ac'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:07.234207 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5af2ef0e-7aeb-42e9-9968-c024a7a02c03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a65f212e9a4ae5a4aa8e7b020d52ac'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:07.251124 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933adf6-c9df-48fe-95c6-18287872f084 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:07.255234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5af2ef0e-7aeb-42e9-9968-c024a7a02c03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a65f212e9a4ae5a4aa8e7b020d52ac'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:07.256193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5af2ef0e-7aeb-42e9-9968-c024a7a02c03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a65f212e9a4ae5a4aa8e7b020d52ac'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:07.256992 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5af2ef0e-7aeb-42e9-9968-c024a7a02c03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a65f212e9a4ae5a4aa8e7b020d52ac'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:07.268933 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933adf6-c9df-48fe-95c6-18287872f084 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:07.276133 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0aaa3a-9577-4623-b1cb-0302cf6ba31b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:07.276853 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aaa3a-9577-4623-b1cb-0302cf6ba31b service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:07.277267 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aaa3a-9577-4623-b1cb-0302cf6ba31b service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:07.277615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aaa3a-9577-4623-b1cb-0302cf6ba31b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:07.279523 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1c0aaa3a-9577-4623-b1cb-0302cf6ba31b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:07.300000 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 833/1660] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:07 2021] DELETE /identity/v3/users/e0a65f212e9a4ae5a4aa8e7b020d52ac => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:07.301146 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2ef0e-7aeb-42e9-9968-c024a7a02c03 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:07.304397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5af2ef0e-7aeb-42e9-9968-c024a7a02c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:07.316842 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0aaa3a-9577-4623-b1cb-0302cf6ba31b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:07.318594 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0aaa3a-9577-4623-b1cb-0302cf6ba31b service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:07.342730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 828/1661] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:07 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:07.345691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daa9fa-0092-4398-8f0c-22f0d87cc02b None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:07.346751 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daa9fa-0092-4398-8f0c-22f0d87cc02b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:07.347148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daa9fa-0092-4398-8f0c-22f0d87cc02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:07.402340 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-a8daa9fa-0092-4398-8f0c-22f0d87cc02b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:07.405662 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-a8daa9fa-0092-4398-8f0c-22f0d87cc02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:07.454652 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2ef0e-7aeb-42e9-9968-c024a7a02c03 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:07.462599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983cedf-4afd-4de7-acfa-e2984323d843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:07.463306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983cedf-4afd-4de7-acfa-e2984323d843 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:07.463597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983cedf-4afd-4de7-acfa-e2984323d843 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:07.464054 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983cedf-4afd-4de7-acfa-e2984323d843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:07.466520 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a983cedf-4afd-4de7-acfa-e2984323d843 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:07.496528 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 829/1662] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:07.497876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daa9fa-0092-4398-8f0c-22f0d87cc02b None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:07.499780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-a8daa9fa-0092-4398-8f0c-22f0d87cc02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:07.589648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983cedf-4afd-4de7-acfa-e2984323d843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:07.591795 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983cedf-4afd-4de7-acfa-e2984323d843 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:07.608799 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 834/1663] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:07 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:07.609038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983cedf-4afd-4de7-acfa-e2984323d843 service nova] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:07.610488 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a983cedf-4afd-4de7-acfa-e2984323d843 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:07.638445 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daa9fa-0092-4398-8f0c-22f0d87cc02b None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:07.648934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca698d-d263-4db9-864a-7b3592b2906c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:07.649598 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca698d-d263-4db9-864a-7b3592b2906c service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:07.650417 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca698d-d263-4db9-864a-7b3592b2906c service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:07.650712 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca698d-d263-4db9-864a-7b3592b2906c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:07.656794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-cdca698d-d263-4db9-864a-7b3592b2906c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:07.736660 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983cedf-4afd-4de7-acfa-e2984323d843 service nova] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:07.745638 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fd272-2245-4901-b2cb-ab5b726412be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:07.746371 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fd272-2245-4901-b2cb-ab5b726412be service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:07.746700 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fd272-2245-4901-b2cb-ab5b726412be service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:07.746992 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fd272-2245-4901-b2cb-ab5b726412be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:07.766959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fd272-2245-4901-b2cb-ab5b726412be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:07.769642 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fd272-2245-4901-b2cb-ab5b726412be service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:07.783999 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 835/1664] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:07.788679 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca698d-d263-4db9-864a-7b3592b2906c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:07.790192 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca698d-d263-4db9-864a-7b3592b2906c service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:07.811840 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 830/1665] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:07 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:07.943898 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cee960-d817-4e63-8d13-89a434e979ad None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:07.944197 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cee960-d817-4e63-8d13-89a434e979ad None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:07.944831 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cee960-d817-4e63-8d13-89a434e979ad None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:07.946443 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 836/1666] 10.222.0.18 () {54 vars in 912 bytes} [Wed Dec 15 03:03:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:03:07.954505 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebf3ff-acf5-47d0-a8a6-42bcb8ddcddf None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:07.954806 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebf3ff-acf5-47d0-a8a6-42bcb8ddcddf None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:07.955069 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebf3ff-acf5-47d0-a8a6-42bcb8ddcddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:08.009227 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-44ebf3ff-acf5-47d0-a8a6-42bcb8ddcddf None None] MFA Rules not processed for user `eb120cde66b246909cf8e0b7b8d96ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:08.012704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-44ebf3ff-acf5-47d0-a8a6-42bcb8ddcddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:08.037601 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 831/1667] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Dec 15 03:03:07 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:08.065813 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cee960-d817-4e63-8d13-89a434e979ad None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:08.080695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cee960-d817-4e63-8d13-89a434e979ad None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:08.085101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b61ed-858a-4d87-a3d0-7f2b846493ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:08.085855 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b61ed-858a-4d87-a3d0-7f2b846493ba service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:08.086264 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b61ed-858a-4d87-a3d0-7f2b846493ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:08.086757 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b61ed-858a-4d87-a3d0-7f2b846493ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:08.099530 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b61ed-858a-4d87-a3d0-7f2b846493ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:08.101071 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b61ed-858a-4d87-a3d0-7f2b846493ba service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:08.110823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 837/1668] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:08 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:08.222268 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa24995-053c-4fab-9c81-4139489a5ca8 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:08.222812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa24995-053c-4fab-9c81-4139489a5ca8 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:08.222812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa24995-053c-4fab-9c81-4139489a5ca8 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:08.224604 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 832/1669] 10.222.0.18 () {54 vars in 912 bytes} [Wed Dec 15 03:03:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:03:08.236148 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01941d8-453f-461c-a6bd-ee1d03633212 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:08.245928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01941d8-453f-461c-a6bd-ee1d03633212 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:08.250829 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01941d8-453f-461c-a6bd-ee1d03633212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:08.287397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-b01941d8-453f-461c-a6bd-ee1d03633212 None None] MFA Rules not processed for user `eb120cde66b246909cf8e0b7b8d96ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:08.291508 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b01941d8-453f-461c-a6bd-ee1d03633212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:08.301430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 838/1670] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Dec 15 03:03:08 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:08.321665 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa24995-053c-4fab-9c81-4139489a5ca8 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:08.323446 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-efa24995-053c-4fab-9c81-4139489a5ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:08.324004 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01941d8-453f-461c-a6bd-ee1d03633212 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:08.325707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b01941d8-453f-461c-a6bd-ee1d03633212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:08.346245 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01941d8-453f-461c-a6bd-ee1d03633212 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:08.347838 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa24995-053c-4fab-9c81-4139489a5ca8 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:08.354025 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a138d3e-f709-44f3-a132-cb2ef910dc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:08.355261 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a138d3e-f709-44f3-a132-cb2ef910dc4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:08.355708 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a138d3e-f709-44f3-a132-cb2ef910dc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:08.356143 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a138d3e-f709-44f3-a132-cb2ef910dc4a admin admin] PATH_INFO: `/v3/projects/7b807e9c11e54d378da0f2662cba831e` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:08.357648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a138d3e-f709-44f3-a132-cb2ef910dc4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b807e9c11e54d378da0f2662cba831e)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:08.360886 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a138d3e-f709-44f3-a132-cb2ef910dc4a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:08.362658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732b13c-1eab-44dc-8792-e95fa81f04cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:08.363538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732b13c-1eab-44dc-8792-e95fa81f04cc service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:08.363831 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732b13c-1eab-44dc-8792-e95fa81f04cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:08.364563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732b13c-1eab-44dc-8792-e95fa81f04cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:08.385423 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732b13c-1eab-44dc-8792-e95fa81f04cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:08.391768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732b13c-1eab-44dc-8792-e95fa81f04cc service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:08.414616 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 833/1671] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:08 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:08.440764 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6a138d3e-f709-44f3-a132-cb2ef910dc4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b807e9c11e54d378da0f2662cba831e', 'request_id': 'req-6a138d3e-f709-44f3-a132-cb2ef910dc4a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:08.471011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6a138d3e-f709-44f3-a132-cb2ef910dc4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b807e9c11e54d378da0f2662cba831e', 'request_id': 'req-6a138d3e-f709-44f3-a132-cb2ef910dc4a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:08.479945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6a138d3e-f709-44f3-a132-cb2ef910dc4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b807e9c11e54d378da0f2662cba831e', 'request_id': 'req-6a138d3e-f709-44f3-a132-cb2ef910dc4a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:08.504643 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6a138d3e-f709-44f3-a132-cb2ef910dc4a admin admin] The token cache is being invalidate because project 7b807e9c11e54d378da0f2662cba831e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:08.504938 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6a138d3e-f709-44f3-a132-cb2ef910dc4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:08.506925 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6a138d3e-f709-44f3-a132-cb2ef910dc4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:08.512740 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 839/1672] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:08 2021] DELETE /identity/v3/projects/7b807e9c11e54d378da0f2662cba831e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:03:08.514055 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732b13c-1eab-44dc-8792-e95fa81f04cc service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:08.529145 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732b13c-1eab-44dc-8792-e95fa81f04cc service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:08.658784 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d9d9f-df90-435c-bd77-57319f14f631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:08.662534 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d9d9f-df90-435c-bd77-57319f14f631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:08.663071 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d9d9f-df90-435c-bd77-57319f14f631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:08.664362 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d9d9f-df90-435c-bd77-57319f14f631 admin admin] PATH_INFO: `/v3/users/a0748aee42d3492599f7320f84562a9d` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:08.667470 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d9d9f-df90-435c-bd77-57319f14f631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0748aee42d3492599f7320f84562a9d)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:08.671052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d9d9f-df90-435c-bd77-57319f14f631 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:08.766877 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-677d9d9f-df90-435c-bd77-57319f14f631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0748aee42d3492599f7320f84562a9d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:08.790386 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-677d9d9f-df90-435c-bd77-57319f14f631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0748aee42d3492599f7320f84562a9d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:08.810708 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-677d9d9f-df90-435c-bd77-57319f14f631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0748aee42d3492599f7320f84562a9d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:08.822590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-677d9d9f-df90-435c-bd77-57319f14f631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0748aee42d3492599f7320f84562a9d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:08.824441 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-677d9d9f-df90-435c-bd77-57319f14f631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0748aee42d3492599f7320f84562a9d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:08.838119 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 834/1673] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:08 2021] DELETE /identity/v3/users/a0748aee42d3492599f7320f84562a9d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:08.951941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a138d3e-f709-44f3-a132-cb2ef910dc4a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:08.953387 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6a138d3e-f709-44f3-a132-cb2ef910dc4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:09.144902 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a138d3e-f709-44f3-a132-cb2ef910dc4a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:09.305425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8efb73-869b-4e2c-b09a-87142da04692 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93762c21f03d44d5bf3881d17e14ef90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:09.306375 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8efb73-869b-4e2c-b09a-87142da04692 service placement] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:09.306889 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8efb73-869b-4e2c-b09a-87142da04692 service placement] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:09.307466 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8efb73-869b-4e2c-b09a-87142da04692 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:09.314924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7f8efb73-869b-4e2c-b09a-87142da04692 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:09.338865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8efb73-869b-4e2c-b09a-87142da04692 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:09.340549 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8efb73-869b-4e2c-b09a-87142da04692 service placement] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:09.377122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 840/1674] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:03:09.424335 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d9d9f-df90-435c-bd77-57319f14f631 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:09.425831 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-677d9d9f-df90-435c-bd77-57319f14f631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:09.538925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d9d9f-df90-435c-bd77-57319f14f631 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:09.546016 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b481f-aecf-4b6a-8fb1-990e27bfcd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:09.547149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b481f-aecf-4b6a-8fb1-990e27bfcd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:09.547548 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b481f-aecf-4b6a-8fb1-990e27bfcd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:09.547974 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b481f-aecf-4b6a-8fb1-990e27bfcd85 admin admin] PATH_INFO: `/v3/projects/d788925bf2f4432ab15aec2f385e9c26` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:09.549474 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b481f-aecf-4b6a-8fb1-990e27bfcd85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d788925bf2f4432ab15aec2f385e9c26)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:09.550846 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING py.warnings [None req-cb5b481f-aecf-4b6a-8fb1-990e27bfcd85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:03:09.550846 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: warnings.warn(msg) Dec 15 03:03:09.550846 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: Dec 15 03:03:09.552417 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b481f-aecf-4b6a-8fb1-990e27bfcd85 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:09.660406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cb5b481f-aecf-4b6a-8fb1-990e27bfcd85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd788925bf2f4432ab15aec2f385e9c26', 'request_id': 'req-cb5b481f-aecf-4b6a-8fb1-990e27bfcd85'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:09.674808 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cb5b481f-aecf-4b6a-8fb1-990e27bfcd85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd788925bf2f4432ab15aec2f385e9c26', 'request_id': 'req-cb5b481f-aecf-4b6a-8fb1-990e27bfcd85'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:09.702538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cb5b481f-aecf-4b6a-8fb1-990e27bfcd85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd788925bf2f4432ab15aec2f385e9c26', 'request_id': 'req-cb5b481f-aecf-4b6a-8fb1-990e27bfcd85'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:09.730880 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cb5b481f-aecf-4b6a-8fb1-990e27bfcd85 admin admin] The token cache is being invalidate because project d788925bf2f4432ab15aec2f385e9c26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:09.731363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cb5b481f-aecf-4b6a-8fb1-990e27bfcd85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:09.735199 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cb5b481f-aecf-4b6a-8fb1-990e27bfcd85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:09.739327 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 835/1675] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:09 2021] DELETE /identity/v3/projects/d788925bf2f4432ab15aec2f385e9c26 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:09.744823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700d57-73ec-424a-aae9-5dc32f876640 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:09.745365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700d57-73ec-424a-aae9-5dc32f876640 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:09.745860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700d57-73ec-424a-aae9-5dc32f876640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:09.797808 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-0d700d57-73ec-424a-aae9-5dc32f876640 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:09.801356 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-0d700d57-73ec-424a-aae9-5dc32f876640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:09.978021 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 841/1676] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:10.034823 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2368c5-8832-42bf-ae2a-2f01e5fdd083 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:10.036115 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2368c5-8832-42bf-ae2a-2f01e5fdd083 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:10.036616 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2368c5-8832-42bf-ae2a-2f01e5fdd083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:10.082156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-8b2368c5-8832-42bf-ae2a-2f01e5fdd083 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:10.097069 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8b2368c5-8832-42bf-ae2a-2f01e5fdd083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:10.135000 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 836/1677] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:10.140456 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d700d57-73ec-424a-aae9-5dc32f876640 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:10.161550 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d700d57-73ec-424a-aae9-5dc32f876640 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:10.183038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4035d93-49b6-4f0d-ab63-79bbac8febd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:10.185234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4035d93-49b6-4f0d-ab63-79bbac8febd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:10.185522 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4035d93-49b6-4f0d-ab63-79bbac8febd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:10.186716 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4035d93-49b6-4f0d-ab63-79bbac8febd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:10.189028 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4035d93-49b6-4f0d-ab63-79bbac8febd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:10.190178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4035d93-49b6-4f0d-ab63-79bbac8febd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:10.210077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4035d93-49b6-4f0d-ab63-79bbac8febd3 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:10.259663 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 842/1678] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:10.265155 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2368c5-8832-42bf-ae2a-2f01e5fdd083 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:10.281491 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2368c5-8832-42bf-ae2a-2f01e5fdd083 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:10.301499 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb74a0-111a-488d-85bf-60bc228b581e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:10.303221 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb74a0-111a-488d-85bf-60bc228b581e admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:10.307804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb74a0-111a-488d-85bf-60bc228b581e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:10.308097 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb74a0-111a-488d-85bf-60bc228b581e admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:10.311096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb74a0-111a-488d-85bf-60bc228b581e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:10.317214 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb74a0-111a-488d-85bf-60bc228b581e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:10.401247 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 837/1679] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:10 2021] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:03:10.405887 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4035d93-49b6-4f0d-ab63-79bbac8febd3 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:10.423351 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4035d93-49b6-4f0d-ab63-79bbac8febd3 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:10.582792 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b465e9d-1597-44c3-8791-4236e3827bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:10.583469 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b465e9d-1597-44c3-8791-4236e3827bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:10.583961 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b465e9d-1597-44c3-8791-4236e3827bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:10.584483 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b465e9d-1597-44c3-8791-4236e3827bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:10.591469 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b465e9d-1597-44c3-8791-4236e3827bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:10.601752 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b465e9d-1597-44c3-8791-4236e3827bd2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:10.647136 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 843/1680] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:10 2021] POST /identity/v3/users => generated 294 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:10.651420 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb74a0-111a-488d-85bf-60bc228b581e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:10.668058 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb74a0-111a-488d-85bf-60bc228b581e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:10.678904 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37ca6f-8778-4e63-8646-0e59ee3e209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:10.679590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37ca6f-8778-4e63-8646-0e59ee3e209e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:10.679867 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37ca6f-8778-4e63-8646-0e59ee3e209e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:10.680334 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37ca6f-8778-4e63-8646-0e59ee3e209e admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:10.681289 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37ca6f-8778-4e63-8646-0e59ee3e209e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:10.683010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37ca6f-8778-4e63-8646-0e59ee3e209e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:10.706782 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 838/1681] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:10 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:10.708673 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b465e9d-1597-44c3-8791-4236e3827bd2 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:10.727619 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b465e9d-1597-44c3-8791-4236e3827bd2 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:10.735808 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35ec30-c65a-4da2-b8bf-b8dd0012727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:10.737505 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35ec30-c65a-4da2-b8bf-b8dd0012727a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:10.739080 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35ec30-c65a-4da2-b8bf-b8dd0012727a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:10.739621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35ec30-c65a-4da2-b8bf-b8dd0012727a admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:10.741075 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35ec30-c65a-4da2-b8bf-b8dd0012727a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:10.745100 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35ec30-c65a-4da2-b8bf-b8dd0012727a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:10.781958 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 844/1682] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:10 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:03:10.782793 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37ca6f-8778-4e63-8646-0e59ee3e209e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:10.848358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37ca6f-8778-4e63-8646-0e59ee3e209e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:10.848358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c511a1-78cb-4c12-af9c-adeda9fbca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:10.848358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c511a1-78cb-4c12-af9c-adeda9fbca58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:10.848358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c511a1-78cb-4c12-af9c-adeda9fbca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:10.848938 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c511a1-78cb-4c12-af9c-adeda9fbca58 admin admin] PATH_INFO: `/v3/projects/41e0afd9b78440f9ac54447fe093e568/users/17d7c8ebe3e94477978dd7be32edb395/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:10.848938 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c511a1-78cb-4c12-af9c-adeda9fbca58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e0afd9b78440f9ac54447fe093e568, user_id=17d7c8ebe3e94477978dd7be32edb395, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:10.848938 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c511a1-78cb-4c12-af9c-adeda9fbca58 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:10.888550 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 839/1683] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:10 2021] PUT /identity/v3/projects/41e0afd9b78440f9ac54447fe093e568/users/17d7c8ebe3e94477978dd7be32edb395/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:10.899593 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dabac9-bcfb-42e6-9187-28dcb0a952da None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:10.900053 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dabac9-bcfb-42e6-9187-28dcb0a952da None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:10.900431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dabac9-bcfb-42e6-9187-28dcb0a952da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:10.949107 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-f8dabac9-bcfb-42e6-9187-28dcb0a952da None None] MFA Rules not processed for user `17d7c8ebe3e94477978dd7be32edb395`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:10.950897 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f8dabac9-bcfb-42e6-9187-28dcb0a952da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:11.050407 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 845/1684] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:10 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:11.055424 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c511a1-78cb-4c12-af9c-adeda9fbca58 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:11.191156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c511a1-78cb-4c12-af9c-adeda9fbca58 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:11.221541 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb0dfb-df63-45cd-99c5-847b88113835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:11.222342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb0dfb-df63-45cd-99c5-847b88113835 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:11.223986 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb0dfb-df63-45cd-99c5-847b88113835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:11.223986 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb0dfb-df63-45cd-99c5-847b88113835 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:11.224277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb0dfb-df63-45cd-99c5-847b88113835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:11.226375 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb0dfb-df63-45cd-99c5-847b88113835 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:11.289185 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 840/1685] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:11 2021] POST /identity/v3/projects => generated 387 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:11.293663 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dabac9-bcfb-42e6-9187-28dcb0a952da None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:11.310872 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dabac9-bcfb-42e6-9187-28dcb0a952da None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:11.407365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127864a-54a3-4ea0-b7b3-0e7e0ec6c632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:11.421827 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127864a-54a3-4ea0-b7b3-0e7e0ec6c632 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:11.422175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127864a-54a3-4ea0-b7b3-0e7e0ec6c632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:11.422454 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127864a-54a3-4ea0-b7b3-0e7e0ec6c632 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:11.438422 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127864a-54a3-4ea0-b7b3-0e7e0ec6c632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:11.440398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127864a-54a3-4ea0-b7b3-0e7e0ec6c632 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:11.485892 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 846/1686] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:11 2021] POST /identity/v3/users => generated 300 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:11.487014 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb0dfb-df63-45cd-99c5-847b88113835 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:11.512824 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb0dfb-df63-45cd-99c5-847b88113835 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:11.541784 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8e3a4-21d3-4610-aa4e-d18ebb93dc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:11.542629 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8e3a4-21d3-4610-aa4e-d18ebb93dc6c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:11.543914 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8e3a4-21d3-4610-aa4e-d18ebb93dc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:11.544207 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8e3a4-21d3-4610-aa4e-d18ebb93dc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:11.548136 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8e3a4-21d3-4610-aa4e-d18ebb93dc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:11.551558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8e3a4-21d3-4610-aa4e-d18ebb93dc6c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:11.580937 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 841/1687] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:11 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:11.582236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127864a-54a3-4ea0-b7b3-0e7e0ec6c632 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:11.599462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127864a-54a3-4ea0-b7b3-0e7e0ec6c632 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:11.620977 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb7e5c-a0a1-46b5-accb-ee5e4c759815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:11.622268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb7e5c-a0a1-46b5-accb-ee5e4c759815 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:11.624550 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb7e5c-a0a1-46b5-accb-ee5e4c759815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:11.625845 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb7e5c-a0a1-46b5-accb-ee5e4c759815 admin admin] PATH_INFO: `/v3/projects/7b276fd8a554404a9fcd4d70f10f0e66/users/a2f9212a9db942239481c23c8bafb90a/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:11.670969 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb7e5c-a0a1-46b5-accb-ee5e4c759815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b276fd8a554404a9fcd4d70f10f0e66, user_id=a2f9212a9db942239481c23c8bafb90a, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:11.674315 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb7e5c-a0a1-46b5-accb-ee5e4c759815 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:11.700981 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 847/1688] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:11 2021] PUT /identity/v3/projects/7b276fd8a554404a9fcd4d70f10f0e66/users/a2f9212a9db942239481c23c8bafb90a/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:11.705426 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8e3a4-21d3-4610-aa4e-d18ebb93dc6c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:11.720933 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8e3a4-21d3-4610-aa4e-d18ebb93dc6c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:11.803826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d03fd-8c48-4849-b13b-fb55761f8c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:11.804794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d03fd-8c48-4849-b13b-fb55761f8c7b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:11.805304 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d03fd-8c48-4849-b13b-fb55761f8c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:11.805646 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d03fd-8c48-4849-b13b-fb55761f8c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:11.806706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d03fd-8c48-4849-b13b-fb55761f8c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:11.809130 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d03fd-8c48-4849-b13b-fb55761f8c7b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:11.821104 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 842/1689] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:11 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:11.826076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb7e5c-a0a1-46b5-accb-ee5e4c759815 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:11.840458 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb7e5c-a0a1-46b5-accb-ee5e4c759815 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:11.845733 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccea8d-e177-44dd-9f6d-74872df951e2 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:11.846194 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccea8d-e177-44dd-9f6d-74872df951e2 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:11.846462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc83c8e-166e-405f-bc1b-5d62dcf845ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:11.846721 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccea8d-e177-44dd-9f6d-74872df951e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:11.847647 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc83c8e-166e-405f-bc1b-5d62dcf845ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:11.847922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc83c8e-166e-405f-bc1b-5d62dcf845ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:11.848195 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc83c8e-166e-405f-bc1b-5d62dcf845ce admin admin] PATH_INFO: `/v3/projects/7b276fd8a554404a9fcd4d70f10f0e66/users/a2f9212a9db942239481c23c8bafb90a/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:11.850456 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc83c8e-166e-405f-bc1b-5d62dcf845ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b276fd8a554404a9fcd4d70f10f0e66, user_id=a2f9212a9db942239481c23c8bafb90a, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:11.854687 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc83c8e-166e-405f-bc1b-5d62dcf845ce admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:11.869921 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 848/1690] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:11 2021] PUT /identity/v3/projects/7b276fd8a554404a9fcd4d70f10f0e66/users/a2f9212a9db942239481c23c8bafb90a/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:11.885007 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbbbbb-4a8b-4ea3-813c-85a49fadd58b None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:11.885540 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbbbbb-4a8b-4ea3-813c-85a49fadd58b None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:11.887229 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbbbbb-4a8b-4ea3-813c-85a49fadd58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:11.892390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-d5ccea8d-e177-44dd-9f6d-74872df951e2 None None] MFA Rules not processed for user `6ea02b6e8f1548a1bd78952cb7337403`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:11.894117 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d5ccea8d-e177-44dd-9f6d-74872df951e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:11.940439 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-fadbbbbb-4a8b-4ea3-813c-85a49fadd58b None None] MFA Rules not processed for user `a2f9212a9db942239481c23c8bafb90a`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:11.942621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-fadbbbbb-4a8b-4ea3-813c-85a49fadd58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:12.016965 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 843/1691] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:11 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:12.027539 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003b09a-25a3-48d2-90b4-a3e32c7faf7d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:12.028028 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003b09a-25a3-48d2-90b4-a3e32c7faf7d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:12.028406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003b09a-25a3-48d2-90b4-a3e32c7faf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:12.053940 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-7003b09a-25a3-48d2-90b4-a3e32c7faf7d None None] MFA Rules not processed for user `6ea02b6e8f1548a1bd78952cb7337403`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:12.056259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-7003b09a-25a3-48d2-90b4-a3e32c7faf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:12.083190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 844/1692] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:12 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:12.104170 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003b09a-25a3-48d2-90b4-a3e32c7faf7d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:12.107277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-7003b09a-25a3-48d2-90b4-a3e32c7faf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:12.130455 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 849/1693] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:11 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:12.131507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbbbbb-4a8b-4ea3-813c-85a49fadd58b None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:12.136288 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-fadbbbbb-4a8b-4ea3-813c-85a49fadd58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:12.198256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003b09a-25a3-48d2-90b4-a3e32c7faf7d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:12.205421 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9e281-7000-40db-bd0f-29944ae4e299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:12.206208 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9e281-7000-40db-bd0f-29944ae4e299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:12.206868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9e281-7000-40db-bd0f-29944ae4e299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:12.206868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9e281-7000-40db-bd0f-29944ae4e299 admin admin] PATH_INFO: `/v3/users/6b7268a5072b49628d28d6412a1cda8c` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:12.208091 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9e281-7000-40db-bd0f-29944ae4e299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7268a5072b49628d28d6412a1cda8c)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:12.210310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9e281-7000-40db-bd0f-29944ae4e299 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:12.235284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbbbbb-4a8b-4ea3-813c-85a49fadd58b None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:12.245648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470ebd9-a34a-4420-96dc-48c2f7a19b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:12.246922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470ebd9-a34a-4420-96dc-48c2f7a19b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:12.247337 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470ebd9-a34a-4420-96dc-48c2f7a19b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:12.247527 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470ebd9-a34a-4420-96dc-48c2f7a19b0f admin admin] PATH_INFO: `/v3/users/e29a665906e24d078297b673d7cc8667` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:12.251893 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470ebd9-a34a-4420-96dc-48c2f7a19b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e29a665906e24d078297b673d7cc8667)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:12.254529 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470ebd9-a34a-4420-96dc-48c2f7a19b0f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:12.275047 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-f8d9e281-7000-40db-bd0f-29944ae4e299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7268a5072b49628d28d6412a1cda8c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:12.306334 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-f8d9e281-7000-40db-bd0f-29944ae4e299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7268a5072b49628d28d6412a1cda8c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:12.319723 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-f8d9e281-7000-40db-bd0f-29944ae4e299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7268a5072b49628d28d6412a1cda8c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:12.344400 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-f8d9e281-7000-40db-bd0f-29944ae4e299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7268a5072b49628d28d6412a1cda8c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:12.345644 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-f8d9e281-7000-40db-bd0f-29944ae4e299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7268a5072b49628d28d6412a1cda8c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:12.355848 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e470ebd9-a34a-4420-96dc-48c2f7a19b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e29a665906e24d078297b673d7cc8667'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:12.368975 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 845/1694] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:12 2021] DELETE /identity/v3/users/6b7268a5072b49628d28d6412a1cda8c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:12.368975 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9e281-7000-40db-bd0f-29944ae4e299 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:12.370447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f8d9e281-7000-40db-bd0f-29944ae4e299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:12.376379 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e470ebd9-a34a-4420-96dc-48c2f7a19b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e29a665906e24d078297b673d7cc8667'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:12.387906 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e470ebd9-a34a-4420-96dc-48c2f7a19b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e29a665906e24d078297b673d7cc8667'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:12.389665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e470ebd9-a34a-4420-96dc-48c2f7a19b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e29a665906e24d078297b673d7cc8667'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:12.390797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e470ebd9-a34a-4420-96dc-48c2f7a19b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e29a665906e24d078297b673d7cc8667'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:12.411016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 850/1695] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:12 2021] DELETE /identity/v3/users/e29a665906e24d078297b673d7cc8667 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:12.411016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470ebd9-a34a-4420-96dc-48c2f7a19b0f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:12.411354 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e470ebd9-a34a-4420-96dc-48c2f7a19b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:12.463618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9e281-7000-40db-bd0f-29944ae4e299 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:12.470333 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470ebd9-a34a-4420-96dc-48c2f7a19b0f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:12.474241 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507ff40-5a98-4ee1-8fee-f4336f17b0da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:12.475126 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507ff40-5a98-4ee1-8fee-f4336f17b0da service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:12.475490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507ff40-5a98-4ee1-8fee-f4336f17b0da service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:12.475819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507ff40-5a98-4ee1-8fee-f4336f17b0da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:12.477713 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d507ff40-5a98-4ee1-8fee-f4336f17b0da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:12.533930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074856e-22a0-489b-86c1-c4117ec8a0fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:12.534618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074856e-22a0-489b-86c1-c4117ec8a0fc service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:12.534893 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074856e-22a0-489b-86c1-c4117ec8a0fc service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:12.535163 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074856e-22a0-489b-86c1-c4117ec8a0fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:12.537102 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-2074856e-22a0-489b-86c1-c4117ec8a0fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:12.552315 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507ff40-5a98-4ee1-8fee-f4336f17b0da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:12.553887 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507ff40-5a98-4ee1-8fee-f4336f17b0da service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:12.582081 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 851/1696] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:12 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:12.584600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbfebc-3a5a-4e8e-9d51-5886bb1ca749 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:12.585452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbfebc-3a5a-4e8e-9d51-5886bb1ca749 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:12.585840 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbfebc-3a5a-4e8e-9d51-5886bb1ca749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:12.600925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074856e-22a0-489b-86c1-c4117ec8a0fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:12.606307 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074856e-22a0-489b-86c1-c4117ec8a0fc service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:12.615206 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-aabbfebc-3a5a-4e8e-9d51-5886bb1ca749 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:12.615206 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-aabbfebc-3a5a-4e8e-9d51-5886bb1ca749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:12.620723 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 846/1697] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:12 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:12.624486 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d559c7-ecd2-4247-9e53-76891decd398 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:12.629601 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d559c7-ecd2-4247-9e53-76891decd398 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:12.630155 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d559c7-ecd2-4247-9e53-76891decd398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:12.673787 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-d0d559c7-ecd2-4247-9e53-76891decd398 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:12.675038 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d0d559c7-ecd2-4247-9e53-76891decd398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:12.716048 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 852/1698] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:12.717731 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbfebc-3a5a-4e8e-9d51-5886bb1ca749 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:12.719231 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-aabbfebc-3a5a-4e8e-9d51-5886bb1ca749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:12.743915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbfebc-3a5a-4e8e-9d51-5886bb1ca749 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:12.751568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cae3d5-792e-4b84-8e69-beb3d6bceb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:12.756415 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cae3d5-792e-4b84-8e69-beb3d6bceb6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:12.756844 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cae3d5-792e-4b84-8e69-beb3d6bceb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:12.757228 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cae3d5-792e-4b84-8e69-beb3d6bceb6b admin admin] PATH_INFO: `/v3/users/17d7c8ebe3e94477978dd7be32edb395` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:12.758712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cae3d5-792e-4b84-8e69-beb3d6bceb6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d7c8ebe3e94477978dd7be32edb395)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:12.761812 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cae3d5-792e-4b84-8e69-beb3d6bceb6b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:12.803001 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 847/1699] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:12.803895 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d559c7-ecd2-4247-9e53-76891decd398 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:12.807290 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d0d559c7-ecd2-4247-9e53-76891decd398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:12.837106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-66cae3d5-792e-4b84-8e69-beb3d6bceb6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d7c8ebe3e94477978dd7be32edb395'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:12.864403 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-66cae3d5-792e-4b84-8e69-beb3d6bceb6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d7c8ebe3e94477978dd7be32edb395'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:12.882937 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-66cae3d5-792e-4b84-8e69-beb3d6bceb6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d7c8ebe3e94477978dd7be32edb395'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:12.884083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-66cae3d5-792e-4b84-8e69-beb3d6bceb6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d7c8ebe3e94477978dd7be32edb395'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:12.884770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-66cae3d5-792e-4b84-8e69-beb3d6bceb6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d7c8ebe3e94477978dd7be32edb395'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:12.907278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d559c7-ecd2-4247-9e53-76891decd398 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:12.917739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 853/1700] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:12 2021] DELETE /identity/v3/users/17d7c8ebe3e94477978dd7be32edb395 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:12.920125 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cae3d5-792e-4b84-8e69-beb3d6bceb6b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:12.923965 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-66cae3d5-792e-4b84-8e69-beb3d6bceb6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:12.964986 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d419400-0bdc-467f-9b10-8bf9140a8165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:12.965639 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d419400-0bdc-467f-9b10-8bf9140a8165 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:12.965966 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d419400-0bdc-467f-9b10-8bf9140a8165 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:12.966274 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d419400-0bdc-467f-9b10-8bf9140a8165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:12.969282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1d419400-0bdc-467f-9b10-8bf9140a8165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:13.026817 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cae3d5-792e-4b84-8e69-beb3d6bceb6b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:13.031187 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542ac15-d286-4d85-a1d7-514b434e6fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:13.031971 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542ac15-d286-4d85-a1d7-514b434e6fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:13.032343 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542ac15-d286-4d85-a1d7-514b434e6fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:13.032618 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542ac15-d286-4d85-a1d7-514b434e6fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:13.034629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-1542ac15-d286-4d85-a1d7-514b434e6fd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:13.063355 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d419400-0bdc-467f-9b10-8bf9140a8165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:13.065172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d419400-0bdc-467f-9b10-8bf9140a8165 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:13.081118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 848/1701] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:13.082627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b64a6-a640-421e-9b35-e5d74da349b0 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:13.082915 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b64a6-a640-421e-9b35-e5d74da349b0 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:13.083186 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b64a6-a640-421e-9b35-e5d74da349b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:13.130428 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-e19b64a6-a640-421e-9b35-e5d74da349b0 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:13.131682 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e19b64a6-a640-421e-9b35-e5d74da349b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:13.152361 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 849/1702] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:13.171423 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542ac15-d286-4d85-a1d7-514b434e6fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:13.173159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542ac15-d286-4d85-a1d7-514b434e6fd8 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:13.195467 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 854/1703] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:13.211756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b64a6-a640-421e-9b35-e5d74da349b0 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:13.218318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e19b64a6-a640-421e-9b35-e5d74da349b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:13.231626 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b64a6-a640-421e-9b35-e5d74da349b0 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:13.240294 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde181d7-8157-419a-967b-43b723061979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:13.241340 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde181d7-8157-419a-967b-43b723061979 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:13.241632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde181d7-8157-419a-967b-43b723061979 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:13.242002 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde181d7-8157-419a-967b-43b723061979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:13.269210 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde181d7-8157-419a-967b-43b723061979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:13.270708 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde181d7-8157-419a-967b-43b723061979 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:13.294580 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 850/1704] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:13.615091 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542ac15-d286-4d85-a1d7-514b434e6fd8 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:13.616851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-1542ac15-d286-4d85-a1d7-514b434e6fd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:13.634657 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542ac15-d286-4d85-a1d7-514b434e6fd8 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:13.644344 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605b81f-5a04-4255-80a7-2276e4be611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:13.645497 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605b81f-5a04-4255-80a7-2276e4be611c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:13.647213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605b81f-5a04-4255-80a7-2276e4be611c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:13.647660 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605b81f-5a04-4255-80a7-2276e4be611c admin admin] PATH_INFO: `/v3/projects/9b91f7569f3f490f92d6d9a6c404af21` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:13.649088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605b81f-5a04-4255-80a7-2276e4be611c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b91f7569f3f490f92d6d9a6c404af21)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:13.657461 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605b81f-5a04-4255-80a7-2276e4be611c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:13.734386 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36291c3-a7d5-46fe-8bb0-fb48a9b7e9fe None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:13.734943 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36291c3-a7d5-46fe-8bb0-fb48a9b7e9fe None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:13.735470 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36291c3-a7d5-46fe-8bb0-fb48a9b7e9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:13.759071 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f605b81f-5a04-4255-80a7-2276e4be611c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b91f7569f3f490f92d6d9a6c404af21', 'request_id': 'req-f605b81f-5a04-4255-80a7-2276e4be611c'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:13.771905 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f605b81f-5a04-4255-80a7-2276e4be611c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b91f7569f3f490f92d6d9a6c404af21', 'request_id': 'req-f605b81f-5a04-4255-80a7-2276e4be611c'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:13.786242 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-f36291c3-a7d5-46fe-8bb0-fb48a9b7e9fe None None] MFA Rules not processed for user `6ea02b6e8f1548a1bd78952cb7337403`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:13.789784 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f36291c3-a7d5-46fe-8bb0-fb48a9b7e9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:13.801497 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f605b81f-5a04-4255-80a7-2276e4be611c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b91f7569f3f490f92d6d9a6c404af21', 'request_id': 'req-f605b81f-5a04-4255-80a7-2276e4be611c'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:13.818429 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f605b81f-5a04-4255-80a7-2276e4be611c admin admin] The token cache is being invalidate because project 9b91f7569f3f490f92d6d9a6c404af21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:13.818923 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f605b81f-5a04-4255-80a7-2276e4be611c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:13.820158 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f605b81f-5a04-4255-80a7-2276e4be611c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:13.822217 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 855/1705] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:13 2021] DELETE /identity/v3/projects/9b91f7569f3f490f92d6d9a6c404af21 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:13.824834 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605b81f-5a04-4255-80a7-2276e4be611c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:13.827275 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f605b81f-5a04-4255-80a7-2276e4be611c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:13.897570 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 851/1706] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:13 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:03:13.910234 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6422eb-4805-428d-b78c-125c9ee8b96a None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:13.914415 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6422eb-4805-428d-b78c-125c9ee8b96a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:13.914798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6422eb-4805-428d-b78c-125c9ee8b96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:13.950315 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-0e6422eb-4805-428d-b78c-125c9ee8b96a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:13.952587 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0e6422eb-4805-428d-b78c-125c9ee8b96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:13.970358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 852/1707] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:13.971856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6422eb-4805-428d-b78c-125c9ee8b96a None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:13.973608 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0e6422eb-4805-428d-b78c-125c9ee8b96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:13.982957 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605b81f-5a04-4255-80a7-2276e4be611c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:13.994230 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a94486-95c4-4b1d-9a3d-ffe74f709a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:14.034069 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6422eb-4805-428d-b78c-125c9ee8b96a None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:14.034264 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a94486-95c4-4b1d-9a3d-ffe74f709a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:14.034264 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a94486-95c4-4b1d-9a3d-ffe74f709a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:14.034264 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a94486-95c4-4b1d-9a3d-ffe74f709a47 admin admin] PATH_INFO: `/v3/projects/9b042c269cdd44ff92b3ec9661ab1f3d` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:14.034439 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322c05d-f761-47d6-97a1-4e631ac0dca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:14.034539 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a94486-95c4-4b1d-9a3d-ffe74f709a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b042c269cdd44ff92b3ec9661ab1f3d)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:14.034652 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322c05d-f761-47d6-97a1-4e631ac0dca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:14.034652 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322c05d-f761-47d6-97a1-4e631ac0dca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:14.034652 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322c05d-f761-47d6-97a1-4e631ac0dca0 admin admin] PATH_INFO: `/v3/projects/41e0afd9b78440f9ac54447fe093e568` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:14.034652 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322c05d-f761-47d6-97a1-4e631ac0dca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e0afd9b78440f9ac54447fe093e568)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:14.034889 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a94486-95c4-4b1d-9a3d-ffe74f709a47 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:14.034950 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322c05d-f761-47d6-97a1-4e631ac0dca0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:14.115267 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-16a94486-95c4-4b1d-9a3d-ffe74f709a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b042c269cdd44ff92b3ec9661ab1f3d', 'request_id': 'req-16a94486-95c4-4b1d-9a3d-ffe74f709a47'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.125384 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d322c05d-f761-47d6-97a1-4e631ac0dca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e0afd9b78440f9ac54447fe093e568', 'request_id': 'req-d322c05d-f761-47d6-97a1-4e631ac0dca0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.133392 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-16a94486-95c4-4b1d-9a3d-ffe74f709a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b042c269cdd44ff92b3ec9661ab1f3d', 'request_id': 'req-16a94486-95c4-4b1d-9a3d-ffe74f709a47'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.147343 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-16a94486-95c4-4b1d-9a3d-ffe74f709a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b042c269cdd44ff92b3ec9661ab1f3d', 'request_id': 'req-16a94486-95c4-4b1d-9a3d-ffe74f709a47'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.153721 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d322c05d-f761-47d6-97a1-4e631ac0dca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e0afd9b78440f9ac54447fe093e568', 'request_id': 'req-d322c05d-f761-47d6-97a1-4e631ac0dca0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.165815 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d322c05d-f761-47d6-97a1-4e631ac0dca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e0afd9b78440f9ac54447fe093e568', 'request_id': 'req-d322c05d-f761-47d6-97a1-4e631ac0dca0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.171708 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-16a94486-95c4-4b1d-9a3d-ffe74f709a47 admin admin] The token cache is being invalidate because project 9b042c269cdd44ff92b3ec9661ab1f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:14.172006 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-16a94486-95c4-4b1d-9a3d-ffe74f709a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.173077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-16a94486-95c4-4b1d-9a3d-ffe74f709a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.175949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 856/1708] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:13 2021] DELETE /identity/v3/projects/9b042c269cdd44ff92b3ec9661ab1f3d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:14.180997 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d322c05d-f761-47d6-97a1-4e631ac0dca0 admin admin] The token cache is being invalidate because project 41e0afd9b78440f9ac54447fe093e568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:14.181988 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d322c05d-f761-47d6-97a1-4e631ac0dca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.182152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd0236-1b80-4f2b-a235-bbe6edc1b388 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:14.182440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd0236-1b80-4f2b-a235-bbe6edc1b388 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:14.182720 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd0236-1b80-4f2b-a235-bbe6edc1b388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:14.183083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d322c05d-f761-47d6-97a1-4e631ac0dca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.184960 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 853/1709] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:13 2021] DELETE /identity/v3/projects/41e0afd9b78440f9ac54447fe093e568 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:14.186696 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322c05d-f761-47d6-97a1-4e631ac0dca0 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:14.190830 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d322c05d-f761-47d6-97a1-4e631ac0dca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:14.232107 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-e1dd0236-1b80-4f2b-a235-bbe6edc1b388 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:14.233387 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e1dd0236-1b80-4f2b-a235-bbe6edc1b388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:14.313806 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322c05d-f761-47d6-97a1-4e631ac0dca0 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:14.321692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 857/1710] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:14.322544 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd0236-1b80-4f2b-a235-bbe6edc1b388 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:14.325244 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e1dd0236-1b80-4f2b-a235-bbe6edc1b388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:14.338634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd0236-1b80-4f2b-a235-bbe6edc1b388 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:14.353588 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbd3df-cd95-456a-9afd-c41af2b18baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:14.355132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbd3df-cd95-456a-9afd-c41af2b18baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:14.355423 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbd3df-cd95-456a-9afd-c41af2b18baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:14.355703 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbd3df-cd95-456a-9afd-c41af2b18baa admin admin] PATH_INFO: `/v3/users/a2f9212a9db942239481c23c8bafb90a` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:14.361382 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbd3df-cd95-456a-9afd-c41af2b18baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f9212a9db942239481c23c8bafb90a)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:14.366332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbd3df-cd95-456a-9afd-c41af2b18baa admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:14.410814 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82a6b2-cf85-4a61-aecf-4cb4e1d7177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:14.411819 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82a6b2-cf85-4a61-aecf-4cb4e1d7177a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:14.412168 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82a6b2-cf85-4a61-aecf-4cb4e1d7177a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:14.412505 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82a6b2-cf85-4a61-aecf-4cb4e1d7177a admin admin] PATH_INFO: `/v3/users/6fe9b8cd54a74bc8bed61a4428bb3e01` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:14.413924 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82a6b2-cf85-4a61-aecf-4cb4e1d7177a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe9b8cd54a74bc8bed61a4428bb3e01)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:14.421811 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82a6b2-cf85-4a61-aecf-4cb4e1d7177a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:14.442958 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-edbbd3df-cd95-456a-9afd-c41af2b18baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f9212a9db942239481c23c8bafb90a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.470019 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-edbbd3df-cd95-456a-9afd-c41af2b18baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f9212a9db942239481c23c8bafb90a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.482172 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-edbbd3df-cd95-456a-9afd-c41af2b18baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f9212a9db942239481c23c8bafb90a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.482892 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-edbbd3df-cd95-456a-9afd-c41af2b18baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f9212a9db942239481c23c8bafb90a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.483567 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-edbbd3df-cd95-456a-9afd-c41af2b18baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f9212a9db942239481c23c8bafb90a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.493885 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-8a82a6b2-cf85-4a61-aecf-4cb4e1d7177a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe9b8cd54a74bc8bed61a4428bb3e01'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.501296 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 858/1711] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:14 2021] DELETE /identity/v3/users/a2f9212a9db942239481c23c8bafb90a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:14.506017 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbd3df-cd95-456a-9afd-c41af2b18baa admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:14.510842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-edbbd3df-cd95-456a-9afd-c41af2b18baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:14.523271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-8a82a6b2-cf85-4a61-aecf-4cb4e1d7177a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe9b8cd54a74bc8bed61a4428bb3e01'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.540253 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-8a82a6b2-cf85-4a61-aecf-4cb4e1d7177a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe9b8cd54a74bc8bed61a4428bb3e01'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.550737 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-8a82a6b2-cf85-4a61-aecf-4cb4e1d7177a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe9b8cd54a74bc8bed61a4428bb3e01'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.554336 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-8a82a6b2-cf85-4a61-aecf-4cb4e1d7177a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe9b8cd54a74bc8bed61a4428bb3e01'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:14.568131 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 854/1712] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:14 2021] DELETE /identity/v3/users/6fe9b8cd54a74bc8bed61a4428bb3e01 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:14.640138 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbd3df-cd95-456a-9afd-c41af2b18baa admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:14.742179 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e39b90-22ca-43dd-a2ed-27450b3e18a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:14.743201 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e39b90-22ca-43dd-a2ed-27450b3e18a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:14.744130 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e39b90-22ca-43dd-a2ed-27450b3e18a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:14.744567 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e39b90-22ca-43dd-a2ed-27450b3e18a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:14.745546 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e39b90-22ca-43dd-a2ed-27450b3e18a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:14.752058 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e39b90-22ca-43dd-a2ed-27450b3e18a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:14.768512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e39b90-22ca-43dd-a2ed-27450b3e18a6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:14.787907 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 859/1713] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:14.792315 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82a6b2-cf85-4a61-aecf-4cb4e1d7177a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:14.794088 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8a82a6b2-cf85-4a61-aecf-4cb4e1d7177a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:14.815889 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82a6b2-cf85-4a61-aecf-4cb4e1d7177a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:14.828225 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5d132-82a0-453e-9b8e-1389d65d5c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:14.829100 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5d132-82a0-453e-9b8e-1389d65d5c8e admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:14.829538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5d132-82a0-453e-9b8e-1389d65d5c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:14.829868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5d132-82a0-453e-9b8e-1389d65d5c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:14.830583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5d132-82a0-453e-9b8e-1389d65d5c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:14.832508 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5d132-82a0-453e-9b8e-1389d65d5c8e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:14.918954 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 855/1714] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:14 2021] POST /identity/v3/projects => generated 403 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:14.926549 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e39b90-22ca-43dd-a2ed-27450b3e18a6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:14.976579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e39b90-22ca-43dd-a2ed-27450b3e18a6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:14.995853 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5d132-82a0-453e-9b8e-1389d65d5c8e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:14.997731 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-3ce5d132-82a0-453e-9b8e-1389d65d5c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:15.077941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdc3eb-a8c5-4c90-875b-8be75ab10959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:15.079746 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdc3eb-a8c5-4c90-875b-8be75ab10959 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:15.080936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdc3eb-a8c5-4c90-875b-8be75ab10959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:15.081690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdc3eb-a8c5-4c90-875b-8be75ab10959 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:15.086299 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdc3eb-a8c5-4c90-875b-8be75ab10959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:15.088477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdc3eb-a8c5-4c90-875b-8be75ab10959 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:15.100248 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5d132-82a0-453e-9b8e-1389d65d5c8e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:15.111929 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:15.112855 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:15.113759 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:15.113759 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88 admin admin] PATH_INFO: `/v3/projects/7b276fd8a554404a9fcd4d70f10f0e66` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:15.114816 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b276fd8a554404a9fcd4d70f10f0e66)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:15.116878 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:15.134690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 860/1715] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:14 2021] POST /identity/v3/users => generated 302 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:15.136357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdc3eb-a8c5-4c90-875b-8be75ab10959 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:15.139602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-12cdc3eb-a8c5-4c90-875b-8be75ab10959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:15.166478 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdc3eb-a8c5-4c90-875b-8be75ab10959 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:15.184391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b276fd8a554404a9fcd4d70f10f0e66', 'request_id': 'req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:15.193671 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b276fd8a554404a9fcd4d70f10f0e66', 'request_id': 'req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:15.201850 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b276fd8a554404a9fcd4d70f10f0e66', 'request_id': 'req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:15.216222 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88 admin admin] The token cache is being invalidate because project 7b276fd8a554404a9fcd4d70f10f0e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:15.216785 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:15.218345 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:15.221234 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 856/1716] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:14 2021] DELETE /identity/v3/projects/7b276fd8a554404a9fcd4d70f10f0e66 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:15.222428 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:15.224865 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:15.267129 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f06a6-3717-4bd3-80ee-bffd3afbcf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:15.268319 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f06a6-3717-4bd3-80ee-bffd3afbcf8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:15.268790 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f06a6-3717-4bd3-80ee-bffd3afbcf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:15.269186 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f06a6-3717-4bd3-80ee-bffd3afbcf8b admin admin] PATH_INFO: `/v3/projects/14d65b8acb3a427ebba7da91d76c215a` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:15.271744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f06a6-3717-4bd3-80ee-bffd3afbcf8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d65b8acb3a427ebba7da91d76c215a)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:15.276933 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f06a6-3717-4bd3-80ee-bffd3afbcf8b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:15.484866 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-912f06a6-3717-4bd3-80ee-bffd3afbcf8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d65b8acb3a427ebba7da91d76c215a', 'request_id': 'req-912f06a6-3717-4bd3-80ee-bffd3afbcf8b'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:15.510999 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-912f06a6-3717-4bd3-80ee-bffd3afbcf8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d65b8acb3a427ebba7da91d76c215a', 'request_id': 'req-912f06a6-3717-4bd3-80ee-bffd3afbcf8b'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:15.524224 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ec3a7-5c07-4397-a1b2-27e0f99acb88 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:15.527641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-912f06a6-3717-4bd3-80ee-bffd3afbcf8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d65b8acb3a427ebba7da91d76c215a', 'request_id': 'req-912f06a6-3717-4bd3-80ee-bffd3afbcf8b'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:15.555056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-912f06a6-3717-4bd3-80ee-bffd3afbcf8b admin admin] The token cache is being invalidate because project 14d65b8acb3a427ebba7da91d76c215a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:15.555814 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-912f06a6-3717-4bd3-80ee-bffd3afbcf8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:15.556915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-912f06a6-3717-4bd3-80ee-bffd3afbcf8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:15.558604 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 861/1717] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:15 2021] DELETE /identity/v3/projects/14d65b8acb3a427ebba7da91d76c215a => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:15.579746 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad12eb-3dc6-489c-a0c7-f665e5cd88ea None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:15.580375 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad12eb-3dc6-489c-a0c7-f665e5cd88ea None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:15.580792 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad12eb-3dc6-489c-a0c7-f665e5cd88ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:15.621803 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-dcad12eb-3dc6-489c-a0c7-f665e5cd88ea None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:15.623880 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-dcad12eb-3dc6-489c-a0c7-f665e5cd88ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:15.666708 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27577de8-6c92-4b67-8d2d-01acd222e7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:15.667983 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27577de8-6c92-4b67-8d2d-01acd222e7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:15.667983 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27577de8-6c92-4b67-8d2d-01acd222e7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:15.668158 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27577de8-6c92-4b67-8d2d-01acd222e7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:15.670028 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27577de8-6c92-4b67-8d2d-01acd222e7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:15.673017 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27577de8-6c92-4b67-8d2d-01acd222e7d2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:15.698182 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 857/1718] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:15 2021] GET /identity/v3/roles => generated 1420 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:15.700517 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82230d2-8000-42a0-bb93-aba6d2812db8 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:15.700806 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82230d2-8000-42a0-bb93-aba6d2812db8 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:15.701076 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82230d2-8000-42a0-bb93-aba6d2812db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:15.721561 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 862/1719] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:15.724243 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c91d23-6b07-43e7-92a5-2ff26a480018 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:15.724887 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c91d23-6b07-43e7-92a5-2ff26a480018 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:15.725310 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c91d23-6b07-43e7-92a5-2ff26a480018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:15.745027 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-b82230d2-8000-42a0-bb93-aba6d2812db8 None None] MFA Rules not processed for user `39cddc4e2ea943cd882b6a1addd98e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:15.746276 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b82230d2-8000-42a0-bb93-aba6d2812db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:15.747932 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a2c91d23-6b07-43e7-92a5-2ff26a480018 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:15.750712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a2c91d23-6b07-43e7-92a5-2ff26a480018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:15.770350 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 863/1720] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:15.770350 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c91d23-6b07-43e7-92a5-2ff26a480018 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:15.778019 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a2c91d23-6b07-43e7-92a5-2ff26a480018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:15.795489 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c91d23-6b07-43e7-92a5-2ff26a480018 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:15.815154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac79aa1-dc15-47c4-9ab7-f06801591acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:15.817884 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac79aa1-dc15-47c4-9ab7-f06801591acc admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:15.818226 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac79aa1-dc15-47c4-9ab7-f06801591acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:15.818506 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac79aa1-dc15-47c4-9ab7-f06801591acc admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:15.826012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac79aa1-dc15-47c4-9ab7-f06801591acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:15.826012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac79aa1-dc15-47c4-9ab7-f06801591acc admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:15.881947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 858/1721] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Dec 15 03:03:15 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:15.883819 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d169a-3375-40ca-a8fb-a1fc6e483464 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:15.884292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d169a-3375-40ca-a8fb-a1fc6e483464 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:15.884798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d169a-3375-40ca-a8fb-a1fc6e483464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:15.908745 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 864/1722] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:15 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:15.910068 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-530d169a-3375-40ca-a8fb-a1fc6e483464 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:15.912160 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-530d169a-3375-40ca-a8fb-a1fc6e483464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:15.912490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2604a1d-3f2c-4c71-a01a-db4d60686e93 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:15.920798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2604a1d-3f2c-4c71-a01a-db4d60686e93 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:15.921454 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2604a1d-3f2c-4c71-a01a-db4d60686e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:15.929889 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 859/1723] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:15.936469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d169a-3375-40ca-a8fb-a1fc6e483464 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:16.006615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d169a-3375-40ca-a8fb-a1fc6e483464 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:16.018496 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-d2604a1d-3f2c-4c71-a01a-db4d60686e93 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:16.020898 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7854a31-46bb-47f4-a7f8-337545b12820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:16.021852 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d2604a1d-3f2c-4c71-a01a-db4d60686e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:16.022978 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7854a31-46bb-47f4-a7f8-337545b12820 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:16.024171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7854a31-46bb-47f4-a7f8-337545b12820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:16.024393 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7854a31-46bb-47f4-a7f8-337545b12820 admin admin] PATH_INFO: `/v3/projects/7bb33477af2847019d46108a1c53f0c8/users/695a90a6ead644d5b5851aa9276fa957/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:16.050030 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 865/1724] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:16.051326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2604a1d-3f2c-4c71-a01a-db4d60686e93 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:16.075224 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7854a31-46bb-47f4-a7f8-337545b12820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb33477af2847019d46108a1c53f0c8, user_id=695a90a6ead644d5b5851aa9276fa957, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:16.085422 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7854a31-46bb-47f4-a7f8-337545b12820 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:16.090990 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2604a1d-3f2c-4c71-a01a-db4d60686e93 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:16.101410 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614cf26-755c-4d4d-9ce3-3d625760b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:16.102100 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614cf26-755c-4d4d-9ce3-3d625760b99a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:16.102381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614cf26-755c-4d4d-9ce3-3d625760b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:16.102682 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614cf26-755c-4d4d-9ce3-3d625760b99a admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:16.103538 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614cf26-755c-4d4d-9ce3-3d625760b99a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:16.103841 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614cf26-755c-4d4d-9ce3-3d625760b99a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:16.105484 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614cf26-755c-4d4d-9ce3-3d625760b99a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:16.108348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 860/1725] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:15 2021] PUT /identity/v3/projects/7bb33477af2847019d46108a1c53f0c8/users/695a90a6ead644d5b5851aa9276fa957/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:16.109451 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7854a31-46bb-47f4-a7f8-337545b12820 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:16.146600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 866/1726] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:16.146600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a2c4b-94ab-4407-bc91-cbc4320deef1 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:16.146600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a2c4b-94ab-4407-bc91-cbc4320deef1 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:16.146600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a2c4b-94ab-4407-bc91-cbc4320deef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:16.181688 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-191a2c4b-94ab-4407-bc91-cbc4320deef1 None None] MFA Rules not processed for user `695a90a6ead644d5b5851aa9276fa957`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:16.183194 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-191a2c4b-94ab-4407-bc91-cbc4320deef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:16.235776 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7854a31-46bb-47f4-a7f8-337545b12820 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:16.246110 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b2ecb-d978-4daa-8771-8abca209c379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:16.246890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b2ecb-d978-4daa-8771-8abca209c379 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:16.249851 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b2ecb-d978-4daa-8771-8abca209c379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:16.250857 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b2ecb-d978-4daa-8771-8abca209c379 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:16.255399 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b2ecb-d978-4daa-8771-8abca209c379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:16.261518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b2ecb-d978-4daa-8771-8abca209c379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:16.263712 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b2ecb-d978-4daa-8771-8abca209c379 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:16.268884 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 867/1727] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:16 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:16.269847 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a2c4b-94ab-4407-bc91-cbc4320deef1 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:16.286955 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 861/1728] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:16.288473 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b2ecb-d978-4daa-8771-8abca209c379 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:16.290919 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a2c4b-94ab-4407-bc91-cbc4320deef1 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:16.291267 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1f1b2ecb-d978-4daa-8771-8abca209c379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:16.301573 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1c1a0-ce86-4223-9986-59c69f8ab658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:16.302390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1c1a0-ce86-4223-9986-59c69f8ab658 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:16.302743 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1c1a0-ce86-4223-9986-59c69f8ab658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:16.303892 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1c1a0-ce86-4223-9986-59c69f8ab658 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:16.304674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1c1a0-ce86-4223-9986-59c69f8ab658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:16.306761 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1c1a0-ce86-4223-9986-59c69f8ab658 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:16.381642 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 868/1729] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:16 2021] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:16.383596 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1c1a0-ce86-4223-9986-59c69f8ab658 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:16.484152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1c1a0-ce86-4223-9986-59c69f8ab658 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:16.490088 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b2ecb-d978-4daa-8771-8abca209c379 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:16.490697 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7efc53-1087-4fd3-af59-357377360b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:16.491385 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7efc53-1087-4fd3-af59-357377360b86 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:16.497548 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7efc53-1087-4fd3-af59-357377360b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:16.498513 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7efc53-1087-4fd3-af59-357377360b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:16.500078 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7efc53-1087-4fd3-af59-357377360b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:16.501841 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7efc53-1087-4fd3-af59-357377360b86 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:16.543080 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 869/1730] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:16 2021] POST /identity/v3/projects => generated 405 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:16.544037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7efc53-1087-4fd3-af59-357377360b86 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:16.718739 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd24b3-b08d-48d3-a6cf-30975276f6e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb0af7ac70d48989852c022c9f83848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:16.719407 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd24b3-b08d-48d3-a6cf-30975276f6e0 service swift] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:16.720076 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd24b3-b08d-48d3-a6cf-30975276f6e0 service swift] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:16.720076 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd24b3-b08d-48d3-a6cf-30975276f6e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:16.755958 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7efc53-1087-4fd3-af59-357377360b86 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:16.771605 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff834b90-a0bf-4fb5-aff4-a4ae507353f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:16.772202 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff834b90-a0bf-4fb5-aff4-a4ae507353f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:16.772393 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff834b90-a0bf-4fb5-aff4-a4ae507353f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:16.772661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff834b90-a0bf-4fb5-aff4-a4ae507353f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:16.773380 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff834b90-a0bf-4fb5-aff4-a4ae507353f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:16.778086 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff834b90-a0bf-4fb5-aff4-a4ae507353f3 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:16.861662 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 870/1731] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:16 2021] POST /identity/v3/projects => generated 381 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:16.864201 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff834b90-a0bf-4fb5-aff4-a4ae507353f3 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:16.938200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd24b3-b08d-48d3-a6cf-30975276f6e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:16.943320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd24b3-b08d-48d3-a6cf-30975276f6e0 service swift] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:16.967669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 862/1732] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Dec 15 03:03:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 03:03:16.971324 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd24b3-b08d-48d3-a6cf-30975276f6e0 service swift] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:17.009005 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd24b3-b08d-48d3-a6cf-30975276f6e0 service swift] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:17.073629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff834b90-a0bf-4fb5-aff4-a4ae507353f3 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:17.096869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79103eaf-46b6-4684-b75c-ecb4944af332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:17.104082 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79103eaf-46b6-4684-b75c-ecb4944af332 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:17.104592 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79103eaf-46b6-4684-b75c-ecb4944af332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:17.105016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79103eaf-46b6-4684-b75c-ecb4944af332 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:17.106338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79103eaf-46b6-4684-b75c-ecb4944af332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:17.109688 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79103eaf-46b6-4684-b75c-ecb4944af332 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:17.151129 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 871/1733] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:16 2021] POST /identity/v3/users => generated 294 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:17.152405 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79103eaf-46b6-4684-b75c-ecb4944af332 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:17.192599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79103eaf-46b6-4684-b75c-ecb4944af332 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:17.210966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a535df3-49e8-4b55-867a-06ebd8d514dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:17.211663 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a535df3-49e8-4b55-867a-06ebd8d514dd admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:17.212968 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a535df3-49e8-4b55-867a-06ebd8d514dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:17.212968 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a535df3-49e8-4b55-867a-06ebd8d514dd admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:17.212968 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a535df3-49e8-4b55-867a-06ebd8d514dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:17.232570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a535df3-49e8-4b55-867a-06ebd8d514dd admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:17.251979 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8de92-751b-4319-a92a-defc8a50fe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:17.255582 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8de92-751b-4319-a92a-defc8a50fe64 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:17.257759 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8de92-751b-4319-a92a-defc8a50fe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:17.263132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8de92-751b-4319-a92a-defc8a50fe64 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:17.275212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8de92-751b-4319-a92a-defc8a50fe64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:17.282639 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8de92-751b-4319-a92a-defc8a50fe64 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:17.286022 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 872/1734] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:17 2021] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:17.297660 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a535df3-49e8-4b55-867a-06ebd8d514dd admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:17.337440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a535df3-49e8-4b55-867a-06ebd8d514dd admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:17.358168 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878c0e3-dc3d-407c-ad79-b4ab13513cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:17.360392 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878c0e3-dc3d-407c-ad79-b4ab13513cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:17.360533 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878c0e3-dc3d-407c-ad79-b4ab13513cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:17.360828 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878c0e3-dc3d-407c-ad79-b4ab13513cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:17.367264 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878c0e3-dc3d-407c-ad79-b4ab13513cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:17.371315 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878c0e3-dc3d-407c-ad79-b4ab13513cc7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:17.378580 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 863/1735] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:16 2021] POST /identity/v3/users => generated 309 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:17.388104 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8de92-751b-4319-a92a-defc8a50fe64 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:17.410336 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 873/1736] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:17 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:17.415396 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878c0e3-dc3d-407c-ad79-b4ab13513cc7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:17.431713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8de92-751b-4319-a92a-defc8a50fe64 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:17.443773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878c0e3-dc3d-407c-ad79-b4ab13513cc7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:17.452339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df3391-c097-4955-bae5-d26718f87bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:17.453170 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df3391-c097-4955-bae5-d26718f87bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:17.453565 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df3391-c097-4955-bae5-d26718f87bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:17.453950 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df3391-c097-4955-bae5-d26718f87bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:17.454828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df3391-c097-4955-bae5-d26718f87bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:17.456561 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df3391-c097-4955-bae5-d26718f87bd7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:17.461337 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39388a2c-63aa-4aeb-b063-70a679efe6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:17.463851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39388a2c-63aa-4aeb-b063-70a679efe6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:17.464495 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39388a2c-63aa-4aeb-b063-70a679efe6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:17.464991 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39388a2c-63aa-4aeb-b063-70a679efe6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:17.466761 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39388a2c-63aa-4aeb-b063-70a679efe6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:17.473193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39388a2c-63aa-4aeb-b063-70a679efe6b6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:17.503485 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 864/1737] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:17 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:17.510881 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df3391-c097-4955-bae5-d26718f87bd7 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:17.512254 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 874/1738] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:17 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:17.513580 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39388a2c-63aa-4aeb-b063-70a679efe6b6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:17.535147 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df3391-c097-4955-bae5-d26718f87bd7 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:17.541234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39388a2c-63aa-4aeb-b063-70a679efe6b6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:17.566055 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a10f3-2819-4bfb-9f47-caf3c6525cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:17.566497 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f3aa1-9239-48e7-a2d9-4e9415a63c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:17.567385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f3aa1-9239-48e7-a2d9-4e9415a63c81 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:17.567801 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f3aa1-9239-48e7-a2d9-4e9415a63c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:17.568168 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f3aa1-9239-48e7-a2d9-4e9415a63c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:17.568323 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a10f3-2819-4bfb-9f47-caf3c6525cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:17.568747 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a10f3-2819-4bfb-9f47-caf3c6525cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:17.569178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a10f3-2819-4bfb-9f47-caf3c6525cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:17.569289 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f3aa1-9239-48e7-a2d9-4e9415a63c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:17.571049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a10f3-2819-4bfb-9f47-caf3c6525cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:17.571246 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f3aa1-9239-48e7-a2d9-4e9415a63c81 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:17.573621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a10f3-2819-4bfb-9f47-caf3c6525cf0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:17.592434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 875/1739] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:17 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:17.593744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a10f3-2819-4bfb-9f47-caf3c6525cf0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:17.603804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 865/1740] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:17 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:17.613126 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a10f3-2819-4bfb-9f47-caf3c6525cf0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:17.614256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f3aa1-9239-48e7-a2d9-4e9415a63c81 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:17.622377 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dd2f4-242a-4a64-ab3f-7d5715dc7b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:17.624245 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dd2f4-242a-4a64-ab3f-7d5715dc7b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:17.625819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dd2f4-242a-4a64-ab3f-7d5715dc7b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:17.626996 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dd2f4-242a-4a64-ab3f-7d5715dc7b38 admin admin] PATH_INFO: `/v3/projects/ae45b86924ba45e5a7af9c3b22a317bc/users/896b684abbe7469b95afcf375cd5e26f/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:17.651632 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dd2f4-242a-4a64-ab3f-7d5715dc7b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae45b86924ba45e5a7af9c3b22a317bc, user_id=896b684abbe7469b95afcf375cd5e26f, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:17.655357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dd2f4-242a-4a64-ab3f-7d5715dc7b38 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:17.666764 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f3aa1-9239-48e7-a2d9-4e9415a63c81 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:17.688936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 876/1741] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:17 2021] PUT /identity/v3/projects/ae45b86924ba45e5a7af9c3b22a317bc/users/896b684abbe7469b95afcf375cd5e26f/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:17.689224 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dd2f4-242a-4a64-ab3f-7d5715dc7b38 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:17.875313 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dd2f4-242a-4a64-ab3f-7d5715dc7b38 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:17.887560 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf328f-989e-4b7c-b680-7f8054e7468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:17.888503 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf328f-989e-4b7c-b680-7f8054e7468c admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:17.889322 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf328f-989e-4b7c-b680-7f8054e7468c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:17.889624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf328f-989e-4b7c-b680-7f8054e7468c admin admin] PATH_INFO: `/v3/projects/c04d3e1db3fd4dec8a8b95fd89896acf/users/cb407d307f724b7986001864d87d3588/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:17.927178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf328f-989e-4b7c-b680-7f8054e7468c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04d3e1db3fd4dec8a8b95fd89896acf, user_id=cb407d307f724b7986001864d87d3588, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:17.930187 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf328f-989e-4b7c-b680-7f8054e7468c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:17.941535 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a11023-3a64-4a50-97a8-2b95cc53557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:17.944742 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a11023-3a64-4a50-97a8-2b95cc53557b admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:17.945029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a11023-3a64-4a50-97a8-2b95cc53557b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:17.953248 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a11023-3a64-4a50-97a8-2b95cc53557b admin admin] PATH_INFO: `/v3/projects/d4f3ca697c1742c2b65cc2140f34337a/users/db520a388ab64666aedb00c2df551ee2/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:17.961337 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 877/1742] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:17 2021] PUT /identity/v3/projects/c04d3e1db3fd4dec8a8b95fd89896acf/users/cb407d307f724b7986001864d87d3588/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:17.964621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf328f-989e-4b7c-b680-7f8054e7468c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:18.022746 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a11023-3a64-4a50-97a8-2b95cc53557b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f3ca697c1742c2b65cc2140f34337a, user_id=db520a388ab64666aedb00c2df551ee2, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:18.025431 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a11023-3a64-4a50-97a8-2b95cc53557b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:18.052616 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 866/1743] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:17 2021] PUT /identity/v3/projects/d4f3ca697c1742c2b65cc2140f34337a/users/db520a388ab64666aedb00c2df551ee2/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:18.056355 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54725ac3-fd2a-4bf7-ba6d-74b5e8719a4c None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:18.056804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54725ac3-fd2a-4bf7-ba6d-74b5e8719a4c None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:18.057243 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54725ac3-fd2a-4bf7-ba6d-74b5e8719a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:18.111087 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-54725ac3-fd2a-4bf7-ba6d-74b5e8719a4c None None] MFA Rules not processed for user `eb120cde66b246909cf8e0b7b8d96ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:18.119673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-54725ac3-fd2a-4bf7-ba6d-74b5e8719a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:18.139584 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf328f-989e-4b7c-b680-7f8054e7468c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:18.213025 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 867/1744] 10.222.0.31 () {58 vars in 1015 bytes} [Wed Dec 15 03:03:18 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:18.214680 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e750acc-c869-4fab-abfb-e75bf71d5ecc None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:18.215128 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e750acc-c869-4fab-abfb-e75bf71d5ecc None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:18.215729 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e750acc-c869-4fab-abfb-e75bf71d5ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:18.274158 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-4e750acc-c869-4fab-abfb-e75bf71d5ecc None None] MFA Rules not processed for user `cb407d307f724b7986001864d87d3588`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:18.275875 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-4e750acc-c869-4fab-abfb-e75bf71d5ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:18.310316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9567d-d04f-4e88-95a8-5bab06e84093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:18.311684 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9567d-d04f-4e88-95a8-5bab06e84093 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:18.315166 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9567d-d04f-4e88-95a8-5bab06e84093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:18.315587 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9567d-d04f-4e88-95a8-5bab06e84093 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:18.316610 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9567d-d04f-4e88-95a8-5bab06e84093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:18.320884 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9567d-d04f-4e88-95a8-5bab06e84093 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:18.356963 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 878/1745] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:17 2021] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:18.363898 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadf2aa-3280-44fc-afdf-b241fc5cfd9f None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:18.365154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadf2aa-3280-44fc-afdf-b241fc5cfd9f None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:18.368532 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadf2aa-3280-44fc-afdf-b241fc5cfd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:18.441720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 868/1746] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:18 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:18.441720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e750acc-c869-4fab-abfb-e75bf71d5ecc None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:18.445297 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-8cadf2aa-3280-44fc-afdf-b241fc5cfd9f None None] MFA Rules not processed for user `db520a388ab64666aedb00c2df551ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:18.445297 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-8cadf2aa-3280-44fc-afdf-b241fc5cfd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:18.456995 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e750acc-c869-4fab-abfb-e75bf71d5ecc None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:18.464119 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc73308-c8dc-4b46-ace8-77e3cf118b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:18.466289 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc73308-c8dc-4b46-ace8-77e3cf118b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:18.466570 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc73308-c8dc-4b46-ace8-77e3cf118b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:18.467027 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc73308-c8dc-4b46-ace8-77e3cf118b10 admin admin] PATH_INFO: `/v3/projects/ae45b86924ba45e5a7af9c3b22a317bc/users/896b684abbe7469b95afcf375cd5e26f/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:18.469918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc73308-c8dc-4b46-ace8-77e3cf118b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae45b86924ba45e5a7af9c3b22a317bc, user_id=896b684abbe7469b95afcf375cd5e26f, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:18.473785 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc73308-c8dc-4b46-ace8-77e3cf118b10 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:18.500348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 869/1747] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:18 2021] PUT /identity/v3/projects/ae45b86924ba45e5a7af9c3b22a317bc/users/896b684abbe7469b95afcf375cd5e26f/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:18.514422 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc73308-c8dc-4b46-ace8-77e3cf118b10 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:18.637907 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 879/1748] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:18 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:18.640607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55258b4-6a8f-4e2a-8c94-ba598be9e81f None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:18.641188 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55258b4-6a8f-4e2a-8c94-ba598be9e81f None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:18.641576 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55258b4-6a8f-4e2a-8c94-ba598be9e81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:18.718935 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-f55258b4-6a8f-4e2a-8c94-ba598be9e81f None None] MFA Rules not processed for user `896b684abbe7469b95afcf375cd5e26f`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:18.721212 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f55258b4-6a8f-4e2a-8c94-ba598be9e81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:18.742879 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc73308-c8dc-4b46-ace8-77e3cf118b10 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:18.748512 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e1e70-98ec-4770-b30b-a5fe8e21dbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:18.749423 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e1e70-98ec-4770-b30b-a5fe8e21dbd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:18.750661 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e1e70-98ec-4770-b30b-a5fe8e21dbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:18.751100 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e1e70-98ec-4770-b30b-a5fe8e21dbd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:18.757925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e1e70-98ec-4770-b30b-a5fe8e21dbd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:18.761220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e1e70-98ec-4770-b30b-a5fe8e21dbd2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:18.826051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 880/1749] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:18 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:18.827187 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55258b4-6a8f-4e2a-8c94-ba598be9e81f None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:18.831735 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f55258b4-6a8f-4e2a-8c94-ba598be9e81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:18.857235 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55258b4-6a8f-4e2a-8c94-ba598be9e81f None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:18.864853 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 870/1750] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:18 2021] POST /identity/v3/projects => generated 387 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:18.869028 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e1e70-98ec-4770-b30b-a5fe8e21dbd2 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:19.004789 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e1e70-98ec-4770-b30b-a5fe8e21dbd2 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:19.016568 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f778ec7-b9c8-4d88-8836-1466f8e5caa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:19.018546 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f778ec7-b9c8-4d88-8836-1466f8e5caa6 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:19.019479 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f778ec7-b9c8-4d88-8836-1466f8e5caa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:19.020514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f778ec7-b9c8-4d88-8836-1466f8e5caa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:19.021718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f778ec7-b9c8-4d88-8836-1466f8e5caa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:19.026242 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f778ec7-b9c8-4d88-8836-1466f8e5caa6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:19.081737 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 871/1751] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:18 2021] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:19.083104 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f778ec7-b9c8-4d88-8836-1466f8e5caa6 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:19.086272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-3f778ec7-b9c8-4d88-8836-1466f8e5caa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:19.100487 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0ede3-b974-459d-855c-408d0381cb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:19.102256 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0ede3-b974-459d-855c-408d0381cb42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:19.102742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0ede3-b974-459d-855c-408d0381cb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:19.105952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0ede3-b974-459d-855c-408d0381cb42 admin admin] PATH_INFO: `/v3/users/05b7cb1174744379a22820fd06e7c99b` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:19.109600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0ede3-b974-459d-855c-408d0381cb42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b7cb1174744379a22820fd06e7c99b)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:19.112005 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0ede3-b974-459d-855c-408d0381cb42 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:19.191524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f778ec7-b9c8-4d88-8836-1466f8e5caa6 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:19.209607 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272b5e9-21af-4b00-8bed-5f502de6a3a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:19.210945 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272b5e9-21af-4b00-8bed-5f502de6a3a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:19.211319 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272b5e9-21af-4b00-8bed-5f502de6a3a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:19.211672 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272b5e9-21af-4b00-8bed-5f502de6a3a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:19.216816 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f7a0ede3-b974-459d-855c-408d0381cb42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b7cb1174744379a22820fd06e7c99b'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:19.253277 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f7a0ede3-b974-459d-855c-408d0381cb42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b7cb1174744379a22820fd06e7c99b'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:19.269373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f7a0ede3-b974-459d-855c-408d0381cb42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b7cb1174744379a22820fd06e7c99b'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:19.272584 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f7a0ede3-b974-459d-855c-408d0381cb42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b7cb1174744379a22820fd06e7c99b'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:19.273270 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f7a0ede3-b974-459d-855c-408d0381cb42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b7cb1174744379a22820fd06e7c99b'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:19.312882 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 881/1752] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:18 2021] DELETE /identity/v3/users/05b7cb1174744379a22820fd06e7c99b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:19.314186 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0ede3-b974-459d-855c-408d0381cb42 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:19.315976 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f7a0ede3-b974-459d-855c-408d0381cb42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:19.343696 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272b5e9-21af-4b00-8bed-5f502de6a3a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:19.343696 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272b5e9-21af-4b00-8bed-5f502de6a3a6 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:19.363715 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 872/1753] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:19 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:19.364493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272b5e9-21af-4b00-8bed-5f502de6a3a6 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:19.487211 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0ede3-b974-459d-855c-408d0381cb42 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:19.492794 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2db402-1b17-4c35-a14e-53f0c06de608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:19.493688 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2db402-1b17-4c35-a14e-53f0c06de608 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:19.494079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2db402-1b17-4c35-a14e-53f0c06de608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:19.494430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2db402-1b17-4c35-a14e-53f0c06de608 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:19.499580 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2db402-1b17-4c35-a14e-53f0c06de608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:19.506132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2db402-1b17-4c35-a14e-53f0c06de608 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:19.518315 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272b5e9-21af-4b00-8bed-5f502de6a3a6 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:19.536598 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949d25a-e7a5-4bee-92cf-96f79617c5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:19.539808 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949d25a-e7a5-4bee-92cf-96f79617c5cb admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:19.540158 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949d25a-e7a5-4bee-92cf-96f79617c5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:19.540502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949d25a-e7a5-4bee-92cf-96f79617c5cb admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:19.541284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949d25a-e7a5-4bee-92cf-96f79617c5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:19.545553 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949d25a-e7a5-4bee-92cf-96f79617c5cb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:19.550202 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 882/1754] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:19 2021] POST /identity/v3/users => generated 300 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:19.553213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df47be3-16ce-46be-a995-afa2b379659a None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:19.554795 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df47be3-16ce-46be-a995-afa2b379659a None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:19.556882 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df47be3-16ce-46be-a995-afa2b379659a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:19.610782 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 873/1755] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:19 2021] POST /identity/v3/users => generated 298 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:19.610782 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949d25a-e7a5-4bee-92cf-96f79617c5cb admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:19.619095 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-3df47be3-16ce-46be-a995-afa2b379659a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:19.622245 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3df47be3-16ce-46be-a995-afa2b379659a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:19.632251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949d25a-e7a5-4bee-92cf-96f79617c5cb admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:19.637609 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150df64-d4f9-402a-b4b3-bb64f0c989c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:19.638615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150df64-d4f9-402a-b4b3-bb64f0c989c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:19.639608 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150df64-d4f9-402a-b4b3-bb64f0c989c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:19.640069 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150df64-d4f9-402a-b4b3-bb64f0c989c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:19.641066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150df64-d4f9-402a-b4b3-bb64f0c989c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:19.642642 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 883/1756] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:19.644942 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150df64-d4f9-402a-b4b3-bb64f0c989c6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:19.647213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df47be3-16ce-46be-a995-afa2b379659a None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:19.649008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3df47be3-16ce-46be-a995-afa2b379659a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:19.662109 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 874/1757] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:19 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:19.663213 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150df64-d4f9-402a-b4b3-bb64f0c989c6 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:19.667656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e150df64-d4f9-402a-b4b3-bb64f0c989c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:19.669033 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df47be3-16ce-46be-a995-afa2b379659a None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:19.675168 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a3997-290a-493a-a6eb-27010457befa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:19.676206 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a3997-290a-493a-a6eb-27010457befa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:19.676498 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a3997-290a-493a-a6eb-27010457befa admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:19.676772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a3997-290a-493a-a6eb-27010457befa admin admin] PATH_INFO: `/v3/users/695a90a6ead644d5b5851aa9276fa957` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:19.678365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a3997-290a-493a-a6eb-27010457befa admin admin] RBAC: Authorizing `identity:delete_user(user_id=695a90a6ead644d5b5851aa9276fa957)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:19.680462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a3997-290a-493a-a6eb-27010457befa admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:19.684936 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150df64-d4f9-402a-b4b3-bb64f0c989c6 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:19.695807 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707585bd-af6a-4b3d-a477-366dac757fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:19.696856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707585bd-af6a-4b3d-a477-366dac757fae admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:19.697231 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707585bd-af6a-4b3d-a477-366dac757fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:19.697626 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707585bd-af6a-4b3d-a477-366dac757fae admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:19.698556 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707585bd-af6a-4b3d-a477-366dac757fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:19.700351 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707585bd-af6a-4b3d-a477-366dac757fae admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:19.718032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 875/1758] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:19 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:19.719673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707585bd-af6a-4b3d-a477-366dac757fae admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:19.720369 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-707585bd-af6a-4b3d-a477-366dac757fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:19.744093 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6a8a3997-290a-493a-a6eb-27010457befa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '695a90a6ead644d5b5851aa9276fa957'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:19.759933 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6a8a3997-290a-493a-a6eb-27010457befa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '695a90a6ead644d5b5851aa9276fa957'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:19.773204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6a8a3997-290a-493a-a6eb-27010457befa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '695a90a6ead644d5b5851aa9276fa957'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:19.774096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6a8a3997-290a-493a-a6eb-27010457befa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '695a90a6ead644d5b5851aa9276fa957'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:19.775094 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6a8a3997-290a-493a-a6eb-27010457befa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '695a90a6ead644d5b5851aa9276fa957'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:19.789184 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 884/1759] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:19 2021] DELETE /identity/v3/users/695a90a6ead644d5b5851aa9276fa957 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:19.789824 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a3997-290a-493a-a6eb-27010457befa admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:19.791309 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6a8a3997-290a-493a-a6eb-27010457befa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:19.805111 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707585bd-af6a-4b3d-a477-366dac757fae admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:19.854518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efd075-9b84-461f-bcd3-d55b86bb4732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:19.855515 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efd075-9b84-461f-bcd3-d55b86bb4732 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:19.855981 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efd075-9b84-461f-bcd3-d55b86bb4732 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:19.856433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efd075-9b84-461f-bcd3-d55b86bb4732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:19.859185 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-96efd075-9b84-461f-bcd3-d55b86bb4732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:19.864513 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a3997-290a-493a-a6eb-27010457befa admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:19.869280 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64889c99-569a-41f5-a260-16bdc63dc8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:19.870381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64889c99-569a-41f5-a260-16bdc63dc8f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:19.870665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64889c99-569a-41f5-a260-16bdc63dc8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:19.870939 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64889c99-569a-41f5-a260-16bdc63dc8f6 admin admin] PATH_INFO: `/v3/projects/2e98a004fd8f45baac15d8704c96a2f8/users/779febe3cedb4d0d985a083ca6bb5f34/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:19.872662 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efd075-9b84-461f-bcd3-d55b86bb4732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:19.875068 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efd075-9b84-461f-bcd3-d55b86bb4732 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:19.888116 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64889c99-569a-41f5-a260-16bdc63dc8f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e98a004fd8f45baac15d8704c96a2f8, user_id=779febe3cedb4d0d985a083ca6bb5f34, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:19.890187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 876/1760] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:19.891278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efd075-9b84-461f-bcd3-d55b86bb4732 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:19.891401 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64889c99-569a-41f5-a260-16bdc63dc8f6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:19.894687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-96efd075-9b84-461f-bcd3-d55b86bb4732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:19.909445 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 885/1761] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:19 2021] PUT /identity/v3/projects/2e98a004fd8f45baac15d8704c96a2f8/users/779febe3cedb4d0d985a083ca6bb5f34/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:19.909445 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603cdac-5a61-47a3-b34b-6e0ab5333e19 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:19.909696 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efd075-9b84-461f-bcd3-d55b86bb4732 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:19.909782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603cdac-5a61-47a3-b34b-6e0ab5333e19 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:19.909782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603cdac-5a61-47a3-b34b-6e0ab5333e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:19.926129 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-b603cdac-5a61-47a3-b34b-6e0ab5333e19 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:19.927255 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b603cdac-5a61-47a3-b34b-6e0ab5333e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:20.014602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 886/1762] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:20.014602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603cdac-5a61-47a3-b34b-6e0ab5333e19 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:20.015706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c5e9b-aa10-4048-acb5-21d93a81ae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:20.016378 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c5e9b-aa10-4048-acb5-21d93a81ae3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:20.016661 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c5e9b-aa10-4048-acb5-21d93a81ae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:20.017213 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c5e9b-aa10-4048-acb5-21d93a81ae3f admin admin] PATH_INFO: `/v3/projects/de5c8b190c49475c98c5cc21668fe921/users/f37903e121df4d8da6029c2de1bb6f6d/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:20.034320 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603cdac-5a61-47a3-b34b-6e0ab5333e19 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:20.039303 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ec79a-e95e-421e-86f1-93b0fc6ecde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:20.039975 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ec79a-e95e-421e-86f1-93b0fc6ecde6 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:20.040261 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ec79a-e95e-421e-86f1-93b0fc6ecde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:20.040591 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ec79a-e95e-421e-86f1-93b0fc6ecde6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:20.041345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ec79a-e95e-421e-86f1-93b0fc6ecde6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:20.043129 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ec79a-e95e-421e-86f1-93b0fc6ecde6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:20.053713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c5e9b-aa10-4048-acb5-21d93a81ae3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5c8b190c49475c98c5cc21668fe921, user_id=f37903e121df4d8da6029c2de1bb6f6d, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:20.056736 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c5e9b-aa10-4048-acb5-21d93a81ae3f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:20.060959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 887/1763] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:20 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:20.061965 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ec79a-e95e-421e-86f1-93b0fc6ecde6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:20.063760 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-cd3ec79a-e95e-421e-86f1-93b0fc6ecde6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:20.089410 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 877/1764] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:19 2021] PUT /identity/v3/projects/de5c8b190c49475c98c5cc21668fe921/users/f37903e121df4d8da6029c2de1bb6f6d/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:20.093191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c5e9b-aa10-4048-acb5-21d93a81ae3f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:20.156745 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ec79a-e95e-421e-86f1-93b0fc6ecde6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:20.226325 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c5e9b-aa10-4048-acb5-21d93a81ae3f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:20.232003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db0c2a-4475-41d6-8a3c-4c863d1a3f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:20.233094 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db0c2a-4475-41d6-8a3c-4c863d1a3f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:20.233376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db0c2a-4475-41d6-8a3c-4c863d1a3f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:20.233650 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db0c2a-4475-41d6-8a3c-4c863d1a3f52 admin admin] PATH_INFO: `/v3/projects/2e98a004fd8f45baac15d8704c96a2f8/users/779febe3cedb4d0d985a083ca6bb5f34/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:20.236073 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db0c2a-4475-41d6-8a3c-4c863d1a3f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e98a004fd8f45baac15d8704c96a2f8, user_id=779febe3cedb4d0d985a083ca6bb5f34, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:20.242482 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db0c2a-4475-41d6-8a3c-4c863d1a3f52 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:20.251076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d51c1d-29eb-4a1f-9a62-48ef29fac56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:20.252054 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d51c1d-29eb-4a1f-9a62-48ef29fac56e service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:20.253597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d51c1d-29eb-4a1f-9a62-48ef29fac56e service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:20.254229 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d51c1d-29eb-4a1f-9a62-48ef29fac56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:20.275655 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d51c1d-29eb-4a1f-9a62-48ef29fac56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:20.282391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 878/1765] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:20 2021] PUT /identity/v3/projects/2e98a004fd8f45baac15d8704c96a2f8/users/779febe3cedb4d0d985a083ca6bb5f34/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:20.283497 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db0c2a-4475-41d6-8a3c-4c863d1a3f52 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:20.285677 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d51c1d-29eb-4a1f-9a62-48ef29fac56e service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:20.327072 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 888/1766] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:20.329732 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f365a09-458a-41f1-a6a6-91c227219d11 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:20.334254 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f365a09-458a-41f1-a6a6-91c227219d11 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:20.335686 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f365a09-458a-41f1-a6a6-91c227219d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:20.387505 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-9f365a09-458a-41f1-a6a6-91c227219d11 None None] MFA Rules not processed for user `779febe3cedb4d0d985a083ca6bb5f34`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:20.389564 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-9f365a09-458a-41f1-a6a6-91c227219d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:20.397815 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db0c2a-4475-41d6-8a3c-4c863d1a3f52 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:20.410565 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0157fe-8fb7-4dcf-96e0-6271273ba0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:20.411262 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0157fe-8fb7-4dcf-96e0-6271273ba0dc admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:20.413493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0157fe-8fb7-4dcf-96e0-6271273ba0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:20.413800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0157fe-8fb7-4dcf-96e0-6271273ba0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:20.415044 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0157fe-8fb7-4dcf-96e0-6271273ba0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:20.421091 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0157fe-8fb7-4dcf-96e0-6271273ba0dc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:20.440968 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 879/1767] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:20 2021] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:20.442012 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0157fe-8fb7-4dcf-96e0-6271273ba0dc admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:20.443735 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-7d0157fe-8fb7-4dcf-96e0-6271273ba0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:20.467779 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0157fe-8fb7-4dcf-96e0-6271273ba0dc admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:20.472683 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff437e2-a6ea-4d0e-bfa2-ac5c2da3fa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:20.484833 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff437e2-a6ea-4d0e-bfa2-ac5c2da3fa80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:20.485635 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff437e2-a6ea-4d0e-bfa2-ac5c2da3fa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:20.486136 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff437e2-a6ea-4d0e-bfa2-ac5c2da3fa80 admin admin] PATH_INFO: `/v3/projects/18d37b4bb54a44adb94a88be4573899c` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:20.489167 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff437e2-a6ea-4d0e-bfa2-ac5c2da3fa80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d37b4bb54a44adb94a88be4573899c)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:20.491569 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff437e2-a6ea-4d0e-bfa2-ac5c2da3fa80 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:20.496293 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 889/1768] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:20 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:20.496293 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f365a09-458a-41f1-a6a6-91c227219d11 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:20.506877 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f365a09-458a-41f1-a6a6-91c227219d11 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:20.522685 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbf770-933e-40fb-bb14-f91ba87ab3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:20.524793 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbf770-933e-40fb-bb14-f91ba87ab3c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:20.525075 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbf770-933e-40fb-bb14-f91ba87ab3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:20.525573 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbf770-933e-40fb-bb14-f91ba87ab3c0 admin admin] PATH_INFO: `/v3/projects/de5c8b190c49475c98c5cc21668fe921/users/f37903e121df4d8da6029c2de1bb6f6d/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:20.528120 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbf770-933e-40fb-bb14-f91ba87ab3c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5c8b190c49475c98c5cc21668fe921, user_id=f37903e121df4d8da6029c2de1bb6f6d, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:20.532481 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbf770-933e-40fb-bb14-f91ba87ab3c0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:20.565700 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 890/1769] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:20 2021] PUT /identity/v3/projects/de5c8b190c49475c98c5cc21668fe921/users/f37903e121df4d8da6029c2de1bb6f6d/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:20.565700 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbf770-933e-40fb-bb14-f91ba87ab3c0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:20.565700 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-cbbbf770-933e-40fb-bb14-f91ba87ab3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:20.631686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-eff437e2-a6ea-4d0e-bfa2-ac5c2da3fa80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d37b4bb54a44adb94a88be4573899c', 'request_id': 'req-eff437e2-a6ea-4d0e-bfa2-ac5c2da3fa80'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:20.647484 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-eff437e2-a6ea-4d0e-bfa2-ac5c2da3fa80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d37b4bb54a44adb94a88be4573899c', 'request_id': 'req-eff437e2-a6ea-4d0e-bfa2-ac5c2da3fa80'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:20.663027 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-eff437e2-a6ea-4d0e-bfa2-ac5c2da3fa80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d37b4bb54a44adb94a88be4573899c', 'request_id': 'req-eff437e2-a6ea-4d0e-bfa2-ac5c2da3fa80'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:20.685524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-eff437e2-a6ea-4d0e-bfa2-ac5c2da3fa80 admin admin] The token cache is being invalidate because project 18d37b4bb54a44adb94a88be4573899c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:20.685802 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-eff437e2-a6ea-4d0e-bfa2-ac5c2da3fa80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:20.686552 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-eff437e2-a6ea-4d0e-bfa2-ac5c2da3fa80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:20.689271 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbf770-933e-40fb-bb14-f91ba87ab3c0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:20.690151 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 880/1770] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:20 2021] DELETE /identity/v3/projects/18d37b4bb54a44adb94a88be4573899c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:20.694266 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38284089-d34d-4716-b74d-dd9fda989a63 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:20.694560 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38284089-d34d-4716-b74d-dd9fda989a63 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:20.696035 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38284089-d34d-4716-b74d-dd9fda989a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:20.782934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-38284089-d34d-4716-b74d-dd9fda989a63 None None] MFA Rules not processed for user `f37903e121df4d8da6029c2de1bb6f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:20.782934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-38284089-d34d-4716-b74d-dd9fda989a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:20.796620 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233528a3-8aba-4716-b1a3-7d623556c436 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:20.797493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233528a3-8aba-4716-b1a3-7d623556c436 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:20.797916 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233528a3-8aba-4716-b1a3-7d623556c436 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:20.798378 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233528a3-8aba-4716-b1a3-7d623556c436 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:20.800493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-233528a3-8aba-4716-b1a3-7d623556c436 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:20.901885 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233528a3-8aba-4716-b1a3-7d623556c436 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:20.903380 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233528a3-8aba-4716-b1a3-7d623556c436 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:20.921644 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 881/1771] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:20 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:20.923129 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc5874-139d-4e35-86e8-ce6373b83cb8 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:20.923545 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc5874-139d-4e35-86e8-ce6373b83cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:20.924184 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc5874-139d-4e35-86e8-ce6373b83cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:20.944537 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 891/1772] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:20 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:20.944537 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233528a3-8aba-4716-b1a3-7d623556c436 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:20.945799 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-233528a3-8aba-4716-b1a3-7d623556c436 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:20.958276 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233528a3-8aba-4716-b1a3-7d623556c436 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:20.964884 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d1653-c19f-452b-912b-6e3d985d6519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:20.965733 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d1653-c19f-452b-912b-6e3d985d6519 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:20.965852 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d1653-c19f-452b-912b-6e3d985d6519 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:20.966128 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d1653-c19f-452b-912b-6e3d985d6519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:20.981827 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-d1fc5874-139d-4e35-86e8-ce6373b83cb8 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:20.983500 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d1fc5874-139d-4e35-86e8-ce6373b83cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:21.002721 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d1653-c19f-452b-912b-6e3d985d6519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:21.004423 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d1653-c19f-452b-912b-6e3d985d6519 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:21.017843 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 892/1773] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:20 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:21.119807 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 882/1774] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:21.132448 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf81235-9c34-4432-8a88-1326716cfa10 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:21.132738 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf81235-9c34-4432-8a88-1326716cfa10 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:21.133025 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf81235-9c34-4432-8a88-1326716cfa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:21.164677 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc5874-139d-4e35-86e8-ce6373b83cb8 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:21.166253 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d1fc5874-139d-4e35-86e8-ce6373b83cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:21.182782 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc5874-139d-4e35-86e8-ce6373b83cb8 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:21.217309 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-caf81235-9c34-4432-8a88-1326716cfa10 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:21.221653 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-caf81235-9c34-4432-8a88-1326716cfa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:21.229781 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:21.237014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 893/1775] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:21.237014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf81235-9c34-4432-8a88-1326716cfa10 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:21.237014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-caf81235-9c34-4432-8a88-1326716cfa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:21.239152 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:21.241261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:21.241743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff admin admin] PATH_INFO: `/v3/projects/7bb33477af2847019d46108a1c53f0c8` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:21.244356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bb33477af2847019d46108a1c53f0c8)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:21.247281 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:21.254484 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf81235-9c34-4432-8a88-1326716cfa10 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:21.268025 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41c92f-4861-4501-8d61-a63adf8a1320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:21.269140 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41c92f-4861-4501-8d61-a63adf8a1320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:21.269522 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41c92f-4861-4501-8d61-a63adf8a1320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:21.269857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41c92f-4861-4501-8d61-a63adf8a1320 admin admin] PATH_INFO: `/v3/users/cb407d307f724b7986001864d87d3588` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:21.271528 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41c92f-4861-4501-8d61-a63adf8a1320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb407d307f724b7986001864d87d3588)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:21.274364 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41c92f-4861-4501-8d61-a63adf8a1320 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:21.358404 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bb33477af2847019d46108a1c53f0c8', 'request_id': 'req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:21.366215 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4e41c92f-4861-4501-8d61-a63adf8a1320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb407d307f724b7986001864d87d3588'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:21.374173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bb33477af2847019d46108a1c53f0c8', 'request_id': 'req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:21.381397 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bb33477af2847019d46108a1c53f0c8', 'request_id': 'req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:21.391366 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4e41c92f-4861-4501-8d61-a63adf8a1320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb407d307f724b7986001864d87d3588'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:21.400676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff admin admin] The token cache is being invalidate because project 7bb33477af2847019d46108a1c53f0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:21.400676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:21.400676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:21.402905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 883/1776] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:21 2021] DELETE /identity/v3/projects/7bb33477af2847019d46108a1c53f0c8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:21.403833 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:21.405603 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:21.411867 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4e41c92f-4861-4501-8d61-a63adf8a1320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb407d307f724b7986001864d87d3588'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:21.412588 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4e41c92f-4861-4501-8d61-a63adf8a1320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb407d307f724b7986001864d87d3588'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:21.413639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4e41c92f-4861-4501-8d61-a63adf8a1320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb407d307f724b7986001864d87d3588'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:21.436982 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 894/1777] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:21 2021] DELETE /identity/v3/users/cb407d307f724b7986001864d87d3588 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:21.437906 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41c92f-4861-4501-8d61-a63adf8a1320 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:21.439315 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4e41c92f-4861-4501-8d61-a63adf8a1320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:21.503045 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce77b7c-ef70-4512-82f3-5058fd4a99ff admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:21.520704 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41c92f-4861-4501-8d61-a63adf8a1320 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:21.530947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83722ba1-880b-4e0b-ae0f-aa27c656cce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:21.531820 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83722ba1-880b-4e0b-ae0f-aa27c656cce6 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:21.531941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83722ba1-880b-4e0b-ae0f-aa27c656cce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:21.532142 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83722ba1-880b-4e0b-ae0f-aa27c656cce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:21.534028 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-83722ba1-880b-4e0b-ae0f-aa27c656cce6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:21.566097 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb5d21-a053-4dfc-a23c-4fb181999ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:21.567182 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb5d21-a053-4dfc-a23c-4fb181999ffb admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:21.567921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb5d21-a053-4dfc-a23c-4fb181999ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:21.568530 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb5d21-a053-4dfc-a23c-4fb181999ffb admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:21.569461 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb5d21-a053-4dfc-a23c-4fb181999ffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:21.571134 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb5d21-a053-4dfc-a23c-4fb181999ffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:21.574683 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb5d21-a053-4dfc-a23c-4fb181999ffb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:21.593859 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 884/1778] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:21.594795 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb5d21-a053-4dfc-a23c-4fb181999ffb admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:21.599520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6bbb5d21-a053-4dfc-a23c-4fb181999ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:21.617767 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb5d21-a053-4dfc-a23c-4fb181999ffb admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:21.624136 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e820c85-9347-4764-86fb-c9ca5dab559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:21.625444 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e820c85-9347-4764-86fb-c9ca5dab559b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:21.625890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e820c85-9347-4764-86fb-c9ca5dab559b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:21.626370 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e820c85-9347-4764-86fb-c9ca5dab559b admin admin] PATH_INFO: `/v3/users/896b684abbe7469b95afcf375cd5e26f` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:21.627998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e820c85-9347-4764-86fb-c9ca5dab559b admin admin] RBAC: Authorizing `identity:delete_user(user_id=896b684abbe7469b95afcf375cd5e26f)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:21.630958 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e820c85-9347-4764-86fb-c9ca5dab559b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:21.689848 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7e820c85-9347-4764-86fb-c9ca5dab559b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896b684abbe7469b95afcf375cd5e26f'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:21.703221 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7e820c85-9347-4764-86fb-c9ca5dab559b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896b684abbe7469b95afcf375cd5e26f'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:21.715122 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7e820c85-9347-4764-86fb-c9ca5dab559b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896b684abbe7469b95afcf375cd5e26f'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:21.728195 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7e820c85-9347-4764-86fb-c9ca5dab559b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896b684abbe7469b95afcf375cd5e26f'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:21.729484 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7e820c85-9347-4764-86fb-c9ca5dab559b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896b684abbe7469b95afcf375cd5e26f'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:21.739676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 885/1779] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:21 2021] DELETE /identity/v3/users/896b684abbe7469b95afcf375cd5e26f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:21.739955 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83722ba1-880b-4e0b-ae0f-aa27c656cce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:21.740082 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c41ed-9772-445d-a3c9-316736be918e None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:21.740082 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c41ed-9772-445d-a3c9-316736be918e None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:21.740082 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c41ed-9772-445d-a3c9-316736be918e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:21.740467 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83722ba1-880b-4e0b-ae0f-aa27c656cce6 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:21.756978 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 895/1780] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:21 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:21.769111 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83722ba1-880b-4e0b-ae0f-aa27c656cce6 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:21.770987 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-e43c41ed-9772-445d-a3c9-316736be918e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:21.773453 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e43c41ed-9772-445d-a3c9-316736be918e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:21.777960 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-83722ba1-880b-4e0b-ae0f-aa27c656cce6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:21.805659 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83722ba1-880b-4e0b-ae0f-aa27c656cce6 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:21.890124 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 886/1781] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:21.902363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c41ed-9772-445d-a3c9-316736be918e None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:21.904859 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e43c41ed-9772-445d-a3c9-316736be918e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:21.907493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f51c8-5707-4522-9af9-7157ce3a6a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:21.915338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f51c8-5707-4522-9af9-7157ce3a6a63 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:21.915666 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f51c8-5707-4522-9af9-7157ce3a6a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:21.915935 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f51c8-5707-4522-9af9-7157ce3a6a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:21.920949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f51c8-5707-4522-9af9-7157ce3a6a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:21.933737 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f51c8-5707-4522-9af9-7157ce3a6a63 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:21.985907 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c41ed-9772-445d-a3c9-316736be918e None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:21.991528 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b0bcd-3918-4235-856c-e0e2433730bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:21.992494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0bcd-3918-4235-856c-e0e2433730bf service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:21.992878 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0bcd-3918-4235-856c-e0e2433730bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:21.994114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0bcd-3918-4235-856c-e0e2433730bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:22.019188 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b0bcd-3918-4235-856c-e0e2433730bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:22.019370 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 896/1782] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:21 2021] POST /identity/v3/projects => generated 373 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:22.019469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b0bcd-3918-4235-856c-e0e2433730bf service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:22.022258 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f51c8-5707-4522-9af9-7157ce3a6a63 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:22.024585 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-493f51c8-5707-4522-9af9-7157ce3a6a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:22.048242 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 887/1783] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:03:22.221489 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f51c8-5707-4522-9af9-7157ce3a6a63 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:22.231437 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630e4e5-759f-48d1-b049-6156b8328259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:22.232199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630e4e5-759f-48d1-b049-6156b8328259 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:22.233008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630e4e5-759f-48d1-b049-6156b8328259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:22.233279 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630e4e5-759f-48d1-b049-6156b8328259 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:22.234839 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630e4e5-759f-48d1-b049-6156b8328259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:22.235952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630e4e5-759f-48d1-b049-6156b8328259 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:22.269563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 897/1784] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:22 2021] POST /identity/v3/users => generated 287 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:22.277199 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b0bcd-3918-4235-856c-e0e2433730bf service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:22.289284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b0bcd-3918-4235-856c-e0e2433730bf service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:22.296090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630e4e5-759f-48d1-b049-6156b8328259 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:22.298146 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c630e4e5-759f-48d1-b049-6156b8328259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:22.304384 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f73c1-d785-4bd4-aa1d-5d105a054b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:22.306148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f73c1-d785-4bd4-aa1d-5d105a054b94 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:22.306429 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f73c1-d785-4bd4-aa1d-5d105a054b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:22.306710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f73c1-d785-4bd4-aa1d-5d105a054b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:22.308446 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f73c1-d785-4bd4-aa1d-5d105a054b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:22.317084 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f73c1-d785-4bd4-aa1d-5d105a054b94 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:22.353301 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630e4e5-759f-48d1-b049-6156b8328259 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:22.374343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 888/1785] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:22 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:22.376163 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f73c1-d785-4bd4-aa1d-5d105a054b94 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:22.382394 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01819bd6-2c1a-40b5-b93a-467d24192a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:22.383309 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01819bd6-2c1a-40b5-b93a-467d24192a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:22.383591 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01819bd6-2c1a-40b5-b93a-467d24192a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:22.383866 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01819bd6-2c1a-40b5-b93a-467d24192a2c admin admin] PATH_INFO: `/v3/users/db520a388ab64666aedb00c2df551ee2` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:22.385842 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b47f73c1-d785-4bd4-aa1d-5d105a054b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:22.391242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01819bd6-2c1a-40b5-b93a-467d24192a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=db520a388ab64666aedb00c2df551ee2)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:22.415942 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01819bd6-2c1a-40b5-b93a-467d24192a2c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:22.441017 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f73c1-d785-4bd4-aa1d-5d105a054b94 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:22.455596 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01e58b-db38-49e4-bd40-92322278f5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:22.457114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01e58b-db38-49e4-bd40-92322278f5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:22.457394 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01e58b-db38-49e4-bd40-92322278f5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:22.457673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01e58b-db38-49e4-bd40-92322278f5c6 admin admin] PATH_INFO: `/v3/projects/ae45b86924ba45e5a7af9c3b22a317bc` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:22.461540 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01e58b-db38-49e4-bd40-92322278f5c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae45b86924ba45e5a7af9c3b22a317bc)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:22.463998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01e58b-db38-49e4-bd40-92322278f5c6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:22.562705 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-01819bd6-2c1a-40b5-b93a-467d24192a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db520a388ab64666aedb00c2df551ee2'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:22.580206 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3e01e58b-db38-49e4-bd40-92322278f5c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae45b86924ba45e5a7af9c3b22a317bc', 'request_id': 'req-3e01e58b-db38-49e4-bd40-92322278f5c6'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:22.583133 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-01819bd6-2c1a-40b5-b93a-467d24192a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db520a388ab64666aedb00c2df551ee2'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:22.594523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-01819bd6-2c1a-40b5-b93a-467d24192a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db520a388ab64666aedb00c2df551ee2'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:22.595377 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-01819bd6-2c1a-40b5-b93a-467d24192a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db520a388ab64666aedb00c2df551ee2'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:22.596294 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-01819bd6-2c1a-40b5-b93a-467d24192a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db520a388ab64666aedb00c2df551ee2'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:22.599053 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3e01e58b-db38-49e4-bd40-92322278f5c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae45b86924ba45e5a7af9c3b22a317bc', 'request_id': 'req-3e01e58b-db38-49e4-bd40-92322278f5c6'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:22.612292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3e01e58b-db38-49e4-bd40-92322278f5c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae45b86924ba45e5a7af9c3b22a317bc', 'request_id': 'req-3e01e58b-db38-49e4-bd40-92322278f5c6'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:22.629584 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 898/1786] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:22 2021] DELETE /identity/v3/users/db520a388ab64666aedb00c2df551ee2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:22.630749 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01819bd6-2c1a-40b5-b93a-467d24192a2c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:22.632372 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-01819bd6-2c1a-40b5-b93a-467d24192a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:22.640491 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3e01e58b-db38-49e4-bd40-92322278f5c6 admin admin] The token cache is being invalidate because project ae45b86924ba45e5a7af9c3b22a317bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:22.641158 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3e01e58b-db38-49e4-bd40-92322278f5c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:22.642184 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3e01e58b-db38-49e4-bd40-92322278f5c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:22.644925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 889/1787] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:22 2021] DELETE /identity/v3/projects/ae45b86924ba45e5a7af9c3b22a317bc => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:22.646993 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24b92c-b73b-4b70-82eb-a78ade09861f None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:22.648344 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24b92c-b73b-4b70-82eb-a78ade09861f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:22.648825 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24b92c-b73b-4b70-82eb-a78ade09861f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:22.702262 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-da24b92c-b73b-4b70-82eb-a78ade09861f None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:22.703475 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-da24b92c-b73b-4b70-82eb-a78ade09861f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:22.773952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01819bd6-2c1a-40b5-b93a-467d24192a2c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:22.785626 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32422b65-fdc6-4b99-b283-b958fd352617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:22.786318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32422b65-fdc6-4b99-b283-b958fd352617 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:22.803443 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32422b65-fdc6-4b99-b283-b958fd352617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:22.803900 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32422b65-fdc6-4b99-b283-b958fd352617 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:22.806879 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32422b65-fdc6-4b99-b283-b958fd352617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:22.818255 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32422b65-fdc6-4b99-b283-b958fd352617 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:22.854364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 890/1788] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:22.855881 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bf692-bfc8-494b-be61-ad907cf27a3c None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:22.856166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bf692-bfc8-494b-be61-ad907cf27a3c None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:22.856435 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bf692-bfc8-494b-be61-ad907cf27a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:22.863071 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 899/1789] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:22 2021] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:22.863993 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32422b65-fdc6-4b99-b283-b958fd352617 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:22.881800 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-32422b65-fdc6-4b99-b283-b958fd352617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:22.896762 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32422b65-fdc6-4b99-b283-b958fd352617 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:22.903889 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bd3b0-6bfd-4729-afaa-8be6c79323c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:22.905409 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bd3b0-6bfd-4729-afaa-8be6c79323c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:22.905699 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bd3b0-6bfd-4729-afaa-8be6c79323c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:22.906069 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bd3b0-6bfd-4729-afaa-8be6c79323c6 admin admin] PATH_INFO: `/v3/projects/6b63ee34087f457ba5c48899aec4a880/users/4afbb9e69aeb431aa83af4ecd7e9bd23/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:22.924074 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bd3b0-6bfd-4729-afaa-8be6c79323c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b63ee34087f457ba5c48899aec4a880, user_id=4afbb9e69aeb431aa83af4ecd7e9bd23, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:22.926720 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bd3b0-6bfd-4729-afaa-8be6c79323c6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:22.926977 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-4f4bf692-bfc8-494b-be61-ad907cf27a3c None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:22.928645 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-4f4bf692-bfc8-494b-be61-ad907cf27a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:22.962374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 900/1790] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:22 2021] PUT /identity/v3/projects/6b63ee34087f457ba5c48899aec4a880/users/4afbb9e69aeb431aa83af4ecd7e9bd23/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:22.965220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bd3b0-6bfd-4729-afaa-8be6c79323c6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:22.974031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 891/1791] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:22.974031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bf692-bfc8-494b-be61-ad907cf27a3c None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:22.974031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-4f4bf692-bfc8-494b-be61-ad907cf27a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:22.986982 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-8d9bd3b0-6bfd-4729-afaa-8be6c79323c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:23.064383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bf692-bfc8-494b-be61-ad907cf27a3c None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:23.074889 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bd3b0-6bfd-4729-afaa-8be6c79323c6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:23.080521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965915c-5b20-48d8-8638-313ece8b76ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:23.081396 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965915c-5b20-48d8-8638-313ece8b76ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:23.081730 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965915c-5b20-48d8-8638-313ece8b76ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:23.082032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965915c-5b20-48d8-8638-313ece8b76ca admin admin] PATH_INFO: `/v3/projects/c04d3e1db3fd4dec8a8b95fd89896acf` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:23.083231 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965915c-5b20-48d8-8638-313ece8b76ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04d3e1db3fd4dec8a8b95fd89896acf)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:23.085118 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965915c-5b20-48d8-8638-313ece8b76ca admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:23.141766 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f921d-7d7a-449b-8edc-5cb55281349d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:23.142567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f921d-7d7a-449b-8edc-5cb55281349d service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:23.142851 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f921d-7d7a-449b-8edc-5cb55281349d service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:23.143127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f921d-7d7a-449b-8edc-5cb55281349d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:23.155670 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f921d-7d7a-449b-8edc-5cb55281349d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:23.157136 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f921d-7d7a-449b-8edc-5cb55281349d service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:23.168925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 892/1792] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:23.170431 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f0462-a0fe-4e46-93fb-2118791621cb None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:23.170744 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f0462-a0fe-4e46-93fb-2118791621cb None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:23.171021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f0462-a0fe-4e46-93fb-2118791621cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:23.183593 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3965915c-5b20-48d8-8638-313ece8b76ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04d3e1db3fd4dec8a8b95fd89896acf', 'request_id': 'req-3965915c-5b20-48d8-8638-313ece8b76ca'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:23.197694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-321f0462-a0fe-4e46-93fb-2118791621cb None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:23.202776 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3965915c-5b20-48d8-8638-313ece8b76ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04d3e1db3fd4dec8a8b95fd89896acf', 'request_id': 'req-3965915c-5b20-48d8-8638-313ece8b76ca'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:23.214045 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3965915c-5b20-48d8-8638-313ece8b76ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04d3e1db3fd4dec8a8b95fd89896acf', 'request_id': 'req-3965915c-5b20-48d8-8638-313ece8b76ca'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:23.214704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-321f0462-a0fe-4e46-93fb-2118791621cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:23.243381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3965915c-5b20-48d8-8638-313ece8b76ca admin admin] The token cache is being invalidate because project c04d3e1db3fd4dec8a8b95fd89896acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:23.243970 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3965915c-5b20-48d8-8638-313ece8b76ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:23.244590 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3965915c-5b20-48d8-8638-313ece8b76ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:23.246592 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 901/1793] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:22 2021] DELETE /identity/v3/projects/c04d3e1db3fd4dec8a8b95fd89896acf => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:23.248561 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a7a1f-9d90-4252-9b5e-19d96a080687 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:23.248933 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a7a1f-9d90-4252-9b5e-19d96a080687 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:23.249306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a7a1f-9d90-4252-9b5e-19d96a080687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:23.295665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-174a7a1f-9d90-4252-9b5e-19d96a080687 None None] MFA Rules not processed for user `4afbb9e69aeb431aa83af4ecd7e9bd23`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:23.297250 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-174a7a1f-9d90-4252-9b5e-19d96a080687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:23.345665 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 893/1794] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:23.347520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f0462-a0fe-4e46-93fb-2118791621cb None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:23.351358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-321f0462-a0fe-4e46-93fb-2118791621cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:23.365488 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f0462-a0fe-4e46-93fb-2118791621cb None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:23.372182 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d49e4-44a1-465c-81d5-adefea4b9d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:23.374263 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d49e4-44a1-465c-81d5-adefea4b9d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:23.374615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d49e4-44a1-465c-81d5-adefea4b9d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:23.374899 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d49e4-44a1-465c-81d5-adefea4b9d0b admin admin] PATH_INFO: `/v3/users/779febe3cedb4d0d985a083ca6bb5f34` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:23.376911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d49e4-44a1-465c-81d5-adefea4b9d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=779febe3cedb4d0d985a083ca6bb5f34)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:23.381461 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d49e4-44a1-465c-81d5-adefea4b9d0b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:23.426711 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 902/1795] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:23 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:23.427609 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a7a1f-9d90-4252-9b5e-19d96a080687 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:23.452175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a7a1f-9d90-4252-9b5e-19d96a080687 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:23.460334 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ae1d49e4-44a1-465c-81d5-adefea4b9d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '779febe3cedb4d0d985a083ca6bb5f34'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:23.464633 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8ad64-8d9a-402e-a355-7e939f3cfdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:23.465459 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8ad64-8d9a-402e-a355-7e939f3cfdda admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:23.465941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8ad64-8d9a-402e-a355-7e939f3cfdda admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:23.466249 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8ad64-8d9a-402e-a355-7e939f3cfdda admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:23.467055 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8ad64-8d9a-402e-a355-7e939f3cfdda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:23.467357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8ad64-8d9a-402e-a355-7e939f3cfdda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:23.469069 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8ad64-8d9a-402e-a355-7e939f3cfdda admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:23.478984 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ae1d49e4-44a1-465c-81d5-adefea4b9d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '779febe3cedb4d0d985a083ca6bb5f34'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:23.484511 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 903/1796] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:23.485470 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8ad64-8d9a-402e-a355-7e939f3cfdda admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:23.487754 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-41a8ad64-8d9a-402e-a355-7e939f3cfdda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:23.491497 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ae1d49e4-44a1-465c-81d5-adefea4b9d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '779febe3cedb4d0d985a083ca6bb5f34'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:23.502726 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8ad64-8d9a-402e-a355-7e939f3cfdda admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:23.508032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ae1d49e4-44a1-465c-81d5-adefea4b9d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '779febe3cedb4d0d985a083ca6bb5f34'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:23.508893 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05f3e2-76b8-4503-82ac-d49ea4d92c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:23.509408 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ae1d49e4-44a1-465c-81d5-adefea4b9d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '779febe3cedb4d0d985a083ca6bb5f34'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:23.509740 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05f3e2-76b8-4503-82ac-d49ea4d92c92 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:23.510229 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05f3e2-76b8-4503-82ac-d49ea4d92c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:23.510587 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05f3e2-76b8-4503-82ac-d49ea4d92c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:23.511392 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05f3e2-76b8-4503-82ac-d49ea4d92c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:23.514960 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05f3e2-76b8-4503-82ac-d49ea4d92c92 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:23.518423 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 894/1797] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:23 2021] DELETE /identity/v3/users/779febe3cedb4d0d985a083ca6bb5f34 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:23.519671 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d49e4-44a1-465c-81d5-adefea4b9d0b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:23.521211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-ae1d49e4-44a1-465c-81d5-adefea4b9d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:23.616145 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 904/1798] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:23 2021] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:23.620711 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05f3e2-76b8-4503-82ac-d49ea4d92c92 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:23.622748 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3e05f3e2-76b8-4503-82ac-d49ea4d92c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:23.670886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d49e4-44a1-465c-81d5-adefea4b9d0b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:23.799167 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd2224-697d-45c1-be7b-02a1b932ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:23.800823 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd2224-697d-45c1-be7b-02a1b932ff65 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:23.802553 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd2224-697d-45c1-be7b-02a1b932ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:23.803271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd2224-697d-45c1-be7b-02a1b932ff65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:23.804330 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd2224-697d-45c1-be7b-02a1b932ff65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:23.812019 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd2224-697d-45c1-be7b-02a1b932ff65 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:23.814070 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05f3e2-76b8-4503-82ac-d49ea4d92c92 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:23.825791 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a95150-4d0b-4035-9fb3-8210335e50f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:23.826586 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a95150-4d0b-4035-9fb3-8210335e50f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:23.826871 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a95150-4d0b-4035-9fb3-8210335e50f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:23.827151 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a95150-4d0b-4035-9fb3-8210335e50f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:23.827871 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a95150-4d0b-4035-9fb3-8210335e50f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:23.829800 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a95150-4d0b-4035-9fb3-8210335e50f4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:23.880749 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 895/1799] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:23 2021] POST /identity/v3/projects => generated 405 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:23.881660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd2224-697d-45c1-be7b-02a1b932ff65 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:23.883914 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-ebcd2224-697d-45c1-be7b-02a1b932ff65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:23.896417 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 905/1800] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:23 2021] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:23.898689 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a95150-4d0b-4035-9fb3-8210335e50f4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:23.956590 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a95150-4d0b-4035-9fb3-8210335e50f4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:23.979411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd2224-697d-45c1-be7b-02a1b932ff65 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:23.983816 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6c1de-bb28-4c6c-a9a2-c35c2e2f1d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:23.986126 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00e632-86b7-49e2-9e94-af2cd5fca971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:23.986289 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6c1de-bb28-4c6c-a9a2-c35c2e2f1d75 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:23.987288 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00e632-86b7-49e2-9e94-af2cd5fca971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:23.987880 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6c1de-bb28-4c6c-a9a2-c35c2e2f1d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:23.988079 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00e632-86b7-49e2-9e94-af2cd5fca971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:23.988368 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00e632-86b7-49e2-9e94-af2cd5fca971 admin admin] PATH_INFO: `/v3/projects/d4f3ca697c1742c2b65cc2140f34337a` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:23.988483 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6c1de-bb28-4c6c-a9a2-c35c2e2f1d75 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:23.989165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6c1de-bb28-4c6c-a9a2-c35c2e2f1d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:23.989609 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00e632-86b7-49e2-9e94-af2cd5fca971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f3ca697c1742c2b65cc2140f34337a)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:23.991767 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00e632-86b7-49e2-9e94-af2cd5fca971 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:24.001176 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6c1de-bb28-4c6c-a9a2-c35c2e2f1d75 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:24.055511 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 906/1801] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:23 2021] POST /identity/v3/users => generated 303 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:24.058256 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6c1de-bb28-4c6c-a9a2-c35c2e2f1d75 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:24.070118 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6c1de-bb28-4c6c-a9a2-c35c2e2f1d75 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:24.073179 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7d00e632-86b7-49e2-9e94-af2cd5fca971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f3ca697c1742c2b65cc2140f34337a', 'request_id': 'req-7d00e632-86b7-49e2-9e94-af2cd5fca971'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:24.092467 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7d00e632-86b7-49e2-9e94-af2cd5fca971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f3ca697c1742c2b65cc2140f34337a', 'request_id': 'req-7d00e632-86b7-49e2-9e94-af2cd5fca971'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:24.105614 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7d00e632-86b7-49e2-9e94-af2cd5fca971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f3ca697c1742c2b65cc2140f34337a', 'request_id': 'req-7d00e632-86b7-49e2-9e94-af2cd5fca971'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:24.152658 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f2d62-68c9-4584-b663-f7bfa9a05934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:24.153256 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f2d62-68c9-4584-b663-f7bfa9a05934 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:24.153532 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f2d62-68c9-4584-b663-f7bfa9a05934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:24.153803 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f2d62-68c9-4584-b663-f7bfa9a05934 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:24.155122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f2d62-68c9-4584-b663-f7bfa9a05934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:24.156750 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7d00e632-86b7-49e2-9e94-af2cd5fca971 admin admin] The token cache is being invalidate because project d4f3ca697c1742c2b65cc2140f34337a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:24.156882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7d00e632-86b7-49e2-9e94-af2cd5fca971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:24.157589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7d00e632-86b7-49e2-9e94-af2cd5fca971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:24.160641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f2d62-68c9-4584-b663-f7bfa9a05934 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:24.161888 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 896/1802] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:23 2021] DELETE /identity/v3/projects/d4f3ca697c1742c2b65cc2140f34337a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:24.162739 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00e632-86b7-49e2-9e94-af2cd5fca971 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:24.166912 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-7d00e632-86b7-49e2-9e94-af2cd5fca971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:24.187047 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 907/1803] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:24 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:24.188071 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f2d62-68c9-4584-b663-f7bfa9a05934 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:24.192324 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-408f2d62-68c9-4584-b663-f7bfa9a05934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:24.198483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00e632-86b7-49e2-9e94-af2cd5fca971 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:24.204982 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fc5d4-29d1-43cb-9554-6915a213b5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:24.205806 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fc5d4-29d1-43cb-9554-6915a213b5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:24.206017 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fc5d4-29d1-43cb-9554-6915a213b5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:24.206220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fc5d4-29d1-43cb-9554-6915a213b5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:24.206976 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fc5d4-29d1-43cb-9554-6915a213b5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:24.208959 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fc5d4-29d1-43cb-9554-6915a213b5e3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:24.212569 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f2d62-68c9-4584-b663-f7bfa9a05934 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:24.217874 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:24.223861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 897/1804] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:24 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:24.225173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fc5d4-29d1-43cb-9554-6915a213b5e3 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:24.227448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-098fc5d4-29d1-43cb-9554-6915a213b5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:24.228227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:24.228622 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:24.229024 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5 admin admin] PATH_INFO: `/v3/projects/2e98a004fd8f45baac15d8704c96a2f8` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:24.230498 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e98a004fd8f45baac15d8704c96a2f8)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:24.233957 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:24.244029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fc5d4-29d1-43cb-9554-6915a213b5e3 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:24.251304 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40722339-f08d-44b4-b7a2-9540342bde77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:24.252923 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40722339-f08d-44b4-b7a2-9540342bde77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:24.253519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40722339-f08d-44b4-b7a2-9540342bde77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:24.254169 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40722339-f08d-44b4-b7a2-9540342bde77 admin admin] PATH_INFO: `/v3/users/f37903e121df4d8da6029c2de1bb6f6d` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:24.255773 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40722339-f08d-44b4-b7a2-9540342bde77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37903e121df4d8da6029c2de1bb6f6d)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:24.258237 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40722339-f08d-44b4-b7a2-9540342bde77 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:24.320604 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-40722339-f08d-44b4-b7a2-9540342bde77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37903e121df4d8da6029c2de1bb6f6d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:24.340564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-40722339-f08d-44b4-b7a2-9540342bde77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37903e121df4d8da6029c2de1bb6f6d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:24.349840 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-40722339-f08d-44b4-b7a2-9540342bde77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37903e121df4d8da6029c2de1bb6f6d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:24.351850 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e98a004fd8f45baac15d8704c96a2f8', 'request_id': 'req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:24.364784 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-40722339-f08d-44b4-b7a2-9540342bde77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37903e121df4d8da6029c2de1bb6f6d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:24.365419 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-40722339-f08d-44b4-b7a2-9540342bde77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37903e121df4d8da6029c2de1bb6f6d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:24.371662 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e98a004fd8f45baac15d8704c96a2f8', 'request_id': 'req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:24.372227 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 898/1805] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:24 2021] DELETE /identity/v3/users/f37903e121df4d8da6029c2de1bb6f6d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:24.374427 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40722339-f08d-44b4-b7a2-9540342bde77 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:24.390973 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-40722339-f08d-44b4-b7a2-9540342bde77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:24.403920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e98a004fd8f45baac15d8704c96a2f8', 'request_id': 'req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:24.433490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5 admin admin] The token cache is being invalidate because project 2e98a004fd8f45baac15d8704c96a2f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:24.439466 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:24.441970 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:24.454983 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 908/1806] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:24 2021] DELETE /identity/v3/projects/2e98a004fd8f45baac15d8704c96a2f8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:24.467354 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:24.474604 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:24.552350 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40722339-f08d-44b4-b7a2-9540342bde77 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:24.566576 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8bccf-bdc7-442a-9210-332f5bfe243e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:24.567567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8bccf-bdc7-442a-9210-332f5bfe243e admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:24.567919 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8bccf-bdc7-442a-9210-332f5bfe243e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:24.568261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8bccf-bdc7-442a-9210-332f5bfe243e admin admin] PATH_INFO: `/v3/projects/b8127956f49d4a8184abc658de59ebbc/users/0fc59617076e479baef35f6e57ece32f/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:24.601164 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8bccf-bdc7-442a-9210-332f5bfe243e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8127956f49d4a8184abc658de59ebbc, user_id=0fc59617076e479baef35f6e57ece32f, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:24.604220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8bccf-bdc7-442a-9210-332f5bfe243e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:24.607814 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ba5b6-15c0-4347-aa3e-6c868bfcc8b5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:24.613549 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcb656-f165-4a3d-a15c-77c41fbbe476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:24.614208 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcb656-f165-4a3d-a15c-77c41fbbe476 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:24.614787 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcb656-f165-4a3d-a15c-77c41fbbe476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:24.614787 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcb656-f165-4a3d-a15c-77c41fbbe476 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:24.615492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcb656-f165-4a3d-a15c-77c41fbbe476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:24.617163 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcb656-f165-4a3d-a15c-77c41fbbe476 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:24.635731 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 909/1807] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:24 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:24.635731 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95e544-edc7-4a21-8e42-6ffc85b47aa7 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:24.635731 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95e544-edc7-4a21-8e42-6ffc85b47aa7 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:24.635731 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95e544-edc7-4a21-8e42-6ffc85b47aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:24.637902 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 899/1808] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:24 2021] PUT /identity/v3/projects/b8127956f49d4a8184abc658de59ebbc/users/0fc59617076e479baef35f6e57ece32f/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:24.640064 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8bccf-bdc7-442a-9210-332f5bfe243e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:24.661432 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-5e95e544-edc7-4a21-8e42-6ffc85b47aa7 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:24.662952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5e95e544-edc7-4a21-8e42-6ffc85b47aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:24.773618 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 910/1809] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:24.774202 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95e544-edc7-4a21-8e42-6ffc85b47aa7 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:24.775366 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8bccf-bdc7-442a-9210-332f5bfe243e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:24.778709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5e95e544-edc7-4a21-8e42-6ffc85b47aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:24.791123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf029f-b35b-42fe-b6af-50202310f568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:24.792182 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf029f-b35b-42fe-b6af-50202310f568 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:24.792304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95e544-edc7-4a21-8e42-6ffc85b47aa7 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:24.792605 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf029f-b35b-42fe-b6af-50202310f568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:24.793066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf029f-b35b-42fe-b6af-50202310f568 admin admin] PATH_INFO: `/v3/projects/d746d1a4ceb143e0a0f65d572b601808/users/cbe15db6a6204883ae355d112bb833ff/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:24.798222 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68d3f5-51bf-4e01-9524-9246c125d268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:24.799006 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68d3f5-51bf-4e01-9524-9246c125d268 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:24.799347 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68d3f5-51bf-4e01-9524-9246c125d268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:24.799628 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68d3f5-51bf-4e01-9524-9246c125d268 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:24.800591 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68d3f5-51bf-4e01-9524-9246c125d268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:24.802466 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68d3f5-51bf-4e01-9524-9246c125d268 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:24.817761 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 911/1810] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:24 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:24.817761 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9281b60-4701-4ac0-ba90-35f6d9a3c4fe None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:24.817761 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9281b60-4701-4ac0-ba90-35f6d9a3c4fe None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:24.817761 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9281b60-4701-4ac0-ba90-35f6d9a3c4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:24.840186 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-b9281b60-4701-4ac0-ba90-35f6d9a3c4fe None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:24.841406 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b9281b60-4701-4ac0-ba90-35f6d9a3c4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:24.844719 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf029f-b35b-42fe-b6af-50202310f568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d746d1a4ceb143e0a0f65d572b601808, user_id=cbe15db6a6204883ae355d112bb833ff, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:24.848514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf029f-b35b-42fe-b6af-50202310f568 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:24.850772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 912/1811] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:24.851620 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9281b60-4701-4ac0-ba90-35f6d9a3c4fe None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:24.864968 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9281b60-4701-4ac0-ba90-35f6d9a3c4fe None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:24.877140 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 900/1812] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:24 2021] PUT /identity/v3/projects/d746d1a4ceb143e0a0f65d572b601808/users/cbe15db6a6204883ae355d112bb833ff/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:24.878141 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf029f-b35b-42fe-b6af-50202310f568 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:24.972950 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28d346-c18e-46a7-a4f2-95a15b2e3fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:24.973860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28d346-c18e-46a7-a4f2-95a15b2e3fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:24.974171 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28d346-c18e-46a7-a4f2-95a15b2e3fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:24.974448 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28d346-c18e-46a7-a4f2-95a15b2e3fe7 admin admin] PATH_INFO: `/v3/projects/b8127956f49d4a8184abc658de59ebbc/users/0fc59617076e479baef35f6e57ece32f/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:24.976491 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28d346-c18e-46a7-a4f2-95a15b2e3fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8127956f49d4a8184abc658de59ebbc, user_id=0fc59617076e479baef35f6e57ece32f, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:24.979175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28d346-c18e-46a7-a4f2-95a15b2e3fe7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:24.987073 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf029f-b35b-42fe-b6af-50202310f568 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:24.993372 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 913/1813] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:24 2021] PUT /identity/v3/projects/b8127956f49d4a8184abc658de59ebbc/users/0fc59617076e479baef35f6e57ece32f/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:24.993372 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e06d1-68f9-4209-b3fb-1a62fe5ababb None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:24.993372 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e06d1-68f9-4209-b3fb-1a62fe5ababb None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:24.993372 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e06d1-68f9-4209-b3fb-1a62fe5ababb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:25.040633 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-7c9e06d1-68f9-4209-b3fb-1a62fe5ababb None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:25.041835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7c9e06d1-68f9-4209-b3fb-1a62fe5ababb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:25.094882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cb44a-a7b9-40b8-9848-e54632b2634a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:25.095800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cb44a-a7b9-40b8-9848-e54632b2634a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:25.096095 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cb44a-a7b9-40b8-9848-e54632b2634a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:25.096373 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cb44a-a7b9-40b8-9848-e54632b2634a admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:25.097273 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cb44a-a7b9-40b8-9848-e54632b2634a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:25.097583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cb44a-a7b9-40b8-9848-e54632b2634a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:25.101705 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cb44a-a7b9-40b8-9848-e54632b2634a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:25.115403 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 914/1814] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:25.116846 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e06d1-68f9-4209-b3fb-1a62fe5ababb None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:25.119236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7c9e06d1-68f9-4209-b3fb-1a62fe5ababb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:25.120739 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 901/1815] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:25.127826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628850e6-df28-466f-a66a-848ae66903d2 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:25.128124 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628850e6-df28-466f-a66a-848ae66903d2 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:25.128404 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628850e6-df28-466f-a66a-848ae66903d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:25.136664 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e06d1-68f9-4209-b3fb-1a62fe5ababb None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:25.141529 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d820ada-610d-47d6-b39d-bcf10f738f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:25.142428 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d820ada-610d-47d6-b39d-bcf10f738f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:25.142707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d820ada-610d-47d6-b39d-bcf10f738f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:25.142976 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d820ada-610d-47d6-b39d-bcf10f738f74 admin admin] PATH_INFO: `/v3/projects/de5c8b190c49475c98c5cc21668fe921` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:25.150434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d820ada-610d-47d6-b39d-bcf10f738f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5c8b190c49475c98c5cc21668fe921)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:25.158832 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d820ada-610d-47d6-b39d-bcf10f738f74 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:25.230547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2d820ada-610d-47d6-b39d-bcf10f738f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5c8b190c49475c98c5cc21668fe921', 'request_id': 'req-2d820ada-610d-47d6-b39d-bcf10f738f74'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:25.235200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-628850e6-df28-466f-a66a-848ae66903d2 None None] MFA Rules not processed for user `0fc59617076e479baef35f6e57ece32f`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:25.236411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-628850e6-df28-466f-a66a-848ae66903d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:25.242769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2d820ada-610d-47d6-b39d-bcf10f738f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5c8b190c49475c98c5cc21668fe921', 'request_id': 'req-2d820ada-610d-47d6-b39d-bcf10f738f74'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:25.251352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2d820ada-610d-47d6-b39d-bcf10f738f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5c8b190c49475c98c5cc21668fe921', 'request_id': 'req-2d820ada-610d-47d6-b39d-bcf10f738f74'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:25.261764 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2d820ada-610d-47d6-b39d-bcf10f738f74 admin admin] The token cache is being invalidate because project de5c8b190c49475c98c5cc21668fe921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:25.262086 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2d820ada-610d-47d6-b39d-bcf10f738f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:25.262883 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2d820ada-610d-47d6-b39d-bcf10f738f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:25.264952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 915/1816] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:25 2021] DELETE /identity/v3/projects/de5c8b190c49475c98c5cc21668fe921 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:25.265763 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d820ada-610d-47d6-b39d-bcf10f738f74 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:25.269746 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-2d820ada-610d-47d6-b39d-bcf10f738f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:25.338270 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 902/1817] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:25 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:25.338270 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628850e6-df28-466f-a66a-848ae66903d2 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:25.338270 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-628850e6-df28-466f-a66a-848ae66903d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:25.348316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d820ada-610d-47d6-b39d-bcf10f738f74 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:25.353083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895dfa3-a8fb-437f-8c44-b20809fe8404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:25.354036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895dfa3-a8fb-437f-8c44-b20809fe8404 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:25.354324 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895dfa3-a8fb-437f-8c44-b20809fe8404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:25.354599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895dfa3-a8fb-437f-8c44-b20809fe8404 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:25.355305 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895dfa3-a8fb-437f-8c44-b20809fe8404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:25.357753 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895dfa3-a8fb-437f-8c44-b20809fe8404 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:25.384181 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 916/1818] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:25 2021] POST /identity/v3/projects => generated 399 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:25.385486 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715accb-26a7-4856-ae71-7c1ce7ee8b29 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:25.385726 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715accb-26a7-4856-ae71-7c1ce7ee8b29 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:25.386072 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715accb-26a7-4856-ae71-7c1ce7ee8b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:25.405226 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628850e6-df28-466f-a66a-848ae66903d2 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:25.415450 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-6715accb-26a7-4856-ae71-7c1ce7ee8b29 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:25.416691 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6715accb-26a7-4856-ae71-7c1ce7ee8b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:25.473796 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a4403-9fe6-42cf-ac66-a0515d84833f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:25.474699 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a4403-9fe6-42cf-ac66-a0515d84833f service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:25.475049 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a4403-9fe6-42cf-ac66-a0515d84833f service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:25.475396 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a4403-9fe6-42cf-ac66-a0515d84833f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:25.477311 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-5a7a4403-9fe6-42cf-ac66-a0515d84833f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:25.494314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 917/1819] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:25.494314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715accb-26a7-4856-ae71-7c1ce7ee8b29 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:25.494314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6715accb-26a7-4856-ae71-7c1ce7ee8b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:25.497452 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a4403-9fe6-42cf-ac66-a0515d84833f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:25.499326 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a4403-9fe6-42cf-ac66-a0515d84833f service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:25.510380 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 903/1820] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:25.511307 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a4403-9fe6-42cf-ac66-a0515d84833f service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:25.526721 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a4403-9fe6-42cf-ac66-a0515d84833f service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:25.533872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf73c0f-340e-4036-83fd-36a2e8b5452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:25.534673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf73c0f-340e-4036-83fd-36a2e8b5452d admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:25.534966 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf73c0f-340e-4036-83fd-36a2e8b5452d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:25.535278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf73c0f-340e-4036-83fd-36a2e8b5452d admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:25.535985 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf73c0f-340e-4036-83fd-36a2e8b5452d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:25.538415 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf73c0f-340e-4036-83fd-36a2e8b5452d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:25.561563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715accb-26a7-4856-ae71-7c1ce7ee8b29 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:25.566632 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12727d-0895-43ed-aaeb-9ef300fe6d44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:25.567270 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12727d-0895-43ed-aaeb-9ef300fe6d44 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:25.567558 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12727d-0895-43ed-aaeb-9ef300fe6d44 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:25.567835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12727d-0895-43ed-aaeb-9ef300fe6d44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:25.585726 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 904/1821] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:25 2021] POST /identity/v3/users => generated 300 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:25.587673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a2157-9ab1-47a6-b229-a197147ae27b None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:25.588243 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a2157-9ab1-47a6-b229-a197147ae27b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:25.588699 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a2157-9ab1-47a6-b229-a197147ae27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:25.651871 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-e55a2157-9ab1-47a6-b229-a197147ae27b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:25.653931 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e55a2157-9ab1-47a6-b229-a197147ae27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:25.673064 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12727d-0895-43ed-aaeb-9ef300fe6d44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:25.674879 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12727d-0895-43ed-aaeb-9ef300fe6d44 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:25.681098 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 905/1822] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:25.681909 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a2157-9ab1-47a6-b229-a197147ae27b None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:25.688083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 918/1823] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:25 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:25.690145 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12727d-0895-43ed-aaeb-9ef300fe6d44 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:25.692029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a2157-9ab1-47a6-b229-a197147ae27b None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:25.697806 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41989b5c-3099-4b60-a0ac-59f9ab7f11ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:25.698694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41989b5c-3099-4b60-a0ac-59f9ab7f11ad admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:25.699137 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41989b5c-3099-4b60-a0ac-59f9ab7f11ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:25.699607 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41989b5c-3099-4b60-a0ac-59f9ab7f11ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:25.700533 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41989b5c-3099-4b60-a0ac-59f9ab7f11ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:25.702289 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41989b5c-3099-4b60-a0ac-59f9ab7f11ad admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:25.713302 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12727d-0895-43ed-aaeb-9ef300fe6d44 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:25.722692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3dab0-30e6-46e6-ad38-20dc4a014926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:25.723833 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3dab0-30e6-46e6-ad38-20dc4a014926 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:25.724259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3dab0-30e6-46e6-ad38-20dc4a014926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:25.724723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3dab0-30e6-46e6-ad38-20dc4a014926 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:25.725927 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3dab0-30e6-46e6-ad38-20dc4a014926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:25.726418 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3dab0-30e6-46e6-ad38-20dc4a014926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:25.736037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3dab0-30e6-46e6-ad38-20dc4a014926 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:25.747479 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 906/1824] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:25 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:25.748988 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41989b5c-3099-4b60-a0ac-59f9ab7f11ad admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:25.754278 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 919/1825] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:25.755184 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3dab0-30e6-46e6-ad38-20dc4a014926 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:25.759219 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41989b5c-3099-4b60-a0ac-59f9ab7f11ad admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:25.766650 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3dab0-30e6-46e6-ad38-20dc4a014926 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:25.767494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ba9c4-0f53-4051-b3c4-70999a0a34e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:25.768232 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ba9c4-0f53-4051-b3c4-70999a0a34e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:25.769093 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ba9c4-0f53-4051-b3c4-70999a0a34e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:25.769375 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ba9c4-0f53-4051-b3c4-70999a0a34e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:25.770160 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ba9c4-0f53-4051-b3c4-70999a0a34e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:25.771742 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ba9c4-0f53-4051-b3c4-70999a0a34e2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:25.772514 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896efce-e74f-4368-8e53-d811c6d6ba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:25.773391 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896efce-e74f-4368-8e53-d811c6d6ba0f admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:25.773874 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896efce-e74f-4368-8e53-d811c6d6ba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:25.774377 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896efce-e74f-4368-8e53-d811c6d6ba0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:25.780694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896efce-e74f-4368-8e53-d811c6d6ba0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:25.783375 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896efce-e74f-4368-8e53-d811c6d6ba0f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:25.813390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 907/1826] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:25 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:03:25.814800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ba9c4-0f53-4051-b3c4-70999a0a34e2 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:25.831077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 920/1827] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:25 2021] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:25.832592 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896efce-e74f-4368-8e53-d811c6d6ba0f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:25.843114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ba9c4-0f53-4051-b3c4-70999a0a34e2 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:25.969485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896efce-e74f-4368-8e53-d811c6d6ba0f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:25.987071 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8271eb-5492-4127-abbf-65ecd591a780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:25.987966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8271eb-5492-4127-abbf-65ecd591a780 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:25.988245 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8271eb-5492-4127-abbf-65ecd591a780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:25.988683 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8271eb-5492-4127-abbf-65ecd591a780 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:25.989408 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8271eb-5492-4127-abbf-65ecd591a780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:25.991396 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8271eb-5492-4127-abbf-65ecd591a780 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:26.039088 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677fa41-02ef-4ddd-958a-73aeae711941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:26.039460 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 921/1828] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:25 2021] POST /identity/v3/users => generated 286 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:26.040101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677fa41-02ef-4ddd-958a-73aeae711941 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:26.040447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677fa41-02ef-4ddd-958a-73aeae711941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:26.040731 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677fa41-02ef-4ddd-958a-73aeae711941 admin admin] PATH_INFO: `/v3/projects/78cf549e410f4e3fa9bf3794ed2f77c3/users/2a54e113ce8e4e83b79b39b216c47318/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:26.044647 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8271eb-5492-4127-abbf-65ecd591a780 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:26.073767 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8271eb-5492-4127-abbf-65ecd591a780 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:26.083066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6026d05-7ec5-4b84-8674-223ab81e2b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:26.083819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6026d05-7ec5-4b84-8674-223ab81e2b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:26.084119 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6026d05-7ec5-4b84-8674-223ab81e2b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:26.084434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6026d05-7ec5-4b84-8674-223ab81e2b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:26.085425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6026d05-7ec5-4b84-8674-223ab81e2b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:26.087371 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6026d05-7ec5-4b84-8674-223ab81e2b58 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:26.093686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677fa41-02ef-4ddd-958a-73aeae711941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78cf549e410f4e3fa9bf3794ed2f77c3, user_id=2a54e113ce8e4e83b79b39b216c47318, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:26.100390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677fa41-02ef-4ddd-958a-73aeae711941 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:26.131462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 922/1829] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:26 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:26.132519 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6026d05-7ec5-4b84-8674-223ab81e2b58 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:26.153948 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 908/1830] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:25 2021] PUT /identity/v3/projects/78cf549e410f4e3fa9bf3794ed2f77c3/users/2a54e113ce8e4e83b79b39b216c47318/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:03:26.156555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226b8cb-17af-4b8f-9271-29f0963f4c85 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:26.156843 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226b8cb-17af-4b8f-9271-29f0963f4c85 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:26.160899 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226b8cb-17af-4b8f-9271-29f0963f4c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:26.162415 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6026d05-7ec5-4b84-8674-223ab81e2b58 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:26.248256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-7226b8cb-17af-4b8f-9271-29f0963f4c85 None None] MFA Rules not processed for user `2a54e113ce8e4e83b79b39b216c47318`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:26.251946 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-7226b8cb-17af-4b8f-9271-29f0963f4c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:26.291983 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de487f86-e94a-4460-9d1c-baaf438f504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:26.294258 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de487f86-e94a-4460-9d1c-baaf438f504f admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:26.298414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de487f86-e94a-4460-9d1c-baaf438f504f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:26.299612 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de487f86-e94a-4460-9d1c-baaf438f504f admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:26.300664 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de487f86-e94a-4460-9d1c-baaf438f504f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:26.312710 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de487f86-e94a-4460-9d1c-baaf438f504f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:26.380486 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 923/1831] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:26 2021] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:26.381720 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de487f86-e94a-4460-9d1c-baaf438f504f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:26.416818 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de487f86-e94a-4460-9d1c-baaf438f504f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:26.443127 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d16e97-892a-4597-966d-13098011fdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:26.444034 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d16e97-892a-4597-966d-13098011fdb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:26.444316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d16e97-892a-4597-966d-13098011fdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:26.444595 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d16e97-892a-4597-966d-13098011fdb9 admin admin] PATH_INFO: `/v3/projects/57f9e7823c6f44589ec92c3f44a3322e/users/2e3d941ceb0741f5912f6783c65fde97/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:26.476514 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d16e97-892a-4597-966d-13098011fdb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f9e7823c6f44589ec92c3f44a3322e, user_id=2e3d941ceb0741f5912f6783c65fde97, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:26.479706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d16e97-892a-4597-966d-13098011fdb9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:26.513959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 924/1832] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:26 2021] PUT /identity/v3/projects/57f9e7823c6f44589ec92c3f44a3322e/users/2e3d941ceb0741f5912f6783c65fde97/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:26.522242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d16e97-892a-4597-966d-13098011fdb9 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:26.522390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 909/1833] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:26 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:26.523931 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-78d16e97-892a-4597-966d-13098011fdb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:26.532437 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226b8cb-17af-4b8f-9271-29f0963f4c85 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:26.567216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226b8cb-17af-4b8f-9271-29f0963f4c85 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:26.679453 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d16e97-892a-4597-966d-13098011fdb9 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:26.695633 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d739278-76c7-49a2-b4a7-c64fda25d38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:26.697127 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d739278-76c7-49a2-b4a7-c64fda25d38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:26.697457 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d739278-76c7-49a2-b4a7-c64fda25d38b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:26.697775 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d739278-76c7-49a2-b4a7-c64fda25d38b admin admin] PATH_INFO: `/v3/users/4afbb9e69aeb431aa83af4ecd7e9bd23` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:26.699490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d739278-76c7-49a2-b4a7-c64fda25d38b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4afbb9e69aeb431aa83af4ecd7e9bd23)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:26.702320 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d739278-76c7-49a2-b4a7-c64fda25d38b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:26.730249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec5f82-bf09-4804-b873-33e080beb20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:26.733206 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec5f82-bf09-4804-b873-33e080beb20f admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:26.734612 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec5f82-bf09-4804-b873-33e080beb20f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:26.735656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec5f82-bf09-4804-b873-33e080beb20f admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:26.737550 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec5f82-bf09-4804-b873-33e080beb20f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:26.749955 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec5f82-bf09-4804-b873-33e080beb20f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:26.810635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2d739278-76c7-49a2-b4a7-c64fda25d38b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4afbb9e69aeb431aa83af4ecd7e9bd23'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:26.824736 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 910/1834] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:26 2021] POST /identity/v3/projects => generated 401 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:26.829541 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f73a9-36e0-4ed1-8f35-2c3906e50ad4 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:26.829863 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f73a9-36e0-4ed1-8f35-2c3906e50ad4 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:26.831553 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f73a9-36e0-4ed1-8f35-2c3906e50ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:26.851597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2d739278-76c7-49a2-b4a7-c64fda25d38b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4afbb9e69aeb431aa83af4ecd7e9bd23'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:26.869938 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2d739278-76c7-49a2-b4a7-c64fda25d38b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4afbb9e69aeb431aa83af4ecd7e9bd23'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:26.871060 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2d739278-76c7-49a2-b4a7-c64fda25d38b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4afbb9e69aeb431aa83af4ecd7e9bd23'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:26.872130 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2d739278-76c7-49a2-b4a7-c64fda25d38b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4afbb9e69aeb431aa83af4ecd7e9bd23'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:26.891347 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-8e6f73a9-36e0-4ed1-8f35-2c3906e50ad4 None None] MFA Rules not processed for user `2e3d941ceb0741f5912f6783c65fde97`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:26.892867 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8e6f73a9-36e0-4ed1-8f35-2c3906e50ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:26.906079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 925/1835] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:26 2021] DELETE /identity/v3/users/4afbb9e69aeb431aa83af4ecd7e9bd23 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:26.907862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d739278-76c7-49a2-b4a7-c64fda25d38b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:26.910068 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-2d739278-76c7-49a2-b4a7-c64fda25d38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:27.002003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 911/1836] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:26 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:27.003462 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f73a9-36e0-4ed1-8f35-2c3906e50ad4 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:27.005411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8e6f73a9-36e0-4ed1-8f35-2c3906e50ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:27.040914 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d739278-76c7-49a2-b4a7-c64fda25d38b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:27.046166 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd22d70-b921-4a9b-a3f1-e3ab0776fbb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:27.047073 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd22d70-b921-4a9b-a3f1-e3ab0776fbb2 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:27.047523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd22d70-b921-4a9b-a3f1-e3ab0776fbb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:27.047946 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd22d70-b921-4a9b-a3f1-e3ab0776fbb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:27.050345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-8fd22d70-b921-4a9b-a3f1-e3ab0776fbb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:27.062078 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd22d70-b921-4a9b-a3f1-e3ab0776fbb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:27.064216 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd22d70-b921-4a9b-a3f1-e3ab0776fbb2 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:27.077712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 926/1837] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:26 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:27.078619 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd22d70-b921-4a9b-a3f1-e3ab0776fbb2 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:27.080304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-8fd22d70-b921-4a9b-a3f1-e3ab0776fbb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:27.174651 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f73a9-36e0-4ed1-8f35-2c3906e50ad4 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:27.180946 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e08e4-006a-4ba3-ae84-4c616a8da20b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:27.182200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e08e4-006a-4ba3-ae84-4c616a8da20b service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:27.183082 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e08e4-006a-4ba3-ae84-4c616a8da20b service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:27.184592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e08e4-006a-4ba3-ae84-4c616a8da20b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:27.222505 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e08e4-006a-4ba3-ae84-4c616a8da20b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:27.224202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e08e4-006a-4ba3-ae84-4c616a8da20b service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:27.244642 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 912/1838] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:27 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:27.249931 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b7d04-804b-4859-9876-7b44ac1d99a2 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:27.250443 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b7d04-804b-4859-9876-7b44ac1d99a2 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:27.250917 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b7d04-804b-4859-9876-7b44ac1d99a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:27.275287 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-bb2b7d04-804b-4859-9876-7b44ac1d99a2 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:27.275513 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd22d70-b921-4a9b-a3f1-e3ab0776fbb2 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:27.276972 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-bb2b7d04-804b-4859-9876-7b44ac1d99a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:27.280452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127e702-eb05-47d8-948c-cf1c94d2076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:27.285237 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127e702-eb05-47d8-948c-cf1c94d2076e admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:27.285526 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127e702-eb05-47d8-948c-cf1c94d2076e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:27.285963 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127e702-eb05-47d8-948c-cf1c94d2076e admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:27.286986 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127e702-eb05-47d8-948c-cf1c94d2076e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:27.288465 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 913/1839] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:27.290524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b7d04-804b-4859-9876-7b44ac1d99a2 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:27.292323 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-bb2b7d04-804b-4859-9876-7b44ac1d99a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:27.293648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127e702-eb05-47d8-948c-cf1c94d2076e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:27.320553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 927/1840] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:27 2021] POST /identity/v3/users => generated 307 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:27.326046 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970392a-9ece-4cfd-bb10-fa74e3f02f34 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:27.326663 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970392a-9ece-4cfd-bb10-fa74e3f02f34 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:27.327669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970392a-9ece-4cfd-bb10-fa74e3f02f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:27.391804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b7d04-804b-4859-9876-7b44ac1d99a2 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:27.405112 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec03cff-65d3-4e1c-a923-8bc87e181441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:27.406242 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec03cff-65d3-4e1c-a923-8bc87e181441 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:27.406242 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec03cff-65d3-4e1c-a923-8bc87e181441 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:27.406453 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec03cff-65d3-4e1c-a923-8bc87e181441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:27.446949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a970392a-9ece-4cfd-bb10-fa74e3f02f34 None None] MFA Rules not processed for user `cbe15db6a6204883ae355d112bb833ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:27.448178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a970392a-9ece-4cfd-bb10-fa74e3f02f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:27.523580 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec03cff-65d3-4e1c-a923-8bc87e181441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:27.528353 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec03cff-65d3-4e1c-a923-8bc87e181441 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:27.560402 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 914/1841] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:27 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:27.561246 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec03cff-65d3-4e1c-a923-8bc87e181441 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:27.601675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec03cff-65d3-4e1c-a923-8bc87e181441 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:27.618004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead791a-7e23-4afa-a792-9034edaff0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:27.624391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead791a-7e23-4afa-a792-9034edaff0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:27.626472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead791a-7e23-4afa-a792-9034edaff0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:27.626835 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead791a-7e23-4afa-a792-9034edaff0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:27.628591 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead791a-7e23-4afa-a792-9034edaff0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:27.635383 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 928/1842] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:27 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:27.635589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead791a-7e23-4afa-a792-9034edaff0f4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:27.636238 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970392a-9ece-4cfd-bb10-fa74e3f02f34 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:27.667179 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970392a-9ece-4cfd-bb10-fa74e3f02f34 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:27.673458 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 915/1843] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:27 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:27.677743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead791a-7e23-4afa-a792-9034edaff0f4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:27.682451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87849324-e74d-4575-858e-ebb8651d5e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:27.682640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0ead791a-7e23-4afa-a792-9034edaff0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:27.683130 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849324-e74d-4575-858e-ebb8651d5e34 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:27.683414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849324-e74d-4575-858e-ebb8651d5e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:27.683694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849324-e74d-4575-858e-ebb8651d5e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:27.715847 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87849324-e74d-4575-858e-ebb8651d5e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:27.718115 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead791a-7e23-4afa-a792-9034edaff0f4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:27.721796 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87849324-e74d-4575-858e-ebb8651d5e34 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:27.738390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d502f6-6784-427c-a966-7c634d760b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:27.740482 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d502f6-6784-427c-a966-7c634d760b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:27.741001 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d502f6-6784-427c-a966-7c634d760b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:27.741751 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d502f6-6784-427c-a966-7c634d760b17 admin admin] PATH_INFO: `/v3/users/2e3d941ceb0741f5912f6783c65fde97` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:27.746082 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d502f6-6784-427c-a966-7c634d760b17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e3d941ceb0741f5912f6783c65fde97)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:27.749859 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 929/1844] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:27.750888 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87849324-e74d-4575-858e-ebb8651d5e34 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:27.752540 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-87849324-e74d-4575-858e-ebb8651d5e34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:27.752670 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d502f6-6784-427c-a966-7c634d760b17 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:27.772727 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87849324-e74d-4575-858e-ebb8651d5e34 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:27.779565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e80bd-371e-49c1-bb9f-0a10f8d201bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:27.780453 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e80bd-371e-49c1-bb9f-0a10f8d201bf admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:27.780954 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e80bd-371e-49c1-bb9f-0a10f8d201bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:27.781376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e80bd-371e-49c1-bb9f-0a10f8d201bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:27.782327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e80bd-371e-49c1-bb9f-0a10f8d201bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:27.784788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e80bd-371e-49c1-bb9f-0a10f8d201bf admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:27.842439 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-27d502f6-6784-427c-a966-7c634d760b17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e3d941ceb0741f5912f6783c65fde97'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:27.844442 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 930/1845] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:27 2021] POST /identity/v3/projects => generated 405 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:27.845116 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e80bd-371e-49c1-bb9f-0a10f8d201bf admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:27.867403 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-27d502f6-6784-427c-a966-7c634d760b17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e3d941ceb0741f5912f6783c65fde97'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:27.881660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-27d502f6-6784-427c-a966-7c634d760b17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e3d941ceb0741f5912f6783c65fde97'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:27.901194 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-27d502f6-6784-427c-a966-7c634d760b17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e3d941ceb0741f5912f6783c65fde97'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:27.903170 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-27d502f6-6784-427c-a966-7c634d760b17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e3d941ceb0741f5912f6783c65fde97'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:27.921055 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 916/1846] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:27 2021] DELETE /identity/v3/users/2e3d941ceb0741f5912f6783c65fde97 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:27.922259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d502f6-6784-427c-a966-7c634d760b17 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:27.925799 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-27d502f6-6784-427c-a966-7c634d760b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:27.937308 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e80bd-371e-49c1-bb9f-0a10f8d201bf admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:28.026818 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf3bcc-7218-450c-bdef-d67b4656054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:28.027728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf3bcc-7218-450c-bdef-d67b4656054d admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:28.028008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf3bcc-7218-450c-bdef-d67b4656054d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:28.028554 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf3bcc-7218-450c-bdef-d67b4656054d admin admin] PATH_INFO: `/v3/projects/de287784b14b48899e5a470b6996c38f/users/6f77e514c5cb4bc3af7ce845ba598432/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:28.034339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d502f6-6784-427c-a966-7c634d760b17 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:28.041527 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf46551-5613-4731-8780-be091b140652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:28.042573 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf46551-5613-4731-8780-be091b140652 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:28.043254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf46551-5613-4731-8780-be091b140652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:28.043483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf46551-5613-4731-8780-be091b140652 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:28.045079 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf46551-5613-4731-8780-be091b140652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:28.047907 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf46551-5613-4731-8780-be091b140652 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:28.050284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf3bcc-7218-450c-bdef-d67b4656054d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de287784b14b48899e5a470b6996c38f, user_id=6f77e514c5cb4bc3af7ce845ba598432, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:28.053903 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf3bcc-7218-450c-bdef-d67b4656054d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:28.088844 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 931/1847] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:27 2021] PUT /identity/v3/projects/de287784b14b48899e5a470b6996c38f/users/6f77e514c5cb4bc3af7ce845ba598432/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:28.090374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14487e-a802-495f-8384-810da0a34a56 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:28.090695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14487e-a802-495f-8384-810da0a34a56 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:28.091068 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14487e-a802-495f-8384-810da0a34a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:28.093475 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 917/1848] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:27 2021] POST /identity/v3/users => generated 309 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:28.094854 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf46551-5613-4731-8780-be091b140652 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:28.096749 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-ddf46551-5613-4731-8780-be091b140652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:28.109898 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf46551-5613-4731-8780-be091b140652 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:28.125691 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-4a14487e-a802-495f-8384-810da0a34a56 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:28.127820 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4a14487e-a802-495f-8384-810da0a34a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:28.213512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 932/1849] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:28.214512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14487e-a802-495f-8384-810da0a34a56 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:28.227093 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14487e-a802-495f-8384-810da0a34a56 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:28.229185 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9565c3-e90b-4f13-bac7-406ceb4358d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:28.230861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9565c3-e90b-4f13-bac7-406ceb4358d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:28.232015 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f53e33-07fb-4714-a72e-9a88838bf66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:28.233022 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9565c3-e90b-4f13-bac7-406ceb4358d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:28.233347 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9565c3-e90b-4f13-bac7-406ceb4358d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:28.233459 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f53e33-07fb-4714-a72e-9a88838bf66b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:28.233658 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f53e33-07fb-4714-a72e-9a88838bf66b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:28.233945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f53e33-07fb-4714-a72e-9a88838bf66b admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:28.234189 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9565c3-e90b-4f13-bac7-406ceb4358d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:28.234980 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f53e33-07fb-4714-a72e-9a88838bf66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:28.236165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9565c3-e90b-4f13-bac7-406ceb4358d4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:28.236570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f53e33-07fb-4714-a72e-9a88838bf66b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:28.250418 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 933/1850] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:28 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:28.254114 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f53e33-07fb-4714-a72e-9a88838bf66b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:28.267297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 918/1851] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:28 2021] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:28.268088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f53e33-07fb-4714-a72e-9a88838bf66b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:28.268411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9565c3-e90b-4f13-bac7-406ceb4358d4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:28.270710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0b9565c3-e90b-4f13-bac7-406ceb4358d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:28.276196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108ad5c-4b6e-40b0-b3f2-7459b5591e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:28.278076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108ad5c-4b6e-40b0-b3f2-7459b5591e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:28.278605 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108ad5c-4b6e-40b0-b3f2-7459b5591e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:28.279276 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108ad5c-4b6e-40b0-b3f2-7459b5591e58 admin admin] PATH_INFO: `/v3/projects/d7f62b5ae10a441c82123d5f72a92a3a/users/ee271ac8ccb6486c93a227dbb2c731cc/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:28.301974 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108ad5c-4b6e-40b0-b3f2-7459b5591e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f62b5ae10a441c82123d5f72a92a3a, user_id=ee271ac8ccb6486c93a227dbb2c731cc, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:28.305772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108ad5c-4b6e-40b0-b3f2-7459b5591e58 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:28.325165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 934/1852] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:28 2021] PUT /identity/v3/projects/d7f62b5ae10a441c82123d5f72a92a3a/users/ee271ac8ccb6486c93a227dbb2c731cc/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:28.326523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108ad5c-4b6e-40b0-b3f2-7459b5591e58 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:28.395963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9565c3-e90b-4f13-bac7-406ceb4358d4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:28.434936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108ad5c-4b6e-40b0-b3f2-7459b5591e58 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:28.445207 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947efc44-4d4c-4e0e-9753-62b07a479b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:28.446584 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947efc44-4d4c-4e0e-9753-62b07a479b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:28.447842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947efc44-4d4c-4e0e-9753-62b07a479b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:28.448760 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947efc44-4d4c-4e0e-9753-62b07a479b0d admin admin] PATH_INFO: `/v3/projects/de287784b14b48899e5a470b6996c38f/users/6f77e514c5cb4bc3af7ce845ba598432/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:28.451182 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947efc44-4d4c-4e0e-9753-62b07a479b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de287784b14b48899e5a470b6996c38f, user_id=6f77e514c5cb4bc3af7ce845ba598432, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:28.458254 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947efc44-4d4c-4e0e-9753-62b07a479b0d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:28.470959 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff3ba1-e855-446c-a979-23078bb294a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:28.472201 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff3ba1-e855-446c-a979-23078bb294a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:28.472495 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff3ba1-e855-446c-a979-23078bb294a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:28.472774 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff3ba1-e855-446c-a979-23078bb294a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:28.474507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 935/1853] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:28 2021] PUT /identity/v3/projects/de287784b14b48899e5a470b6996c38f/users/6f77e514c5cb4bc3af7ce845ba598432/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:28.475559 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947efc44-4d4c-4e0e-9753-62b07a479b0d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:28.501121 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff3ba1-e855-446c-a979-23078bb294a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:28.502921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff3ba1-e855-446c-a979-23078bb294a6 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:28.519469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 919/1854] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:28.520934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03449a-9f3c-4ae2-ad91-7f996583c26e None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:28.521228 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03449a-9f3c-4ae2-ad91-7f996583c26e None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:28.521506 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03449a-9f3c-4ae2-ad91-7f996583c26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:28.562548 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-5a03449a-9f3c-4ae2-ad91-7f996583c26e None None] MFA Rules not processed for user `6f77e514c5cb4bc3af7ce845ba598432`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:28.563879 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-5a03449a-9f3c-4ae2-ad91-7f996583c26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:28.596648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947efc44-4d4c-4e0e-9753-62b07a479b0d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:28.611440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b714c86-0b49-4b97-961a-1f2d7c59ab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:28.613686 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b714c86-0b49-4b97-961a-1f2d7c59ab7b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:28.614677 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b714c86-0b49-4b97-961a-1f2d7c59ab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:28.616330 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b714c86-0b49-4b97-961a-1f2d7c59ab7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:28.617750 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b714c86-0b49-4b97-961a-1f2d7c59ab7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:28.619831 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b714c86-0b49-4b97-961a-1f2d7c59ab7b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:28.646757 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 936/1855] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:28 2021] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:28.652228 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b714c86-0b49-4b97-961a-1f2d7c59ab7b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:28.664134 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 920/1856] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:28 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:28.671295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b714c86-0b49-4b97-961a-1f2d7c59ab7b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:28.672868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03449a-9f3c-4ae2-ad91-7f996583c26e None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:28.674389 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-5a03449a-9f3c-4ae2-ad91-7f996583c26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:28.689117 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d46ed7-02d3-44b0-81b9-b66171021ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:28.692061 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d46ed7-02d3-44b0-81b9-b66171021ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:28.692842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d46ed7-02d3-44b0-81b9-b66171021ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:28.693348 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d46ed7-02d3-44b0-81b9-b66171021ff9 admin admin] PATH_INFO: `/v3/projects/d7f62b5ae10a441c82123d5f72a92a3a/users/ee271ac8ccb6486c93a227dbb2c731cc/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:28.698692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d46ed7-02d3-44b0-81b9-b66171021ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f62b5ae10a441c82123d5f72a92a3a, user_id=ee271ac8ccb6486c93a227dbb2c731cc, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:28.705339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d46ed7-02d3-44b0-81b9-b66171021ff9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:28.741768 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 937/1857] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:28 2021] PUT /identity/v3/projects/d7f62b5ae10a441c82123d5f72a92a3a/users/ee271ac8ccb6486c93a227dbb2c731cc/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:28.766834 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03449a-9f3c-4ae2-ad91-7f996583c26e None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:28.851800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc5e6d-d9fd-4b59-987f-1f8e55f0195e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:28.853183 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc5e6d-d9fd-4b59-987f-1f8e55f0195e service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:28.853822 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc5e6d-d9fd-4b59-987f-1f8e55f0195e service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:28.854342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc5e6d-d9fd-4b59-987f-1f8e55f0195e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:28.997416 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc5e6d-d9fd-4b59-987f-1f8e55f0195e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:28.999653 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc5e6d-d9fd-4b59-987f-1f8e55f0195e service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:29.010751 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 921/1858] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:28 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:03:29.030355 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d46ed7-02d3-44b0-81b9-b66171021ff9 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:29.032267 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-89d46ed7-02d3-44b0-81b9-b66171021ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:29.136034 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc5e6d-d9fd-4b59-987f-1f8e55f0195e service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:29.145578 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc5e6d-d9fd-4b59-987f-1f8e55f0195e service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:29.150339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956b711-36b6-4ee5-ae51-37478f3b58ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:29.151106 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b711-36b6-4ee5-ae51-37478f3b58ac service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:29.151492 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b711-36b6-4ee5-ae51-37478f3b58ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:29.152017 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b711-36b6-4ee5-ae51-37478f3b58ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:29.154747 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c956b711-36b6-4ee5-ae51-37478f3b58ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:29.169202 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d46ed7-02d3-44b0-81b9-b66171021ff9 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:29.178059 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589dc50-ffc8-495a-9479-79f24beb393b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:29.179031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589dc50-ffc8-495a-9479-79f24beb393b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:29.179314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589dc50-ffc8-495a-9479-79f24beb393b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:29.179587 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589dc50-ffc8-495a-9479-79f24beb393b admin admin] PATH_INFO: `/v3/projects/6b63ee34087f457ba5c48899aec4a880` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:29.180905 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589dc50-ffc8-495a-9479-79f24beb393b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b63ee34087f457ba5c48899aec4a880)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:29.183817 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589dc50-ffc8-495a-9479-79f24beb393b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:29.239387 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956b711-36b6-4ee5-ae51-37478f3b58ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:29.241266 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956b711-36b6-4ee5-ae51-37478f3b58ac service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:29.255489 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-0589dc50-ffc8-495a-9479-79f24beb393b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b63ee34087f457ba5c48899aec4a880', 'request_id': 'req-0589dc50-ffc8-495a-9479-79f24beb393b'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:29.264025 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 922/1859] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:29 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:03:29.267041 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-0589dc50-ffc8-495a-9479-79f24beb393b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b63ee34087f457ba5c48899aec4a880', 'request_id': 'req-0589dc50-ffc8-495a-9479-79f24beb393b'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:29.267187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87fbf0-f7e0-4c0f-98f7-570c5a290a61 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:29.267187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87fbf0-f7e0-4c0f-98f7-570c5a290a61 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:29.267454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87fbf0-f7e0-4c0f-98f7-570c5a290a61 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:29.269208 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 923/1860] 10.222.0.18 () {54 vars in 921 bytes} [Wed Dec 15 03:03:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:03:29.275830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-0589dc50-ffc8-495a-9479-79f24beb393b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b63ee34087f457ba5c48899aec4a880', 'request_id': 'req-0589dc50-ffc8-495a-9479-79f24beb393b'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:29.287927 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c3144-de9a-4287-a0a7-1df558fd396b None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:29.288211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c3144-de9a-4287-a0a7-1df558fd396b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:29.288408 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c3144-de9a-4287-a0a7-1df558fd396b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:29.289200 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-0589dc50-ffc8-495a-9479-79f24beb393b admin admin] The token cache is being invalidate because project 6b63ee34087f457ba5c48899aec4a880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:29.289593 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-0589dc50-ffc8-495a-9479-79f24beb393b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:29.290435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-0589dc50-ffc8-495a-9479-79f24beb393b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:29.293179 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 938/1861] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:29 2021] DELETE /identity/v3/projects/6b63ee34087f457ba5c48899aec4a880 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:29.298008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589dc50-ffc8-495a-9479-79f24beb393b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:29.299771 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-0589dc50-ffc8-495a-9479-79f24beb393b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:29.319804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-3d7c3144-de9a-4287-a0a7-1df558fd396b None None] MFA Rules not processed for user `fcd50adcd390465ea6fc8582e1524909`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:29.322573 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-3d7c3144-de9a-4287-a0a7-1df558fd396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:29.446420 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589dc50-ffc8-495a-9479-79f24beb393b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:29.465524 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13969139-d5a5-4a78-b7ee-7eca24817d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:29.466497 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13969139-d5a5-4a78-b7ee-7eca24817d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:29.466780 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13969139-d5a5-4a78-b7ee-7eca24817d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:29.467051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13969139-d5a5-4a78-b7ee-7eca24817d8a admin admin] PATH_INFO: `/v3/users/0fc59617076e479baef35f6e57ece32f` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:29.469482 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13969139-d5a5-4a78-b7ee-7eca24817d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fc59617076e479baef35f6e57ece32f)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:29.471586 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13969139-d5a5-4a78-b7ee-7eca24817d8a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:29.487903 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 924/1862] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Dec 15 03:03:29 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:29.491305 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f318f9-79e2-483a-b3ce-2db090e294da None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:29.491305 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f318f9-79e2-483a-b3ce-2db090e294da None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:29.491538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f318f9-79e2-483a-b3ce-2db090e294da None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:29.498179 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 925/1863] 10.222.0.18 () {54 vars in 921 bytes} [Wed Dec 15 03:03:29 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:03:29.519882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b10260-a792-4292-99be-6a8195be0fd3 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:29.520172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b10260-a792-4292-99be-6a8195be0fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:29.520361 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b10260-a792-4292-99be-6a8195be0fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:29.550834 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-16b10260-a792-4292-99be-6a8195be0fd3 None None] MFA Rules not processed for user `fcd50adcd390465ea6fc8582e1524909`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:29.552900 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-16b10260-a792-4292-99be-6a8195be0fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:29.569962 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 926/1864] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Dec 15 03:03:29 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:03:29.584597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-13969139-d5a5-4a78-b7ee-7eca24817d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fc59617076e479baef35f6e57ece32f'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:29.586181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b10260-a792-4292-99be-6a8195be0fd3 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:29.589669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-16b10260-a792-4292-99be-6a8195be0fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:29.630827 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-13969139-d5a5-4a78-b7ee-7eca24817d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fc59617076e479baef35f6e57ece32f'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:29.637921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b10260-a792-4292-99be-6a8195be0fd3 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:29.658087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-13969139-d5a5-4a78-b7ee-7eca24817d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fc59617076e479baef35f6e57ece32f'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:29.659835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-13969139-d5a5-4a78-b7ee-7eca24817d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fc59617076e479baef35f6e57ece32f'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:29.661459 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-13969139-d5a5-4a78-b7ee-7eca24817d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fc59617076e479baef35f6e57ece32f'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:29.668798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd678760-0f13-45f1-815a-5793b877a608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:29.670866 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd678760-0f13-45f1-815a-5793b877a608 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:29.671823 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd678760-0f13-45f1-815a-5793b877a608 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:29.672024 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd678760-0f13-45f1-815a-5793b877a608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:29.679996 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-dd678760-0f13-45f1-815a-5793b877a608 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:29.684947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 939/1865] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:29 2021] DELETE /identity/v3/users/0fc59617076e479baef35f6e57ece32f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:29.710810 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd678760-0f13-45f1-815a-5793b877a608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:29.712424 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd678760-0f13-45f1-815a-5793b877a608 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:29.725541 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 927/1866] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:29.854400 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13969139-d5a5-4a78-b7ee-7eca24817d8a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:29.856646 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-13969139-d5a5-4a78-b7ee-7eca24817d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:29.945218 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13969139-d5a5-4a78-b7ee-7eca24817d8a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:29.953646 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc17809-6dae-46b8-ad55-3d2abd4aeb11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:29.953870 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc17809-6dae-46b8-ad55-3d2abd4aeb11 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:29.954096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc17809-6dae-46b8-ad55-3d2abd4aeb11 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:29.954475 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc17809-6dae-46b8-ad55-3d2abd4aeb11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:29.956777 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5fc17809-6dae-46b8-ad55-3d2abd4aeb11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:29.972602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc17809-6dae-46b8-ad55-3d2abd4aeb11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:29.974671 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc17809-6dae-46b8-ad55-3d2abd4aeb11 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:30.005652 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 940/1867] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:30.084704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd678760-0f13-45f1-815a-5793b877a608 service nova] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:30.086264 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-dd678760-0f13-45f1-815a-5793b877a608 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:30.106805 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd678760-0f13-45f1-815a-5793b877a608 service nova] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:30.187372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065ddcd-69ba-4146-9b9c-bed32c665eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:30.188531 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065ddcd-69ba-4146-9b9c-bed32c665eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:30.188959 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065ddcd-69ba-4146-9b9c-bed32c665eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:30.189425 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065ddcd-69ba-4146-9b9c-bed32c665eff admin admin] PATH_INFO: `/v3/projects/57f9e7823c6f44589ec92c3f44a3322e` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:30.190777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065ddcd-69ba-4146-9b9c-bed32c665eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f9e7823c6f44589ec92c3f44a3322e)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:30.192974 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065ddcd-69ba-4146-9b9c-bed32c665eff admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:30.258022 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7065ddcd-69ba-4146-9b9c-bed32c665eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f9e7823c6f44589ec92c3f44a3322e', 'request_id': 'req-7065ddcd-69ba-4146-9b9c-bed32c665eff'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:30.271400 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7065ddcd-69ba-4146-9b9c-bed32c665eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f9e7823c6f44589ec92c3f44a3322e', 'request_id': 'req-7065ddcd-69ba-4146-9b9c-bed32c665eff'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:30.278898 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7065ddcd-69ba-4146-9b9c-bed32c665eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f9e7823c6f44589ec92c3f44a3322e', 'request_id': 'req-7065ddcd-69ba-4146-9b9c-bed32c665eff'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:30.298362 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7065ddcd-69ba-4146-9b9c-bed32c665eff admin admin] The token cache is being invalidate because project 57f9e7823c6f44589ec92c3f44a3322e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:30.298959 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7065ddcd-69ba-4146-9b9c-bed32c665eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:30.299714 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7065ddcd-69ba-4146-9b9c-bed32c665eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:30.301795 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 928/1868] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:30 2021] DELETE /identity/v3/projects/57f9e7823c6f44589ec92c3f44a3322e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:30.307876 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431f8c3-a6f2-4e26-a16c-7ccd37c5e598 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:30.309114 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431f8c3-a6f2-4e26-a16c-7ccd37c5e598 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:30.309114 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431f8c3-a6f2-4e26-a16c-7ccd37c5e598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:30.331741 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-6431f8c3-a6f2-4e26-a16c-7ccd37c5e598 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:30.333293 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6431f8c3-a6f2-4e26-a16c-7ccd37c5e598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:30.432723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 941/1869] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:30.443404 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e624d4-4b03-4329-bef7-192e0db90c23 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:30.443843 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e624d4-4b03-4329-bef7-192e0db90c23 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:30.444211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e624d4-4b03-4329-bef7-192e0db90c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:30.468264 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-35e624d4-4b03-4329-bef7-192e0db90c23 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:30.469574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-35e624d4-4b03-4329-bef7-192e0db90c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:30.477618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 929/1870] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:30.481794 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431f8c3-a6f2-4e26-a16c-7ccd37c5e598 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:30.497253 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431f8c3-a6f2-4e26-a16c-7ccd37c5e598 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:30.504086 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35125fb-022f-47a2-b887-e14412e39f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:30.504862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35125fb-022f-47a2-b887-e14412e39f26 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:30.505182 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35125fb-022f-47a2-b887-e14412e39f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:30.505459 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35125fb-022f-47a2-b887-e14412e39f26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:30.506455 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35125fb-022f-47a2-b887-e14412e39f26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:30.506856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35125fb-022f-47a2-b887-e14412e39f26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:30.508569 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35125fb-022f-47a2-b887-e14412e39f26 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:30.528617 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 942/1871] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:30.530563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e624d4-4b03-4329-bef7-192e0db90c23 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:30.541700 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e624d4-4b03-4329-bef7-192e0db90c23 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:30.548397 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c845c7-c3db-45e3-995c-db4a495681eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:30.549141 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c845c7-c3db-45e3-995c-db4a495681eb admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:30.549696 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c845c7-c3db-45e3-995c-db4a495681eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:30.549779 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c845c7-c3db-45e3-995c-db4a495681eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:30.550585 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c845c7-c3db-45e3-995c-db4a495681eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:30.552631 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c845c7-c3db-45e3-995c-db4a495681eb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:30.599650 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35125fb-022f-47a2-b887-e14412e39f26 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:30.600410 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 930/1872] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:30 2021] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:30.612155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35125fb-022f-47a2-b887-e14412e39f26 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:30.707416 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfcd02-a0b8-4b22-87de-6ed62f532308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:30.708500 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfcd02-a0b8-4b22-87de-6ed62f532308 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:30.708971 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfcd02-a0b8-4b22-87de-6ed62f532308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:30.709418 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfcd02-a0b8-4b22-87de-6ed62f532308 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:30.710395 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfcd02-a0b8-4b22-87de-6ed62f532308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:30.712698 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfcd02-a0b8-4b22-87de-6ed62f532308 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:30.760542 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 943/1873] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:30 2021] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:03:30.761900 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c845c7-c3db-45e3-995c-db4a495681eb admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:30.775317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c845c7-c3db-45e3-995c-db4a495681eb admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:30.790409 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156eebb0-1d79-4970-8e11-cb1bcf34d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:30.791396 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156eebb0-1d79-4970-8e11-cb1bcf34d19d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:30.792024 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156eebb0-1d79-4970-8e11-cb1bcf34d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:30.793168 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156eebb0-1d79-4970-8e11-cb1bcf34d19d admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:30.794247 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156eebb0-1d79-4970-8e11-cb1bcf34d19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:30.798808 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156eebb0-1d79-4970-8e11-cb1bcf34d19d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:30.838876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 931/1874] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:30 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:30.840675 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfcd02-a0b8-4b22-87de-6ed62f532308 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:30.859727 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfcd02-a0b8-4b22-87de-6ed62f532308 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:30.871782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfcd83-9bc0-4fc9-9fd2-acff4184d19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:30.873194 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfcd83-9bc0-4fc9-9fd2-acff4184d19a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:30.873620 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfcd83-9bc0-4fc9-9fd2-acff4184d19a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:30.874096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfcd83-9bc0-4fc9-9fd2-acff4184d19a admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:30.875200 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfcd83-9bc0-4fc9-9fd2-acff4184d19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:30.876995 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfcd83-9bc0-4fc9-9fd2-acff4184d19a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:30.904286 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 944/1875] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:30 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:03:30.905333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156eebb0-1d79-4970-8e11-cb1bcf34d19d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:30.922024 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156eebb0-1d79-4970-8e11-cb1bcf34d19d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:30.931633 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa70441-e90e-486a-be32-e085981d433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:30.932617 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa70441-e90e-486a-be32-e085981d433d admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:30.932901 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa70441-e90e-486a-be32-e085981d433d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:30.933177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa70441-e90e-486a-be32-e085981d433d admin admin] PATH_INFO: `/v3/projects/7341f37fb50e44c497aa8049ad85662a/users/bd9b083428ce46c496c85bd4e15dd463/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:30.959730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa70441-e90e-486a-be32-e085981d433d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7341f37fb50e44c497aa8049ad85662a, user_id=bd9b083428ce46c496c85bd4e15dd463, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:30.962643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa70441-e90e-486a-be32-e085981d433d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:30.981375 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 932/1876] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:30 2021] PUT /identity/v3/projects/7341f37fb50e44c497aa8049ad85662a/users/bd9b083428ce46c496c85bd4e15dd463/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:30.992788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c5199-4b8e-4529-8e53-bfa5b4e40805 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:30.993081 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c5199-4b8e-4529-8e53-bfa5b4e40805 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:30.993457 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c5199-4b8e-4529-8e53-bfa5b4e40805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:31.028621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-b06c5199-4b8e-4529-8e53-bfa5b4e40805 None None] MFA Rules not processed for user `bd9b083428ce46c496c85bd4e15dd463`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:31.029936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b06c5199-4b8e-4529-8e53-bfa5b4e40805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:31.150583 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 945/1877] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:30 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:31.167842 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa70441-e90e-486a-be32-e085981d433d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:31.170786 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-cfa70441-e90e-486a-be32-e085981d433d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:31.181370 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c5199-4b8e-4529-8e53-bfa5b4e40805 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:31.182968 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b06c5199-4b8e-4529-8e53-bfa5b4e40805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:31.314851 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa70441-e90e-486a-be32-e085981d433d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:31.326890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b34e0-7b10-4ebf-bafb-ebb9a2181b06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:31.327872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b34e0-7b10-4ebf-bafb-ebb9a2181b06 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:31.328120 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b34e0-7b10-4ebf-bafb-ebb9a2181b06 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:31.328409 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b34e0-7b10-4ebf-bafb-ebb9a2181b06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:31.336707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c5199-4b8e-4529-8e53-bfa5b4e40805 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:31.350865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b500d-64dc-48c4-bf6a-93ff18592dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:31.351748 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b500d-64dc-48c4-bf6a-93ff18592dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:31.352035 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b500d-64dc-48c4-bf6a-93ff18592dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:31.352432 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b500d-64dc-48c4-bf6a-93ff18592dba admin admin] PATH_INFO: `/v3/projects/b8127956f49d4a8184abc658de59ebbc` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:31.359629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b500d-64dc-48c4-bf6a-93ff18592dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8127956f49d4a8184abc658de59ebbc)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:31.361595 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b500d-64dc-48c4-bf6a-93ff18592dba admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:31.363691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b34e0-7b10-4ebf-bafb-ebb9a2181b06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:31.368125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b34e0-7b10-4ebf-bafb-ebb9a2181b06 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:31.392231 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 933/1878] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:31 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:31.484638 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3f0b500d-64dc-48c4-bf6a-93ff18592dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8127956f49d4a8184abc658de59ebbc', 'request_id': 'req-3f0b500d-64dc-48c4-bf6a-93ff18592dba'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:31.501781 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3f0b500d-64dc-48c4-bf6a-93ff18592dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8127956f49d4a8184abc658de59ebbc', 'request_id': 'req-3f0b500d-64dc-48c4-bf6a-93ff18592dba'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:31.519156 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3f0b500d-64dc-48c4-bf6a-93ff18592dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8127956f49d4a8184abc658de59ebbc', 'request_id': 'req-3f0b500d-64dc-48c4-bf6a-93ff18592dba'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:31.540461 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3f0b500d-64dc-48c4-bf6a-93ff18592dba admin admin] The token cache is being invalidate because project b8127956f49d4a8184abc658de59ebbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:31.540869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3f0b500d-64dc-48c4-bf6a-93ff18592dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:31.542359 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3f0b500d-64dc-48c4-bf6a-93ff18592dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:31.550220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 946/1879] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:31 2021] DELETE /identity/v3/projects/b8127956f49d4a8184abc658de59ebbc => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:31.552581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ae6fe-2b71-41a2-a191-b4c5fc306039 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:31.553066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ae6fe-2b71-41a2-a191-b4c5fc306039 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:31.553697 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ae6fe-2b71-41a2-a191-b4c5fc306039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:31.581437 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-858ae6fe-2b71-41a2-a191-b4c5fc306039 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:31.583163 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-858ae6fe-2b71-41a2-a191-b4c5fc306039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:31.689316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feeb02-00b7-4a54-91b4-dc68ad286148 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:31.689953 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feeb02-00b7-4a54-91b4-dc68ad286148 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:31.690263 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feeb02-00b7-4a54-91b4-dc68ad286148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:31.699257 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 934/1880] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:31.715878 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-f1feeb02-00b7-4a54-91b4-dc68ad286148 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:31.719702 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f1feeb02-00b7-4a54-91b4-dc68ad286148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:31.727211 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 947/1881] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:31.731988 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ae6fe-2b71-41a2-a191-b4c5fc306039 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:31.746797 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ae6fe-2b71-41a2-a191-b4c5fc306039 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:31.752763 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db99731-214a-48ec-ba6a-c92d91f63c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:31.753427 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db99731-214a-48ec-ba6a-c92d91f63c28 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:31.753712 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db99731-214a-48ec-ba6a-c92d91f63c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:31.754001 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db99731-214a-48ec-ba6a-c92d91f63c28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:31.755604 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db99731-214a-48ec-ba6a-c92d91f63c28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:31.755944 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db99731-214a-48ec-ba6a-c92d91f63c28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:31.757554 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db99731-214a-48ec-ba6a-c92d91f63c28 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:31.793742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1feeb02-00b7-4a54-91b4-dc68ad286148 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:31.806157 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 935/1882] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:31.807006 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1feeb02-00b7-4a54-91b4-dc68ad286148 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:31.813458 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4d2cb-be81-4a44-b727-570427686da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:31.814612 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4d2cb-be81-4a44-b727-570427686da2 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:31.815083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4d2cb-be81-4a44-b727-570427686da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:31.815597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4d2cb-be81-4a44-b727-570427686da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:31.816611 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4d2cb-be81-4a44-b727-570427686da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:31.820357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4d2cb-be81-4a44-b727-570427686da2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:31.886141 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db99731-214a-48ec-ba6a-c92d91f63c28 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:31.906283 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 948/1883] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:31 2021] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:31.912621 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db99731-214a-48ec-ba6a-c92d91f63c28 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:32.074542 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616ddfd-4ab9-47e5-8011-b4653e10d53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:32.075225 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616ddfd-4ab9-47e5-8011-b4653e10d53f admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:32.075500 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616ddfd-4ab9-47e5-8011-b4653e10d53f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:32.076309 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616ddfd-4ab9-47e5-8011-b4653e10d53f admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:32.079988 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616ddfd-4ab9-47e5-8011-b4653e10d53f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:32.081885 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616ddfd-4ab9-47e5-8011-b4653e10d53f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:32.123793 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4d2cb-be81-4a44-b727-570427686da2 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:32.140754 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4d2cb-be81-4a44-b727-570427686da2 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:32.141886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 936/1884] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:31 2021] POST /identity/v3/users => generated 290 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:32.148507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfbc82-a7e5-4e83-b8a9-14769ca83c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:32.149345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfbc82-a7e5-4e83-b8a9-14769ca83c71 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:32.149644 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfbc82-a7e5-4e83-b8a9-14769ca83c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:32.150452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfbc82-a7e5-4e83-b8a9-14769ca83c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:32.151685 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfbc82-a7e5-4e83-b8a9-14769ca83c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:32.154624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfbc82-a7e5-4e83-b8a9-14769ca83c71 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:32.166786 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 949/1885] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:32 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:32.171370 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616ddfd-4ab9-47e5-8011-b4653e10d53f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:32.186997 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616ddfd-4ab9-47e5-8011-b4653e10d53f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:32.206599 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75428be-7f4c-49e7-8a24-6f11647ac57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:32.208654 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75428be-7f4c-49e7-8a24-6f11647ac57a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:32.209117 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75428be-7f4c-49e7-8a24-6f11647ac57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:32.209553 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75428be-7f4c-49e7-8a24-6f11647ac57a admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:32.213264 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75428be-7f4c-49e7-8a24-6f11647ac57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:32.216576 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75428be-7f4c-49e7-8a24-6f11647ac57a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:32.231267 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 937/1886] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:32 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:32.235351 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfbc82-a7e5-4e83-b8a9-14769ca83c71 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:32.249090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfbc82-a7e5-4e83-b8a9-14769ca83c71 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:32.255808 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9494d-53e4-45ee-a4b1-f868d6802aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:32.256938 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9494d-53e4-45ee-a4b1-f868d6802aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:32.257214 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9494d-53e4-45ee-a4b1-f868d6802aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:32.257598 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9494d-53e4-45ee-a4b1-f868d6802aaf admin admin] PATH_INFO: `/v3/projects/1d070a99708e497892ea51f3961f4ef1/users/230aaceaf2b740a5914c47a157cfa1f4/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:32.274529 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9494d-53e4-45ee-a4b1-f868d6802aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d070a99708e497892ea51f3961f4ef1, user_id=230aaceaf2b740a5914c47a157cfa1f4, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:32.278333 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9494d-53e4-45ee-a4b1-f868d6802aaf admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:32.313356 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 950/1887] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:32 2021] PUT /identity/v3/projects/1d070a99708e497892ea51f3961f4ef1/users/230aaceaf2b740a5914c47a157cfa1f4/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:32.315468 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16d31-3aa4-4420-a627-085a25a3c8bf None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:32.316333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16d31-3aa4-4420-a627-085a25a3c8bf None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:32.316333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16d31-3aa4-4420-a627-085a25a3c8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:32.367871 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-e5e16d31-3aa4-4420-a627-085a25a3c8bf None None] MFA Rules not processed for user `230aaceaf2b740a5914c47a157cfa1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:32.369571 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e5e16d31-3aa4-4420-a627-085a25a3c8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:32.474304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e36423-0b18-4e38-a0bf-a38f9e70eff5 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:32.474788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e36423-0b18-4e38-a0bf-a38f9e70eff5 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:32.475170 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e36423-0b18-4e38-a0bf-a38f9e70eff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:32.501081 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 938/1888] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:32 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:32.505376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e16d31-3aa4-4420-a627-085a25a3c8bf None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:32.528271 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-17e36423-0b18-4e38-a0bf-a38f9e70eff5 None None] MFA Rules not processed for user `ee271ac8ccb6486c93a227dbb2c731cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:32.530994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-17e36423-0b18-4e38-a0bf-a38f9e70eff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:32.632612 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e16d31-3aa4-4420-a627-085a25a3c8bf None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:32.641339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea131e-8be6-4713-a45d-20149d942b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:32.642338 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea131e-8be6-4713-a45d-20149d942b3e admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:32.642756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea131e-8be6-4713-a45d-20149d942b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:32.643301 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea131e-8be6-4713-a45d-20149d942b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:32.644499 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea131e-8be6-4713-a45d-20149d942b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:32.647654 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea131e-8be6-4713-a45d-20149d942b3e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:32.679525 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 951/1889] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:32 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:32.690787 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 939/1890] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:32 2021] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:32.694266 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e36423-0b18-4e38-a0bf-a38f9e70eff5 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:32.710139 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e36423-0b18-4e38-a0bf-a38f9e70eff5 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:32.817879 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a0a52-1bea-4fee-b07b-4a2f84eeed09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:32.818853 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a0a52-1bea-4fee-b07b-4a2f84eeed09 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:32.819189 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a0a52-1bea-4fee-b07b-4a2f84eeed09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:32.819470 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a0a52-1bea-4fee-b07b-4a2f84eeed09 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:32.820173 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a0a52-1bea-4fee-b07b-4a2f84eeed09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:32.822165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a0a52-1bea-4fee-b07b-4a2f84eeed09 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:32.844572 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 952/1891] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:32 2021] POST /identity/v3/users => generated 297 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:03:32.849090 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea131e-8be6-4713-a45d-20149d942b3e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:32.860919 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea131e-8be6-4713-a45d-20149d942b3e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:32.868297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf4fb9-f242-4557-9aec-ebbc6a87e855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:32.868970 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf4fb9-f242-4557-9aec-ebbc6a87e855 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:32.869254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf4fb9-f242-4557-9aec-ebbc6a87e855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:32.869530 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf4fb9-f242-4557-9aec-ebbc6a87e855 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:32.871019 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf4fb9-f242-4557-9aec-ebbc6a87e855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:32.873997 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf4fb9-f242-4557-9aec-ebbc6a87e855 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:32.890161 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 940/1892] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:32 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:32.892461 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a0a52-1bea-4fee-b07b-4a2f84eeed09 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:32.903470 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a0a52-1bea-4fee-b07b-4a2f84eeed09 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:32.911219 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a46db7-1330-4033-9fb9-747d94d69d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:32.912199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a46db7-1330-4033-9fb9-747d94d69d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:32.912659 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a46db7-1330-4033-9fb9-747d94d69d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:32.913107 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a46db7-1330-4033-9fb9-747d94d69d5c admin admin] PATH_INFO: `/v3/projects/c21514a19bb948e09477763778fabd05/users/ed0aa9507e9842a6a8aa08fd9bdc2d78/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:32.928684 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a46db7-1330-4033-9fb9-747d94d69d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21514a19bb948e09477763778fabd05, user_id=ed0aa9507e9842a6a8aa08fd9bdc2d78, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:32.932017 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a46db7-1330-4033-9fb9-747d94d69d5c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:32.954219 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 953/1893] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:32 2021] PUT /identity/v3/projects/c21514a19bb948e09477763778fabd05/users/ed0aa9507e9842a6a8aa08fd9bdc2d78/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:32.958127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf4fb9-f242-4557-9aec-ebbc6a87e855 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:32.968687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf4fb9-f242-4557-9aec-ebbc6a87e855 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:33.024235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a180c5-76f4-411b-9bf4-82b229c735da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:33.024908 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a180c5-76f4-411b-9bf4-82b229c735da admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:33.025191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a180c5-76f4-411b-9bf4-82b229c735da admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:33.025469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a180c5-76f4-411b-9bf4-82b229c735da admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:33.026233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a180c5-76f4-411b-9bf4-82b229c735da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:33.027828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a180c5-76f4-411b-9bf4-82b229c735da admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:33.038407 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 941/1894] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:32 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:03:33.042657 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a46db7-1330-4033-9fb9-747d94d69d5c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:33.053187 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a46db7-1330-4033-9fb9-747d94d69d5c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:33.057851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1764e86-b6ba-41c3-a679-bd814e6894d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:33.058781 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1764e86-b6ba-41c3-a679-bd814e6894d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:33.059062 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1764e86-b6ba-41c3-a679-bd814e6894d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:33.063202 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1764e86-b6ba-41c3-a679-bd814e6894d5 admin admin] PATH_INFO: `/v3/projects/c21514a19bb948e09477763778fabd05/users/ed0aa9507e9842a6a8aa08fd9bdc2d78/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:33.065323 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1764e86-b6ba-41c3-a679-bd814e6894d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21514a19bb948e09477763778fabd05, user_id=ed0aa9507e9842a6a8aa08fd9bdc2d78, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:33.068022 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1764e86-b6ba-41c3-a679-bd814e6894d5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:33.078764 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 954/1895] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:33 2021] PUT /identity/v3/projects/c21514a19bb948e09477763778fabd05/users/ed0aa9507e9842a6a8aa08fd9bdc2d78/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:03:33.089106 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a16ee6-7e80-436f-a809-bc688e4b573b None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:33.089238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a16ee6-7e80-436f-a809-bc688e4b573b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:33.089465 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a16ee6-7e80-436f-a809-bc688e4b573b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:33.120776 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-e8a16ee6-7e80-436f-a809-bc688e4b573b None None] MFA Rules not processed for user `ed0aa9507e9842a6a8aa08fd9bdc2d78`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:33.122251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e8a16ee6-7e80-436f-a809-bc688e4b573b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:33.190766 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 942/1896] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:33 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:33.201435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1764e86-b6ba-41c3-a679-bd814e6894d5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:33.203308 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f1764e86-b6ba-41c3-a679-bd814e6894d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:33.268003 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1764e86-b6ba-41c3-a679-bd814e6894d5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:33.273350 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988ffa0-733a-4019-86b8-f96cc3e6b6a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:33.278726 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988ffa0-733a-4019-86b8-f96cc3e6b6a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:33.279783 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988ffa0-733a-4019-86b8-f96cc3e6b6a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:33.280163 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988ffa0-733a-4019-86b8-f96cc3e6b6a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:33.291610 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988ffa0-733a-4019-86b8-f96cc3e6b6a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:33.293177 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988ffa0-733a-4019-86b8-f96cc3e6b6a6 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:33.305915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 955/1897] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:33 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:33.436512 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a16ee6-7e80-436f-a809-bc688e4b573b None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:33.442687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e8a16ee6-7e80-436f-a809-bc688e4b573b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:33.555614 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a16ee6-7e80-436f-a809-bc688e4b573b None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:33.562557 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcec1b2-8578-4652-bf64-1f58eb4b7dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:33.567146 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcec1b2-8578-4652-bf64-1f58eb4b7dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:33.567720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcec1b2-8578-4652-bf64-1f58eb4b7dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:33.568005 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcec1b2-8578-4652-bf64-1f58eb4b7dae admin admin] PATH_INFO: `/v3/users/2a54e113ce8e4e83b79b39b216c47318` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:33.569318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcec1b2-8578-4652-bf64-1f58eb4b7dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a54e113ce8e4e83b79b39b216c47318)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:33.571285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcec1b2-8578-4652-bf64-1f58eb4b7dae admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:33.623501 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-1bcec1b2-8578-4652-bf64-1f58eb4b7dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a54e113ce8e4e83b79b39b216c47318'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:33.640798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-1bcec1b2-8578-4652-bf64-1f58eb4b7dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a54e113ce8e4e83b79b39b216c47318'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:33.649498 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-1bcec1b2-8578-4652-bf64-1f58eb4b7dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a54e113ce8e4e83b79b39b216c47318'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:33.658255 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-1bcec1b2-8578-4652-bf64-1f58eb4b7dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a54e113ce8e4e83b79b39b216c47318'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:33.663090 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-1bcec1b2-8578-4652-bf64-1f58eb4b7dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a54e113ce8e4e83b79b39b216c47318'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:33.671238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 943/1898] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:33 2021] DELETE /identity/v3/users/2a54e113ce8e4e83b79b39b216c47318 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:33.676014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6142d-ab28-44e8-94f4-130eacbba025 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:33.676463 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6142d-ab28-44e8-94f4-130eacbba025 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:33.676547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6142d-ab28-44e8-94f4-130eacbba025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:33.694766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-ebb6142d-ab28-44e8-94f4-130eacbba025 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:33.695993 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-ebb6142d-ab28-44e8-94f4-130eacbba025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:33.743565 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcec1b2-8578-4652-bf64-1f58eb4b7dae admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:33.744945 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1bcec1b2-8578-4652-bf64-1f58eb4b7dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:33.770056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 956/1899] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:33.780340 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6142d-ab28-44e8-94f4-130eacbba025 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:33.781745 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-ebb6142d-ab28-44e8-94f4-130eacbba025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:33.815182 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcec1b2-8578-4652-bf64-1f58eb4b7dae admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:33.829596 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3b079-82fb-4b6d-87a2-82056c77c3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:33.830571 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b079-82fb-4b6d-87a2-82056c77c3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:33.831025 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b079-82fb-4b6d-87a2-82056c77c3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:33.831307 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b079-82fb-4b6d-87a2-82056c77c3c3 admin admin] PATH_INFO: `/v3/users/230aaceaf2b740a5914c47a157cfa1f4` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:33.832526 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3b079-82fb-4b6d-87a2-82056c77c3c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=230aaceaf2b740a5914c47a157cfa1f4)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:33.834861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3b079-82fb-4b6d-87a2-82056c77c3c3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:33.848700 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6142d-ab28-44e8-94f4-130eacbba025 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:33.853510 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293744c-33a3-4fb0-84ed-edea87cb92dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:33.854294 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293744c-33a3-4fb0-84ed-edea87cb92dd service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:33.854576 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293744c-33a3-4fb0-84ed-edea87cb92dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:33.854857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293744c-33a3-4fb0-84ed-edea87cb92dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:33.866801 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293744c-33a3-4fb0-84ed-edea87cb92dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:33.868459 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293744c-33a3-4fb0-84ed-edea87cb92dd service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:33.881940 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 957/1900] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:03:33.908173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-e8e3b079-82fb-4b6d-87a2-82056c77c3c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '230aaceaf2b740a5914c47a157cfa1f4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:33.921282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-e8e3b079-82fb-4b6d-87a2-82056c77c3c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '230aaceaf2b740a5914c47a157cfa1f4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:33.928505 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-e8e3b079-82fb-4b6d-87a2-82056c77c3c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '230aaceaf2b740a5914c47a157cfa1f4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:33.939004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-e8e3b079-82fb-4b6d-87a2-82056c77c3c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '230aaceaf2b740a5914c47a157cfa1f4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:33.940069 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-e8e3b079-82fb-4b6d-87a2-82056c77c3c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '230aaceaf2b740a5914c47a157cfa1f4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:33.947637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 944/1901] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:33 2021] DELETE /identity/v3/users/230aaceaf2b740a5914c47a157cfa1f4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:03:33.952758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221c80-2c6b-4497-8b88-edb406bd683e None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:33.953392 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221c80-2c6b-4497-8b88-edb406bd683e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:33.953910 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221c80-2c6b-4497-8b88-edb406bd683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:33.979636 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-3a221c80-2c6b-4497-8b88-edb406bd683e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:33.981055 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3a221c80-2c6b-4497-8b88-edb406bd683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:34.052816 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 958/1902] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:34.078389 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3b079-82fb-4b6d-87a2-82056c77c3c3 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:34.080208 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e8e3b079-82fb-4b6d-87a2-82056c77c3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:34.157015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3b079-82fb-4b6d-87a2-82056c77c3c3 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:34.161848 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca7e19-14a4-435f-8e68-3dee3735930b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:34.162683 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7e19-14a4-435f-8e68-3dee3735930b service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:34.164998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7e19-14a4-435f-8e68-3dee3735930b service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:34.164998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7e19-14a4-435f-8e68-3dee3735930b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:34.178819 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca7e19-14a4-435f-8e68-3dee3735930b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:34.180320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca7e19-14a4-435f-8e68-3dee3735930b service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:34.190354 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 945/1903] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:03:34.289337 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a221c80-2c6b-4497-8b88-edb406bd683e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:34.298056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3a221c80-2c6b-4497-8b88-edb406bd683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:34.330712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a221c80-2c6b-4497-8b88-edb406bd683e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:34.342831 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd74757-d621-4fc4-8fc5-5967ca5f61a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:34.344243 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd74757-d621-4fc4-8fc5-5967ca5f61a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:34.344523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd74757-d621-4fc4-8fc5-5967ca5f61a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:34.344794 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd74757-d621-4fc4-8fc5-5967ca5f61a5 admin admin] PATH_INFO: `/v3/users/cbe15db6a6204883ae355d112bb833ff` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:34.346151 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd74757-d621-4fc4-8fc5-5967ca5f61a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe15db6a6204883ae355d112bb833ff)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:34.348328 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd74757-d621-4fc4-8fc5-5967ca5f61a5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:34.396688 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca7e19-14a4-435f-8e68-3dee3735930b service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:34.398871 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-44ca7e19-14a4-435f-8e68-3dee3735930b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:34.401710 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3bd74757-d621-4fc4-8fc5-5967ca5f61a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe15db6a6204883ae355d112bb833ff'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.417354 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3bd74757-d621-4fc4-8fc5-5967ca5f61a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe15db6a6204883ae355d112bb833ff'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.417593 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca7e19-14a4-435f-8e68-3dee3735930b service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:34.423624 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:34.424489 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:34.425065 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:34.425349 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd admin admin] PATH_INFO: `/v3/projects/78cf549e410f4e3fa9bf3794ed2f77c3` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:34.426616 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=78cf549e410f4e3fa9bf3794ed2f77c3)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:34.428711 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:34.430671 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3bd74757-d621-4fc4-8fc5-5967ca5f61a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe15db6a6204883ae355d112bb833ff'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.431488 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3bd74757-d621-4fc4-8fc5-5967ca5f61a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe15db6a6204883ae355d112bb833ff'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.433010 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3bd74757-d621-4fc4-8fc5-5967ca5f61a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe15db6a6204883ae355d112bb833ff'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.451498 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 959/1904] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:34 2021] DELETE /identity/v3/users/cbe15db6a6204883ae355d112bb833ff => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:34.492117 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd74757-d621-4fc4-8fc5-5967ca5f61a5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:34.493643 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3bd74757-d621-4fc4-8fc5-5967ca5f61a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:34.502255 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78cf549e410f4e3fa9bf3794ed2f77c3', 'request_id': 'req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.512587 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78cf549e410f4e3fa9bf3794ed2f77c3', 'request_id': 'req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.521773 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78cf549e410f4e3fa9bf3794ed2f77c3', 'request_id': 'req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.534732 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd admin admin] The token cache is being invalidate because project 78cf549e410f4e3fa9bf3794ed2f77c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:34.535023 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.535700 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.537376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 946/1905] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:34 2021] DELETE /identity/v3/projects/78cf549e410f4e3fa9bf3794ed2f77c3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:03:34.541255 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:34.542660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:34.575245 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd74757-d621-4fc4-8fc5-5967ca5f61a5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:34.627206 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86184cb0-52f1-4496-9cf6-dacc0cfbb2cd admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:34.635653 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1edf2-0e1f-4adb-a279-27eb2352e2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:34.636730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1edf2-0e1f-4adb-a279-27eb2352e2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:34.637187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1edf2-0e1f-4adb-a279-27eb2352e2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:34.637734 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1edf2-0e1f-4adb-a279-27eb2352e2d4 admin admin] PATH_INFO: `/v3/users/6f77e514c5cb4bc3af7ce845ba598432` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:34.639653 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1edf2-0e1f-4adb-a279-27eb2352e2d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f77e514c5cb4bc3af7ce845ba598432)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:34.641318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f212b15-ae4d-4385-a018-7e5316fa80f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:34.641669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1edf2-0e1f-4adb-a279-27eb2352e2d4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:34.642406 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f212b15-ae4d-4385-a018-7e5316fa80f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:34.643299 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f212b15-ae4d-4385-a018-7e5316fa80f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:34.646635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f212b15-ae4d-4385-a018-7e5316fa80f8 admin admin] PATH_INFO: `/v3/projects/1d070a99708e497892ea51f3961f4ef1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:34.658022 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f212b15-ae4d-4385-a018-7e5316fa80f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d070a99708e497892ea51f3961f4ef1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:34.660015 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f212b15-ae4d-4385-a018-7e5316fa80f8 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:34.712316 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d5d1edf2-0e1f-4adb-a279-27eb2352e2d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f77e514c5cb4bc3af7ce845ba598432'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.725595 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d5d1edf2-0e1f-4adb-a279-27eb2352e2d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f77e514c5cb4bc3af7ce845ba598432'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.727019 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1f212b15-ae4d-4385-a018-7e5316fa80f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d070a99708e497892ea51f3961f4ef1', 'request_id': 'req-1f212b15-ae4d-4385-a018-7e5316fa80f8'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.734225 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d5d1edf2-0e1f-4adb-a279-27eb2352e2d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f77e514c5cb4bc3af7ce845ba598432'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.736939 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1f212b15-ae4d-4385-a018-7e5316fa80f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d070a99708e497892ea51f3961f4ef1', 'request_id': 'req-1f212b15-ae4d-4385-a018-7e5316fa80f8'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.742290 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d5d1edf2-0e1f-4adb-a279-27eb2352e2d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f77e514c5cb4bc3af7ce845ba598432'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.743078 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d5d1edf2-0e1f-4adb-a279-27eb2352e2d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f77e514c5cb4bc3af7ce845ba598432'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.743842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1f212b15-ae4d-4385-a018-7e5316fa80f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d070a99708e497892ea51f3961f4ef1', 'request_id': 'req-1f212b15-ae4d-4385-a018-7e5316fa80f8'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.755318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 947/1906] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:34 2021] DELETE /identity/v3/users/6f77e514c5cb4bc3af7ce845ba598432 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:03:34.755318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1edf2-0e1f-4adb-a279-27eb2352e2d4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:34.755318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d5d1edf2-0e1f-4adb-a279-27eb2352e2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:34.755585 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1f212b15-ae4d-4385-a018-7e5316fa80f8 admin admin] The token cache is being invalidate because project 1d070a99708e497892ea51f3961f4ef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:34.755585 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1f212b15-ae4d-4385-a018-7e5316fa80f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.756269 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1f212b15-ae4d-4385-a018-7e5316fa80f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.758253 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 960/1907] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:34 2021] DELETE /identity/v3/projects/1d070a99708e497892ea51f3961f4ef1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:03:34.761750 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f212b15-ae4d-4385-a018-7e5316fa80f8 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:34.766872 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-1f212b15-ae4d-4385-a018-7e5316fa80f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:34.843061 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f212b15-ae4d-4385-a018-7e5316fa80f8 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:34.913861 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a8cdb-54d0-411a-ad4e-a28c32d540fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:34.915106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a8cdb-54d0-411a-ad4e-a28c32d540fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:34.915517 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a8cdb-54d0-411a-ad4e-a28c32d540fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:34.915960 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a8cdb-54d0-411a-ad4e-a28c32d540fb admin admin] PATH_INFO: `/v3/users/ed0aa9507e9842a6a8aa08fd9bdc2d78` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:34.917499 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a8cdb-54d0-411a-ad4e-a28c32d540fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed0aa9507e9842a6a8aa08fd9bdc2d78)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:34.919991 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a8cdb-54d0-411a-ad4e-a28c32d540fb admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:34.964530 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1edf2-0e1f-4adb-a279-27eb2352e2d4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:34.970610 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:34.971468 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:34.971746 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:34.972009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf admin admin] PATH_INFO: `/v3/projects/d746d1a4ceb143e0a0f65d572b601808` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:34.973196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d746d1a4ceb143e0a0f65d572b601808)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:34.974992 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d69a8cdb-54d0-411a-ad4e-a28c32d540fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed0aa9507e9842a6a8aa08fd9bdc2d78'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.975134 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:34.986719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d69a8cdb-54d0-411a-ad4e-a28c32d540fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed0aa9507e9842a6a8aa08fd9bdc2d78'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.998093 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d69a8cdb-54d0-411a-ad4e-a28c32d540fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed0aa9507e9842a6a8aa08fd9bdc2d78'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:34.999452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d69a8cdb-54d0-411a-ad4e-a28c32d540fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed0aa9507e9842a6a8aa08fd9bdc2d78'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.000310 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d69a8cdb-54d0-411a-ad4e-a28c32d540fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed0aa9507e9842a6a8aa08fd9bdc2d78'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.017114 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 961/1908] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:34 2021] DELETE /identity/v3/users/ed0aa9507e9842a6a8aa08fd9bdc2d78 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:35.028672 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd746d1a4ceb143e0a0f65d572b601808', 'request_id': 'req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.042478 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd746d1a4ceb143e0a0f65d572b601808', 'request_id': 'req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.044132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a8cdb-54d0-411a-ad4e-a28c32d540fb admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:35.045994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d69a8cdb-54d0-411a-ad4e-a28c32d540fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:35.046493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd746d1a4ceb143e0a0f65d572b601808', 'request_id': 'req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.057748 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf admin admin] The token cache is being invalidate because project d746d1a4ceb143e0a0f65d572b601808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:35.058063 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.058826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.060960 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 948/1909] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:34 2021] DELETE /identity/v3/projects/d746d1a4ceb143e0a0f65d572b601808 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:35.064926 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:35.071430 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:35.121374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a8cdb-54d0-411a-ad4e-a28c32d540fb admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:35.127963 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fdf67-d8a2-48ad-acdc-756fdaf89ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:35.129346 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fdf67-d8a2-48ad-acdc-756fdaf89ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:35.129793 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fdf67-d8a2-48ad-acdc-756fdaf89ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:35.130299 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fdf67-d8a2-48ad-acdc-756fdaf89ae5 admin admin] PATH_INFO: `/v3/projects/de287784b14b48899e5a470b6996c38f` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:35.131645 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fdf67-d8a2-48ad-acdc-756fdaf89ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de287784b14b48899e5a470b6996c38f)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:35.134151 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fdf67-d8a2-48ad-acdc-756fdaf89ae5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:35.147187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcedd6-f02d-4c9f-83e4-102ccda347bf admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:35.152092 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd9a89-4645-4769-b1df-18cfbf795b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:35.152886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd9a89-4645-4769-b1df-18cfbf795b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:35.153165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd9a89-4645-4769-b1df-18cfbf795b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:35.153438 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd9a89-4645-4769-b1df-18cfbf795b7c admin admin] PATH_INFO: `/v3/users/ee271ac8ccb6486c93a227dbb2c731cc` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:35.155233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd9a89-4645-4769-b1df-18cfbf795b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee271ac8ccb6486c93a227dbb2c731cc)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:35.157214 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd9a89-4645-4769-b1df-18cfbf795b7c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:35.188818 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e26fdf67-d8a2-48ad-acdc-756fdaf89ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de287784b14b48899e5a470b6996c38f', 'request_id': 'req-e26fdf67-d8a2-48ad-acdc-756fdaf89ae5'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.199991 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e26fdf67-d8a2-48ad-acdc-756fdaf89ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de287784b14b48899e5a470b6996c38f', 'request_id': 'req-e26fdf67-d8a2-48ad-acdc-756fdaf89ae5'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.214997 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e26fdf67-d8a2-48ad-acdc-756fdaf89ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de287784b14b48899e5a470b6996c38f', 'request_id': 'req-e26fdf67-d8a2-48ad-acdc-756fdaf89ae5'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.227323 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e26fdf67-d8a2-48ad-acdc-756fdaf89ae5 admin admin] The token cache is being invalidate because project de287784b14b48899e5a470b6996c38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:35.227840 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e26fdf67-d8a2-48ad-acdc-756fdaf89ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.230093 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e26fdf67-d8a2-48ad-acdc-756fdaf89ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.231898 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-87fd9a89-4645-4769-b1df-18cfbf795b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee271ac8ccb6486c93a227dbb2c731cc'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.237597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 962/1910] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:35 2021] DELETE /identity/v3/projects/de287784b14b48899e5a470b6996c38f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:35.239420 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f272-f710-43d0-9ff9-d6adeb94ebb8 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:35.239808 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f272-f710-43d0-9ff9-d6adeb94ebb8 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:35.240183 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f272-f710-43d0-9ff9-d6adeb94ebb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:35.254873 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-87fd9a89-4645-4769-b1df-18cfbf795b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee271ac8ccb6486c93a227dbb2c731cc'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.264320 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-c903f272-f710-43d0-9ff9-d6adeb94ebb8 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:35.266530 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-87fd9a89-4645-4769-b1df-18cfbf795b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee271ac8ccb6486c93a227dbb2c731cc'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.267165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c903f272-f710-43d0-9ff9-d6adeb94ebb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:35.284977 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-87fd9a89-4645-4769-b1df-18cfbf795b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee271ac8ccb6486c93a227dbb2c731cc'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.287935 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-87fd9a89-4645-4769-b1df-18cfbf795b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee271ac8ccb6486c93a227dbb2c731cc'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.304055 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 949/1911] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:35 2021] DELETE /identity/v3/users/ee271ac8ccb6486c93a227dbb2c731cc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:03:35.335981 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 963/1912] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:35.343940 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883430ce-7b6c-4f7a-af99-95e2814c91a8 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:35.344301 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883430ce-7b6c-4f7a-af99-95e2814c91a8 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:35.345063 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883430ce-7b6c-4f7a-af99-95e2814c91a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:35.368298 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-883430ce-7b6c-4f7a-af99-95e2814c91a8 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:35.369813 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-883430ce-7b6c-4f7a-af99-95e2814c91a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:35.438361 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 950/1913] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:35.442873 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903f272-f710-43d0-9ff9-d6adeb94ebb8 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:35.454147 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903f272-f710-43d0-9ff9-d6adeb94ebb8 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:35.459377 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeffde-1f0d-4ed8-95bd-e2c75dea716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:35.460069 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeffde-1f0d-4ed8-95bd-e2c75dea716e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:35.460352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeffde-1f0d-4ed8-95bd-e2c75dea716e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:35.460629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeffde-1f0d-4ed8-95bd-e2c75dea716e admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:35.461462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeffde-1f0d-4ed8-95bd-e2c75dea716e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:35.461796 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeffde-1f0d-4ed8-95bd-e2c75dea716e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:35.463707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeffde-1f0d-4ed8-95bd-e2c75dea716e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:35.490955 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 964/1914] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 03:03:35.495802 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883430ce-7b6c-4f7a-af99-95e2814c91a8 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:35.512527 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883430ce-7b6c-4f7a-af99-95e2814c91a8 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:35.518932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6562b3-2b54-40c6-be1a-92ddf1a02654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:35.519753 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6562b3-2b54-40c6-be1a-92ddf1a02654 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:35.520210 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6562b3-2b54-40c6-be1a-92ddf1a02654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:35.520585 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6562b3-2b54-40c6-be1a-92ddf1a02654 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:35.521396 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6562b3-2b54-40c6-be1a-92ddf1a02654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:35.523738 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6562b3-2b54-40c6-be1a-92ddf1a02654 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:35.569561 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 951/1915] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:35 2021] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:35.573262 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeffde-1f0d-4ed8-95bd-e2c75dea716e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:35.584523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeffde-1f0d-4ed8-95bd-e2c75dea716e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:35.628771 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6562b3-2b54-40c6-be1a-92ddf1a02654 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:35.631103 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-eb6562b3-2b54-40c6-be1a-92ddf1a02654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:35.658040 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e6453-fefc-4bdd-a6c3-3fdeeff8a741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:35.658964 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e6453-fefc-4bdd-a6c3-3fdeeff8a741 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:35.659373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e6453-fefc-4bdd-a6c3-3fdeeff8a741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:35.659784 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e6453-fefc-4bdd-a6c3-3fdeeff8a741 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:35.660637 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e6453-fefc-4bdd-a6c3-3fdeeff8a741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:35.663456 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e6453-fefc-4bdd-a6c3-3fdeeff8a741 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:35.695227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 965/1916] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:35 2021] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:35.699150 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e6453-fefc-4bdd-a6c3-3fdeeff8a741 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:35.712376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e6453-fefc-4bdd-a6c3-3fdeeff8a741 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:35.720588 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab482af8-5fea-4c5c-8c10-fad8f6751812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:35.721411 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab482af8-5fea-4c5c-8c10-fad8f6751812 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:35.721829 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab482af8-5fea-4c5c-8c10-fad8f6751812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:35.722409 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab482af8-5fea-4c5c-8c10-fad8f6751812 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:35.723427 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab482af8-5fea-4c5c-8c10-fad8f6751812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:35.725215 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab482af8-5fea-4c5c-8c10-fad8f6751812 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:35.740180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 966/1917] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:35 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:35.743842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab482af8-5fea-4c5c-8c10-fad8f6751812 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:35.754328 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab482af8-5fea-4c5c-8c10-fad8f6751812 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:35.759617 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f272a-3fef-4f3d-8738-bdfa2b6648f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:35.760716 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f272a-3fef-4f3d-8738-bdfa2b6648f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:35.761012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f272a-3fef-4f3d-8738-bdfa2b6648f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:35.761294 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f272a-3fef-4f3d-8738-bdfa2b6648f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:35.762168 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f272a-3fef-4f3d-8738-bdfa2b6648f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:35.763818 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f272a-3fef-4f3d-8738-bdfa2b6648f7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:35.777460 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6562b3-2b54-40c6-be1a-92ddf1a02654 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:35.781149 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 967/1918] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:35 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:03:35.782058 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f272a-3fef-4f3d-8738-bdfa2b6648f7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:35.790348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:35.791845 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:35.792235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:35.792498 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f272a-3fef-4f3d-8738-bdfa2b6648f7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:35.793323 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135 admin admin] PATH_INFO: `/v3/projects/c21514a19bb948e09477763778fabd05` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:35.795354 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c21514a19bb948e09477763778fabd05)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:35.798139 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b3cb4-a016-43fe-8bc3-4f56066ce0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:35.798284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:35.799169 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b3cb4-a016-43fe-8bc3-4f56066ce0c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:35.799515 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b3cb4-a016-43fe-8bc3-4f56066ce0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:35.799867 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b3cb4-a016-43fe-8bc3-4f56066ce0c0 admin admin] PATH_INFO: `/v3/projects/074691c2ff084bb5b6c07def712764b4/users/57f02cd5eb0142029c006085df8a9bda/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:35.816086 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b3cb4-a016-43fe-8bc3-4f56066ce0c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=074691c2ff084bb5b6c07def712764b4, user_id=57f02cd5eb0142029c006085df8a9bda, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:35.819188 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b3cb4-a016-43fe-8bc3-4f56066ce0c0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:35.846324 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 968/1919] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:35 2021] PUT /identity/v3/projects/074691c2ff084bb5b6c07def712764b4/users/57f02cd5eb0142029c006085df8a9bda/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:35.854973 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd53d1-3e6f-42ce-baf8-c6a34a7cf6dd None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:35.855661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd53d1-3e6f-42ce-baf8-c6a34a7cf6dd None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:35.856627 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd53d1-3e6f-42ce-baf8-c6a34a7cf6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:35.894053 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c21514a19bb948e09477763778fabd05', 'request_id': 'req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.906135 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-fabd53d1-3e6f-42ce-baf8-c6a34a7cf6dd None None] MFA Rules not processed for user `57f02cd5eb0142029c006085df8a9bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:35.908036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-fabd53d1-3e6f-42ce-baf8-c6a34a7cf6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:35.911355 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c21514a19bb948e09477763778fabd05', 'request_id': 'req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.923390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c21514a19bb948e09477763778fabd05', 'request_id': 'req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.943477 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135 admin admin] The token cache is being invalidate because project c21514a19bb948e09477763778fabd05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:35.943971 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.944794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:35.946590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 952/1920] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:35 2021] DELETE /identity/v3/projects/c21514a19bb948e09477763778fabd05 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:35.947413 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:35.948720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:36.021634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 969/1921] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:35 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:36.022986 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d5c1b-586a-42e1-99b4-9b0e0c79731b None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.023278 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d5c1b-586a-42e1-99b4-9b0e0c79731b None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.023558 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d5c1b-586a-42e1-99b4-9b0e0c79731b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.042471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-868d5c1b-586a-42e1-99b4-9b0e0c79731b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:36.043672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-868d5c1b-586a-42e1-99b4-9b0e0c79731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:36.049087 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f6f5e-6f4f-4ef3-b3e5-200eb8e9b135 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.053181 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 970/1922] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:36.054108 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d5c1b-586a-42e1-99b4-9b0e0c79731b None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.054221 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf739a8-8696-4b8e-a466-622ac492d245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.055169 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf739a8-8696-4b8e-a466-622ac492d245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.055376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-868d5c1b-586a-42e1-99b4-9b0e0c79731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:36.055615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf739a8-8696-4b8e-a466-622ac492d245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.055979 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf739a8-8696-4b8e-a466-622ac492d245 admin admin] PATH_INFO: `/v3/projects/d7f62b5ae10a441c82123d5f72a92a3a` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.057253 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf739a8-8696-4b8e-a466-622ac492d245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f62b5ae10a441c82123d5f72a92a3a)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.059248 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf739a8-8696-4b8e-a466-622ac492d245 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.113755 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3cf739a8-8696-4b8e-a466-622ac492d245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f62b5ae10a441c82123d5f72a92a3a', 'request_id': 'req-3cf739a8-8696-4b8e-a466-622ac492d245'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:36.116071 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d5c1b-586a-42e1-99b4-9b0e0c79731b None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.122349 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3cf739a8-8696-4b8e-a466-622ac492d245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f62b5ae10a441c82123d5f72a92a3a', 'request_id': 'req-3cf739a8-8696-4b8e-a466-622ac492d245'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:36.130408 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3cf739a8-8696-4b8e-a466-622ac492d245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f62b5ae10a441c82123d5f72a92a3a', 'request_id': 'req-3cf739a8-8696-4b8e-a466-622ac492d245'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:36.141785 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3cf739a8-8696-4b8e-a466-622ac492d245 admin admin] The token cache is being invalidate because project d7f62b5ae10a441c82123d5f72a92a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:36.142105 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3cf739a8-8696-4b8e-a466-622ac492d245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:36.143541 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3cf739a8-8696-4b8e-a466-622ac492d245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:36.145254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 953/1923] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:35 2021] DELETE /identity/v3/projects/d7f62b5ae10a441c82123d5f72a92a3a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:36.146574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4118472-391d-4007-aa6f-ebdcecc8a71d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.146860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4118472-391d-4007-aa6f-ebdcecc8a71d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.147138 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4118472-391d-4007-aa6f-ebdcecc8a71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.166407 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-f4118472-391d-4007-aa6f-ebdcecc8a71d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:36.167604 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f4118472-391d-4007-aa6f-ebdcecc8a71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:36.171422 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9853ff-c9c4-45f6-b7c7-56f8eaba09ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.172077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9853ff-c9c4-45f6-b7c7-56f8eaba09ad service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.172361 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9853ff-c9c4-45f6-b7c7-56f8eaba09ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.172639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9853ff-c9c4-45f6-b7c7-56f8eaba09ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.174488 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7f9853ff-c9c4-45f6-b7c7-56f8eaba09ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:36.233394 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9853ff-c9c4-45f6-b7c7-56f8eaba09ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.234910 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9853ff-c9c4-45f6-b7c7-56f8eaba09ad service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.236178 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 954/1924] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:36.237457 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844929c-3d9e-4216-bd6a-1aa7991e65df None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.237739 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844929c-3d9e-4216-bd6a-1aa7991e65df None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.238041 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844929c-3d9e-4216-bd6a-1aa7991e65df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.245234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 971/1925] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:36 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:36.245505 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9853ff-c9c4-45f6-b7c7-56f8eaba09ad service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.256103 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9853ff-c9c4-45f6-b7c7-56f8eaba09ad service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.256745 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-d844929c-3d9e-4216-bd6a-1aa7991e65df None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:36.257971 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d844929c-3d9e-4216-bd6a-1aa7991e65df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:36.264891 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d68f2f-80e1-4a2a-9af3-f7c76f4ab1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.265555 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d68f2f-80e1-4a2a-9af3-f7c76f4ab1ed admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.265839 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d68f2f-80e1-4a2a-9af3-f7c76f4ab1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.266149 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d68f2f-80e1-4a2a-9af3-f7c76f4ab1ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.266914 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d68f2f-80e1-4a2a-9af3-f7c76f4ab1ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:36.267222 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d68f2f-80e1-4a2a-9af3-f7c76f4ab1ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.268799 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d68f2f-80e1-4a2a-9af3-f7c76f4ab1ed admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.269884 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 955/1926] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:36.270562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844929c-3d9e-4216-bd6a-1aa7991e65df None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.271807 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d844929c-3d9e-4216-bd6a-1aa7991e65df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:36.283694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844929c-3d9e-4216-bd6a-1aa7991e65df None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.287242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 972/1927] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:36.288388 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825fcbdc-d25d-489a-93ac-b3eac54f7eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.289229 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fcbdc-d25d-489a-93ac-b3eac54f7eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.289426 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666272a-5b73-4a58-a16b-65e25dc3f8f6 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.289609 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fcbdc-d25d-489a-93ac-b3eac54f7eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.289776 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fcbdc-d25d-489a-93ac-b3eac54f7eab admin admin] PATH_INFO: `/v3/users/57f02cd5eb0142029c006085df8a9bda` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.290003 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666272a-5b73-4a58-a16b-65e25dc3f8f6 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.290412 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666272a-5b73-4a58-a16b-65e25dc3f8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.291323 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825fcbdc-d25d-489a-93ac-b3eac54f7eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=57f02cd5eb0142029c006085df8a9bda)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.293233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825fcbdc-d25d-489a-93ac-b3eac54f7eab admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.307829 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a666272a-5b73-4a58-a16b-65e25dc3f8f6 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:36.309015 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a666272a-5b73-4a58-a16b-65e25dc3f8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:36.317054 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 973/1928] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:36.317848 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666272a-5b73-4a58-a16b-65e25dc3f8f6 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.328016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666272a-5b73-4a58-a16b-65e25dc3f8f6 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.332644 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7f240-de2b-44a6-bdd0-e3c1cc53802c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.333278 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7f240-de2b-44a6-bdd0-e3c1cc53802c admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.333565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7f240-de2b-44a6-bdd0-e3c1cc53802c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.333845 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7f240-de2b-44a6-bdd0-e3c1cc53802c admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.334573 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7f240-de2b-44a6-bdd0-e3c1cc53802c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.336458 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7f240-de2b-44a6-bdd0-e3c1cc53802c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.339095 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-825fcbdc-d25d-489a-93ac-b3eac54f7eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57f02cd5eb0142029c006085df8a9bda'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:36.350867 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-825fcbdc-d25d-489a-93ac-b3eac54f7eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57f02cd5eb0142029c006085df8a9bda'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:36.358400 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-825fcbdc-d25d-489a-93ac-b3eac54f7eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57f02cd5eb0142029c006085df8a9bda'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:36.362224 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 974/1929] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:36 2021] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:36.363005 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7f240-de2b-44a6-bdd0-e3c1cc53802c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.365793 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-825fcbdc-d25d-489a-93ac-b3eac54f7eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57f02cd5eb0142029c006085df8a9bda'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:36.366493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-825fcbdc-d25d-489a-93ac-b3eac54f7eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57f02cd5eb0142029c006085df8a9bda'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:36.372245 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 956/1930] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:03:36 2021] DELETE /identity/v3/users/57f02cd5eb0142029c006085df8a9bda => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:36.373734 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825fcbdc-d25d-489a-93ac-b3eac54f7eab admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.375197 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-825fcbdc-d25d-489a-93ac-b3eac54f7eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:36.428818 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7f240-de2b-44a6-bdd0-e3c1cc53802c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.443485 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825fcbdc-d25d-489a-93ac-b3eac54f7eab admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.448740 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501b5d8-98c5-4ab0-a278-9122fc49fbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.449628 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501b5d8-98c5-4ab0-a278-9122fc49fbdc admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.449913 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501b5d8-98c5-4ab0-a278-9122fc49fbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.450221 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501b5d8-98c5-4ab0-a278-9122fc49fbdc admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.451842 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501b5d8-98c5-4ab0-a278-9122fc49fbdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.453747 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501b5d8-98c5-4ab0-a278-9122fc49fbdc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.476575 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 957/1931] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:36 2021] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:36.477952 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188e5f5-e3bf-4f13-a2b0-321974cc5749 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.478345 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188e5f5-e3bf-4f13-a2b0-321974cc5749 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.478695 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188e5f5-e3bf-4f13-a2b0-321974cc5749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.494557 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a952418-2f7f-4d05-8c1a-93b195b3bc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.495325 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a952418-2f7f-4d05-8c1a-93b195b3bc79 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.495685 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a952418-2f7f-4d05-8c1a-93b195b3bc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.496036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a952418-2f7f-4d05-8c1a-93b195b3bc79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.496417 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-3188e5f5-e3bf-4f13-a2b0-321974cc5749 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:36.496917 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a952418-2f7f-4d05-8c1a-93b195b3bc79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:36.497299 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a952418-2f7f-4d05-8c1a-93b195b3bc79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.497660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-3188e5f5-e3bf-4f13-a2b0-321974cc5749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:36.499415 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a952418-2f7f-4d05-8c1a-93b195b3bc79 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.505812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 958/1932] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:36.506855 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188e5f5-e3bf-4f13-a2b0-321974cc5749 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.517370 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 975/1933] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:36.521578 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a952418-2f7f-4d05-8c1a-93b195b3bc79 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.523748 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4a952418-2f7f-4d05-8c1a-93b195b3bc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:36.524281 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188e5f5-e3bf-4f13-a2b0-321974cc5749 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.531771 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0988221-a560-4117-9b8b-9294e55a377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.532556 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0988221-a560-4117-9b8b-9294e55a377d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.532844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0988221-a560-4117-9b8b-9294e55a377d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.533121 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0988221-a560-4117-9b8b-9294e55a377d admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.534539 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0988221-a560-4117-9b8b-9294e55a377d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.536532 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0988221-a560-4117-9b8b-9294e55a377d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.540085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a952418-2f7f-4d05-8c1a-93b195b3bc79 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.546161 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec755c-cba0-4df9-b9c2-b6e7a7a4dbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.547388 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec755c-cba0-4df9-b9c2-b6e7a7a4dbb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.547531 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 959/1934] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:36 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:36.548055 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0988221-a560-4117-9b8b-9294e55a377d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.549706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b0988221-a560-4117-9b8b-9294e55a377d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:36.550336 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec755c-cba0-4df9-b9c2-b6e7a7a4dbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.550631 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec755c-cba0-4df9-b9c2-b6e7a7a4dbb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.551357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec755c-cba0-4df9-b9c2-b6e7a7a4dbb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.553305 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec755c-cba0-4df9-b9c2-b6e7a7a4dbb9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.582055 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 976/1935] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:36 2021] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:36.582055 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec755c-cba0-4df9-b9c2-b6e7a7a4dbb9 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.608573 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0988221-a560-4117-9b8b-9294e55a377d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.652753 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec755c-cba0-4df9-b9c2-b6e7a7a4dbb9 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.655606 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404abb67-25e7-47e8-a04e-a53f74d590f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.656249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404abb67-25e7-47e8-a04e-a53f74d590f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.656529 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404abb67-25e7-47e8-a04e-a53f74d590f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.656801 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404abb67-25e7-47e8-a04e-a53f74d590f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.658402 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d335b7-2885-483a-85a0-9224ecd4f6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.659084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d335b7-2885-483a-85a0-9224ecd4f6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.659362 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d335b7-2885-483a-85a0-9224ecd4f6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.659634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d335b7-2885-483a-85a0-9224ecd4f6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.660359 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d335b7-2885-483a-85a0-9224ecd4f6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.661994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d335b7-2885-483a-85a0-9224ecd4f6b1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.665653 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404abb67-25e7-47e8-a04e-a53f74d590f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.667181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404abb67-25e7-47e8-a04e-a53f74d590f5 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.671706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 977/1936] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:36 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:36.672542 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d335b7-2885-483a-85a0-9224ecd4f6b1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.676959 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 960/1937] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:36.677615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404abb67-25e7-47e8-a04e-a53f74d590f5 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.683238 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d335b7-2885-483a-85a0-9224ecd4f6b1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.686865 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404abb67-25e7-47e8-a04e-a53f74d590f5 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.688857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26a7b6-050a-46a4-8fa0-a2db6e06ad46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.689640 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26a7b6-050a-46a4-8fa0-a2db6e06ad46 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.690011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26a7b6-050a-46a4-8fa0-a2db6e06ad46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.690381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26a7b6-050a-46a4-8fa0-a2db6e06ad46 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.691256 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26a7b6-050a-46a4-8fa0-a2db6e06ad46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.691483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009b95b-98c1-4b36-8794-6fd3ff41733c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.692342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009b95b-98c1-4b36-8794-6fd3ff41733c admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.692625 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009b95b-98c1-4b36-8794-6fd3ff41733c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.693518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009b95b-98c1-4b36-8794-6fd3ff41733c admin admin] PATH_INFO: `/v3/projects/4e6a88ec0773417ba40586782d846f58/users/5e89691c9b0f4e9395f7ccf8d7e7fd94/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.693619 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26a7b6-050a-46a4-8fa0-a2db6e06ad46 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.709614 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009b95b-98c1-4b36-8794-6fd3ff41733c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6a88ec0773417ba40586782d846f58, user_id=5e89691c9b0f4e9395f7ccf8d7e7fd94, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.712975 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009b95b-98c1-4b36-8794-6fd3ff41733c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.718436 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 978/1938] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:36 2021] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:36.719694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26a7b6-050a-46a4-8fa0-a2db6e06ad46 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.730881 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 961/1939] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:36 2021] PUT /identity/v3/projects/4e6a88ec0773417ba40586782d846f58/users/5e89691c9b0f4e9395f7ccf8d7e7fd94/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:36.732448 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26a7b6-050a-46a4-8fa0-a2db6e06ad46 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.743585 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05df5e-8c74-4d0a-903a-97a235f4412f None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.743881 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05df5e-8c74-4d0a-903a-97a235f4412f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.744139 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05df5e-8c74-4d0a-903a-97a235f4412f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.780383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-9d05df5e-8c74-4d0a-903a-97a235f4412f None None] MFA Rules not processed for user `5e89691c9b0f4e9395f7ccf8d7e7fd94`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:36.781572 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9d05df5e-8c74-4d0a-903a-97a235f4412f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:36.802672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd71d9-9cf2-4663-b504-418d52bf6651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.803504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd71d9-9cf2-4663-b504-418d52bf6651 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.803931 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd71d9-9cf2-4663-b504-418d52bf6651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.804409 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd71d9-9cf2-4663-b504-418d52bf6651 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.805391 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd71d9-9cf2-4663-b504-418d52bf6651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.807339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd71d9-9cf2-4663-b504-418d52bf6651 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.818964 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 979/1940] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:36 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:36.822857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd71d9-9cf2-4663-b504-418d52bf6651 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.833338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd71d9-9cf2-4663-b504-418d52bf6651 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.839559 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e684301-9096-482a-bebf-166efb1005b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.840241 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e684301-9096-482a-bebf-166efb1005b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.840525 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e684301-9096-482a-bebf-166efb1005b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.840809 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e684301-9096-482a-bebf-166efb1005b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.841586 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e684301-9096-482a-bebf-166efb1005b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.843511 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e684301-9096-482a-bebf-166efb1005b6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.856832 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 980/1941] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:36 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:03:36.858175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e684301-9096-482a-bebf-166efb1005b6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.860222 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 962/1942] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:36 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:03:36.864455 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05df5e-8c74-4d0a-903a-97a235f4412f None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.870931 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e684301-9096-482a-bebf-166efb1005b6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.876352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693480bf-dbda-4b70-8ac4-e3de2cc08375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.877297 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693480bf-dbda-4b70-8ac4-e3de2cc08375 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.877526 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693480bf-dbda-4b70-8ac4-e3de2cc08375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.877804 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693480bf-dbda-4b70-8ac4-e3de2cc08375 admin admin] PATH_INFO: `/v3/projects/3edd0e67828a4dac985d13bb5924d4a5/users/f7997a390ff5491b9addf8c5be68af38/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.878011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05df5e-8c74-4d0a-903a-97a235f4412f None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:36.883214 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7abef-3ac5-4e17-a0bd-218352be1443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:36.884218 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7abef-3ac5-4e17-a0bd-218352be1443 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.884503 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7abef-3ac5-4e17-a0bd-218352be1443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.884780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7abef-3ac5-4e17-a0bd-218352be1443 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.885612 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7abef-3ac5-4e17-a0bd-218352be1443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.887887 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7abef-3ac5-4e17-a0bd-218352be1443 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.894897 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693480bf-dbda-4b70-8ac4-e3de2cc08375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edd0e67828a4dac985d13bb5924d4a5, user_id=f7997a390ff5491b9addf8c5be68af38, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:36.898185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693480bf-dbda-4b70-8ac4-e3de2cc08375 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:36.913204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 981/1943] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:36 2021] PUT /identity/v3/projects/3edd0e67828a4dac985d13bb5924d4a5/users/f7997a390ff5491b9addf8c5be68af38/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:03:36.924976 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c35ff-f3c4-4421-ab27-86e1ffc051cd None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:36.925347 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c35ff-f3c4-4421-ab27-86e1ffc051cd None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:36.925638 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c35ff-f3c4-4421-ab27-86e1ffc051cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:36.938029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 963/1944] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:36 2021] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:03:36.941729 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7abef-3ac5-4e17-a0bd-218352be1443 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:36.958011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-286c35ff-f3c4-4421-ab27-86e1ffc051cd None None] MFA Rules not processed for user `f7997a390ff5491b9addf8c5be68af38`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:36.959482 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-286c35ff-f3c4-4421-ab27-86e1ffc051cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:37.007866 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7abef-3ac5-4e17-a0bd-218352be1443 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.012790 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891e2e9-0cdb-4729-9c8f-f5611839a346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.014172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891e2e9-0cdb-4729-9c8f-f5611839a346 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.014552 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891e2e9-0cdb-4729-9c8f-f5611839a346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.014915 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891e2e9-0cdb-4729-9c8f-f5611839a346 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.015676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891e2e9-0cdb-4729-9c8f-f5611839a346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.017640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891e2e9-0cdb-4729-9c8f-f5611839a346 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.047164 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 964/1945] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:36 2021] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:37.051072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891e2e9-0cdb-4729-9c8f-f5611839a346 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.053067 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 982/1946] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:36 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:03:37.059320 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c35ff-f3c4-4421-ab27-86e1ffc051cd None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.062930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891e2e9-0cdb-4729-9c8f-f5611839a346 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.071051 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d45c9-5214-4dda-9c0f-cf92653f61b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.071051 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d45c9-5214-4dda-9c0f-cf92653f61b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.071051 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d45c9-5214-4dda-9c0f-cf92653f61b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.071051 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d45c9-5214-4dda-9c0f-cf92653f61b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.071467 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d45c9-5214-4dda-9c0f-cf92653f61b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.071981 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d45c9-5214-4dda-9c0f-cf92653f61b4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.081419 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c35ff-f3c4-4421-ab27-86e1ffc051cd None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.086505 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07869e13-d9bd-47bf-b1ba-8f4b9af76628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.087315 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07869e13-d9bd-47bf-b1ba-8f4b9af76628 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.087705 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07869e13-d9bd-47bf-b1ba-8f4b9af76628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.088085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07869e13-d9bd-47bf-b1ba-8f4b9af76628 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.089055 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07869e13-d9bd-47bf-b1ba-8f4b9af76628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.089661 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 965/1947] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:37 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:37.090588 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d45c9-5214-4dda-9c0f-cf92653f61b4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.091515 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07869e13-d9bd-47bf-b1ba-8f4b9af76628 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.092381 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-493d45c9-5214-4dda-9c0f-cf92653f61b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:37.104974 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d45c9-5214-4dda-9c0f-cf92653f61b4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.119646 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.120505 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.120816 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.121402 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017 admin admin] PATH_INFO: `/v3/projects/074691c2ff084bb5b6c07def712764b4` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.122430 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=074691c2ff084bb5b6c07def712764b4)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.124829 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.127259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 983/1948] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:37 2021] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:37.128222 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07869e13-d9bd-47bf-b1ba-8f4b9af76628 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.184593 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '074691c2ff084bb5b6c07def712764b4', 'request_id': 'req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:37.195828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '074691c2ff084bb5b6c07def712764b4', 'request_id': 'req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:37.198313 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07869e13-d9bd-47bf-b1ba-8f4b9af76628 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.204592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '074691c2ff084bb5b6c07def712764b4', 'request_id': 'req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:37.215628 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017 admin admin] The token cache is being invalidate because project 074691c2ff084bb5b6c07def712764b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:03:37.216059 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:37.216742 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:03:37.218350 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 966/1949] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:03:37 2021] DELETE /identity/v3/projects/074691c2ff084bb5b6c07def712764b4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:37.219066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.220469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:37.261925 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673990e1-88b2-411c-b16f-0d67439fe4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.262598 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673990e1-88b2-411c-b16f-0d67439fe4fb admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.262875 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673990e1-88b2-411c-b16f-0d67439fe4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.263176 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673990e1-88b2-411c-b16f-0d67439fe4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.263905 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673990e1-88b2-411c-b16f-0d67439fe4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.265524 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673990e1-88b2-411c-b16f-0d67439fe4fb admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.274981 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 984/1950] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:37 2021] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:37.276257 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629221df-56f5-4960-ba60-2da628d4fa03 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.276541 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629221df-56f5-4960-ba60-2da628d4fa03 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.276815 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629221df-56f5-4960-ba60-2da628d4fa03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.282251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89aa630-c3e8-4a6c-bfa2-70f7443e3017 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.287017 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9401b-3713-476e-acb6-53adaf4b544a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.287788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9401b-3713-476e-acb6-53adaf4b544a admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.288072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9401b-3713-476e-acb6-53adaf4b544a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.288346 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9401b-3713-476e-acb6-53adaf4b544a admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.289043 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9401b-3713-476e-acb6-53adaf4b544a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.291029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9401b-3713-476e-acb6-53adaf4b544a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.293853 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-629221df-56f5-4960-ba60-2da628d4fa03 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:37.295672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-629221df-56f5-4960-ba60-2da628d4fa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:37.303424 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 985/1951] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:37.304274 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629221df-56f5-4960-ba60-2da628d4fa03 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.307211 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-629221df-56f5-4960-ba60-2da628d4fa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:37.312999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 967/1952] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:37 2021] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:37.314505 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c69d56-9ec5-464f-8a0e-6f54f20e59a3 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.314794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c69d56-9ec5-464f-8a0e-6f54f20e59a3 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.315065 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c69d56-9ec5-464f-8a0e-6f54f20e59a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.319887 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629221df-56f5-4960-ba60-2da628d4fa03 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.324651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902fdef-0904-47e0-81f0-a1c0674a3c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.325563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902fdef-0904-47e0-81f0-a1c0674a3c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.325848 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902fdef-0904-47e0-81f0-a1c0674a3c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.326162 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902fdef-0904-47e0-81f0-a1c0674a3c4e admin admin] PATH_INFO: `/v3/projects/573bac46199b401aa7ace6926ffdb830/users/52901a931694415eae1f5f4e6d8d1a4c/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.333064 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-30c69d56-9ec5-464f-8a0e-6f54f20e59a3 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:37.334294 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-30c69d56-9ec5-464f-8a0e-6f54f20e59a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:37.340440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902fdef-0904-47e0-81f0-a1c0674a3c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=573bac46199b401aa7ace6926ffdb830, user_id=52901a931694415eae1f5f4e6d8d1a4c, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.342790 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 968/1953] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:37.343097 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902fdef-0904-47e0-81f0-a1c0674a3c4e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.343433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c69d56-9ec5-464f-8a0e-6f54f20e59a3 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.354065 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c69d56-9ec5-464f-8a0e-6f54f20e59a3 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.358584 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 986/1954] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:37 2021] PUT /identity/v3/projects/573bac46199b401aa7ace6926ffdb830/users/52901a931694415eae1f5f4e6d8d1a4c/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:37.359477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902fdef-0904-47e0-81f0-a1c0674a3c4e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.411233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e759bf-0952-49f8-8799-7c57090f8b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.412065 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e759bf-0952-49f8-8799-7c57090f8b2f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.412337 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e759bf-0952-49f8-8799-7c57090f8b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.412643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e759bf-0952-49f8-8799-7c57090f8b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.413589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e759bf-0952-49f8-8799-7c57090f8b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.415412 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e759bf-0952-49f8-8799-7c57090f8b2f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.420610 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902fdef-0904-47e0-81f0-a1c0674a3c4e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.425401 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d223f57-8733-461e-8943-acb676a092a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.430093 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d223f57-8733-461e-8943-acb676a092a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.430093 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d223f57-8733-461e-8943-acb676a092a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.430363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 969/1955] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:37 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:37.430363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848911c9-bca8-4138-a265-835b3300c50d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.430363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848911c9-bca8-4138-a265-835b3300c50d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.430363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848911c9-bca8-4138-a265-835b3300c50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.430647 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d223f57-8733-461e-8943-acb676a092a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.430647 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d223f57-8733-461e-8943-acb676a092a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:03:37.430855 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d223f57-8733-461e-8943-acb676a092a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.432472 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d223f57-8733-461e-8943-acb676a092a7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.450582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 987/1956] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:03:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:03:37.451477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d223f57-8733-461e-8943-acb676a092a7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.454970 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-848911c9-bca8-4138-a265-835b3300c50d None None] MFA Rules not processed for user `52901a931694415eae1f5f4e6d8d1a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:37.456157 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-848911c9-bca8-4138-a265-835b3300c50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:37.461122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d223f57-8733-461e-8943-acb676a092a7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.465691 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e03e2f-c8e6-43ed-86fc-fe3a8f450c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.467102 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e03e2f-c8e6-43ed-86fc-fe3a8f450c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.467377 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e03e2f-c8e6-43ed-86fc-fe3a8f450c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.467654 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e03e2f-c8e6-43ed-86fc-fe3a8f450c46 admin admin] PATH_INFO: `/v3/projects/41b8185ab9334ad48b604b8a435a55df/users/d593fbd3311b46e9a4588f49e2a5ea5c/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.481615 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e03e2f-c8e6-43ed-86fc-fe3a8f450c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b8185ab9334ad48b604b8a435a55df, user_id=d593fbd3311b46e9a4588f49e2a5ea5c, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.484827 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e03e2f-c8e6-43ed-86fc-fe3a8f450c46 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.497347 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 988/1957] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:37 2021] PUT /identity/v3/projects/41b8185ab9334ad48b604b8a435a55df/users/d593fbd3311b46e9a4588f49e2a5ea5c/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:37.498648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e03e2f-c8e6-43ed-86fc-fe3a8f450c46 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.518003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 970/1958] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:37 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:37.519288 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848911c9-bca8-4138-a265-835b3300c50d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.529663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848911c9-bca8-4138-a265-835b3300c50d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.568030 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e03e2f-c8e6-43ed-86fc-fe3a8f450c46 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.572728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d57b8-1a49-4307-a1c3-c29903332b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.573371 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d57b8-1a49-4307-a1c3-c29903332b6a admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.573650 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d57b8-1a49-4307-a1c3-c29903332b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.573925 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d57b8-1a49-4307-a1c3-c29903332b6a admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.574656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d57b8-1a49-4307-a1c3-c29903332b6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.576564 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d57b8-1a49-4307-a1c3-c29903332b6a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.583393 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd7143-994e-4ead-bfe8-1bf476c6e278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.584050 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7143-994e-4ead-bfe8-1bf476c6e278 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.584325 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7143-994e-4ead-bfe8-1bf476c6e278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.584593 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7143-994e-4ead-bfe8-1bf476c6e278 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.585323 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd7143-994e-4ead-bfe8-1bf476c6e278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.586927 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd7143-994e-4ead-bfe8-1bf476c6e278 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.597969 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 971/1959] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:37 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:37.598637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd7143-994e-4ead-bfe8-1bf476c6e278 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.607428 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 989/1960] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:37 2021] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:37.608458 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d57b8-1a49-4307-a1c3-c29903332b6a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.615104 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd7143-994e-4ead-bfe8-1bf476c6e278 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.680561 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d57b8-1a49-4307-a1c3-c29903332b6a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.685821 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d3940-0652-4ea8-b50f-48f463f90ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.686035 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa8d03-20fd-4537-aaa7-fd599e290a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.686650 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa8d03-20fd-4537-aaa7-fd599e290a7b admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.686754 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d3940-0652-4ea8-b50f-48f463f90ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.686932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa8d03-20fd-4537-aaa7-fd599e290a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.687043 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d3940-0652-4ea8-b50f-48f463f90ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.687207 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa8d03-20fd-4537-aaa7-fd599e290a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.687301 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d3940-0652-4ea8-b50f-48f463f90ef7 admin admin] PATH_INFO: `/v3/projects/41b8185ab9334ad48b604b8a435a55df/users/d593fbd3311b46e9a4588f49e2a5ea5c/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.687940 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa8d03-20fd-4537-aaa7-fd599e290a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.689309 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d3940-0652-4ea8-b50f-48f463f90ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b8185ab9334ad48b604b8a435a55df, user_id=d593fbd3311b46e9a4588f49e2a5ea5c, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.689858 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa8d03-20fd-4537-aaa7-fd599e290a7b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.692046 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d3940-0652-4ea8-b50f-48f463f90ef7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.711149 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 990/1961] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:37 2021] PUT /identity/v3/projects/41b8185ab9334ad48b604b8a435a55df/users/d593fbd3311b46e9a4588f49e2a5ea5c/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:37.711149 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d3940-0652-4ea8-b50f-48f463f90ef7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.735060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 972/1962] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:03:37 2021] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:37.736358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32211b-d614-4aed-82ad-866a56abe1c7 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.736710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32211b-d614-4aed-82ad-866a56abe1c7 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.736991 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32211b-d614-4aed-82ad-866a56abe1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.765254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-bc32211b-d614-4aed-82ad-866a56abe1c7 None None] MFA Rules not processed for user `d593fbd3311b46e9a4588f49e2a5ea5c`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:37.766484 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-bc32211b-d614-4aed-82ad-866a56abe1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:37.775341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d3940-0652-4ea8-b50f-48f463f90ef7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.832665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b848e1-bf22-401c-9f70-e7e6087a6cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.833479 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b848e1-bf22-401c-9f70-e7e6087a6cde admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.833759 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b848e1-bf22-401c-9f70-e7e6087a6cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.834063 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b848e1-bf22-401c-9f70-e7e6087a6cde admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.834766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b848e1-bf22-401c-9f70-e7e6087a6cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.836713 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b848e1-bf22-401c-9f70-e7e6087a6cde admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.846412 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 973/1963] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:37 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:37.847049 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32211b-d614-4aed-82ad-866a56abe1c7 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.858637 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 991/1964] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:37 2021] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:37.859409 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32211b-d614-4aed-82ad-866a56abe1c7 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.859519 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b848e1-bf22-401c-9f70-e7e6087a6cde admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.861101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-81b848e1-bf22-401c-9f70-e7e6087a6cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:37.864514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1062ac-cc74-4769-ab7c-9610e970b5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.865167 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1062ac-cc74-4769-ab7c-9610e970b5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.865443 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1062ac-cc74-4769-ab7c-9610e970b5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.865720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1062ac-cc74-4769-ab7c-9610e970b5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.866443 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1062ac-cc74-4769-ab7c-9610e970b5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.868339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1062ac-cc74-4769-ab7c-9610e970b5e8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.889147 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 974/1965] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:03:37 2021] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:03:37.889940 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1062ac-cc74-4769-ab7c-9610e970b5e8 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.898975 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1062ac-cc74-4769-ab7c-9610e970b5e8 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.903426 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41d49-9601-4d96-9ecb-32293561cb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.904731 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41d49-9601-4d96-9ecb-32293561cb53 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.905069 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41d49-9601-4d96-9ecb-32293561cb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.905351 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41d49-9601-4d96-9ecb-32293561cb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.906170 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa41d49-9601-4d96-9ecb-32293561cb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.907832 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa41d49-9601-4d96-9ecb-32293561cb53 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.918384 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 975/1966] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:37 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:37.922064 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41d49-9601-4d96-9ecb-32293561cb53 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.922852 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b848e1-bf22-401c-9f70-e7e6087a6cde admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.926724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bab2a-87a7-42a3-874e-e9d8de533811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.927371 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bab2a-87a7-42a3-874e-e9d8de533811 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.927657 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bab2a-87a7-42a3-874e-e9d8de533811 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.927937 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bab2a-87a7-42a3-874e-e9d8de533811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.929860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a95bab2a-87a7-42a3-874e-e9d8de533811 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:37.932565 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41d49-9601-4d96-9ecb-32293561cb53 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.937318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65b612-0316-4199-bf38-2d9d825e15ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.937919 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65b612-0316-4199-bf38-2d9d825e15ff admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.938225 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65b612-0316-4199-bf38-2d9d825e15ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.938496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65b612-0316-4199-bf38-2d9d825e15ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.939247 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65b612-0316-4199-bf38-2d9d825e15ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.940800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65b612-0316-4199-bf38-2d9d825e15ff admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.951356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 976/1967] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:37 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:37.952122 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65b612-0316-4199-bf38-2d9d825e15ff admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.960930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65b612-0316-4199-bf38-2d9d825e15ff admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.965391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a11a15-d438-4f4b-920b-8ce442b994ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.966003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a11a15-d438-4f4b-920b-8ce442b994ae admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.966870 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a11a15-d438-4f4b-920b-8ce442b994ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.967139 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a11a15-d438-4f4b-920b-8ce442b994ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:37.967838 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a11a15-d438-4f4b-920b-8ce442b994ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.969361 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a11a15-d438-4f4b-920b-8ce442b994ae admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.979010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 977/1968] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:37 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:37.980501 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a11a15-d438-4f4b-920b-8ce442b994ae admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:37.990032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a11a15-d438-4f4b-920b-8ce442b994ae admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:37.990733 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bab2a-87a7-42a3-874e-e9d8de533811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:37.992198 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bab2a-87a7-42a3-874e-e9d8de533811 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:37.994636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6d430-ebd4-4518-a089-a5b77fc4fdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:37.995503 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6d430-ebd4-4518-a089-a5b77fc4fdb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:37.995785 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6d430-ebd4-4518-a089-a5b77fc4fdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:37.996060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6d430-ebd4-4518-a089-a5b77fc4fdb9 admin admin] PATH_INFO: `/v3/projects/71d8375be715461c94624c54e711b602/users/c0ad00e764ba4d4b868feb5a1768de0a/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:38.001196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 992/1969] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:37 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:38.002285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bab2a-87a7-42a3-874e-e9d8de533811 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:38.012435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bab2a-87a7-42a3-874e-e9d8de533811 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:38.012952 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6d430-ebd4-4518-a089-a5b77fc4fdb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d8375be715461c94624c54e711b602, user_id=c0ad00e764ba4d4b868feb5a1768de0a, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:38.016817 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6d430-ebd4-4518-a089-a5b77fc4fdb9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:38.019178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ddf1e-9e79-4115-ab02-f9b298650668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:38.020066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ddf1e-9e79-4115-ab02-f9b298650668 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:38.020352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ddf1e-9e79-4115-ab02-f9b298650668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:38.020632 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ddf1e-9e79-4115-ab02-f9b298650668 admin admin] PATH_INFO: `/v3/projects/6f432745b7e847febb682060ab6ae363/users/de1c0e981e6546179ebe76f7ec7068ea/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:38.038592 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ddf1e-9e79-4115-ab02-f9b298650668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f432745b7e847febb682060ab6ae363, user_id=de1c0e981e6546179ebe76f7ec7068ea, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:38.039862 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 978/1970] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:37 2021] PUT /identity/v3/projects/71d8375be715461c94624c54e711b602/users/c0ad00e764ba4d4b868feb5a1768de0a/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:38.041276 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ddf1e-9e79-4115-ab02-f9b298650668 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:38.045256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6d430-ebd4-4518-a089-a5b77fc4fdb9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:38.062660 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 993/1971] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:38 2021] PUT /identity/v3/projects/6f432745b7e847febb682060ab6ae363/users/de1c0e981e6546179ebe76f7ec7068ea/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:03:38.072625 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff73b6e-ef2e-4322-9fe2-61312fab135e None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:38.072913 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff73b6e-ef2e-4322-9fe2-61312fab135e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:38.073192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff73b6e-ef2e-4322-9fe2-61312fab135e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:38.113808 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-3ff73b6e-ef2e-4322-9fe2-61312fab135e None None] MFA Rules not processed for user `de1c0e981e6546179ebe76f7ec7068ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:38.115363 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3ff73b6e-ef2e-4322-9fe2-61312fab135e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:38.142950 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6d430-ebd4-4518-a089-a5b77fc4fdb9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:38.218511 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59efe8-6bf0-4248-b77f-f2b03b802d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:38.219235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59efe8-6bf0-4248-b77f-f2b03b802d1a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:38.219543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59efe8-6bf0-4248-b77f-f2b03b802d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:38.219795 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59efe8-6bf0-4248-b77f-f2b03b802d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:38.220578 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59efe8-6bf0-4248-b77f-f2b03b802d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:38.222287 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59efe8-6bf0-4248-b77f-f2b03b802d1a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:38.233014 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 979/1972] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:03:38 2021] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:03:38.236868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59efe8-6bf0-4248-b77f-f2b03b802d1a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:38.248275 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 994/1973] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:38 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:38.248420 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59efe8-6bf0-4248-b77f-f2b03b802d1a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:38.257069 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46368727-6806-4227-b5e7-480e4e28b097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:38.258711 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46368727-6806-4227-b5e7-480e4e28b097 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:38.259350 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46368727-6806-4227-b5e7-480e4e28b097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:38.259823 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46368727-6806-4227-b5e7-480e4e28b097 admin admin] PATH_INFO: `/v3/projects/71d8375be715461c94624c54e711b602/users/c0ad00e764ba4d4b868feb5a1768de0a/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:38.259951 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff73b6e-ef2e-4322-9fe2-61312fab135e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:38.261360 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3ff73b6e-ef2e-4322-9fe2-61312fab135e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:38.262384 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46368727-6806-4227-b5e7-480e4e28b097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d8375be715461c94624c54e711b602, user_id=c0ad00e764ba4d4b868feb5a1768de0a, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:38.270417 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46368727-6806-4227-b5e7-480e4e28b097 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:38.294299 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 980/1974] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:03:38 2021] PUT /identity/v3/projects/71d8375be715461c94624c54e711b602/users/c0ad00e764ba4d4b868feb5a1768de0a/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:03:38.296686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212209-1d40-406d-8127-73eb990623f8 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:38.296977 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212209-1d40-406d-8127-73eb990623f8 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:38.297254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212209-1d40-406d-8127-73eb990623f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:38.325032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff73b6e-ef2e-4322-9fe2-61312fab135e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:38.344645 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c7212209-1d40-406d-8127-73eb990623f8 None None] MFA Rules not processed for user `c0ad00e764ba4d4b868feb5a1768de0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:38.345924 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c7212209-1d40-406d-8127-73eb990623f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:38.376826 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060f0c3-9e4a-4576-9d1f-36f84d2f3a9c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48dcc22c7df4aed8fa6cf32e3c2ec51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:38.377482 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060f0c3-9e4a-4576-9d1f-36f84d2f3a9c service glance] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:38.377759 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060f0c3-9e4a-4576-9d1f-36f84d2f3a9c service glance] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:38.378058 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060f0c3-9e4a-4576-9d1f-36f84d2f3a9c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:38.439165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 981/1975] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:03:38 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:38.444764 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060f0c3-9e4a-4576-9d1f-36f84d2f3a9c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:38.446252 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060f0c3-9e4a-4576-9d1f-36f84d2f3a9c service glance] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:38.447234 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7212209-1d40-406d-8127-73eb990623f8 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:38.449276 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c7212209-1d40-406d-8127-73eb990623f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:38.456359 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 995/1976] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:38 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:03:38.517962 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7212209-1d40-406d-8127-73eb990623f8 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:38.521777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bd41b-57c4-43d0-83a2-80aca480dba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:38.522448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bd41b-57c4-43d0-83a2-80aca480dba5 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:38.522723 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bd41b-57c4-43d0-83a2-80aca480dba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:38.522995 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bd41b-57c4-43d0-83a2-80aca480dba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:38.524780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9a4bd41b-57c4-43d0-83a2-80aca480dba5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:38.604041 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bd41b-57c4-43d0-83a2-80aca480dba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:38.605490 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bd41b-57c4-43d0-83a2-80aca480dba5 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:38.618072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 982/1977] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:38 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:46.392507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38650d10-2df5-4856-95dd-e38365434f06 None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:46.392507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38650d10-2df5-4856-95dd-e38365434f06 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:46.392507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38650d10-2df5-4856-95dd-e38365434f06 None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:46.393817 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 996/1978] 10.222.0.18 () {54 vars in 921 bytes} [Wed Dec 15 03:03:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:03:46.407884 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46b511-708b-40ee-9df1-1e68da82da04 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:46.408438 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46b511-708b-40ee-9df1-1e68da82da04 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:46.408438 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46b511-708b-40ee-9df1-1e68da82da04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:46.439700 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-7e46b511-708b-40ee-9df1-1e68da82da04 None None] MFA Rules not processed for user `fcd50adcd390465ea6fc8582e1524909`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:03:46.440849 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-7e46b511-708b-40ee-9df1-1e68da82da04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:46.540604 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 983/1979] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Dec 15 03:03:46 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:03:46.559150 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38650d10-2df5-4856-95dd-e38365434f06 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:46.569487 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46b511-708b-40ee-9df1-1e68da82da04 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:46.572108 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-7e46b511-708b-40ee-9df1-1e68da82da04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:03:46.578016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38650d10-2df5-4856-95dd-e38365434f06 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:46.587544 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e401c-40f3-415f-92a5-5cf2043da69a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:46.588272 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e401c-40f3-415f-92a5-5cf2043da69a service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:46.588556 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e401c-40f3-415f-92a5-5cf2043da69a service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:46.588874 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e401c-40f3-415f-92a5-5cf2043da69a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:46.603779 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46b511-708b-40ee-9df1-1e68da82da04 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:46.618037 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457aa26-d945-4d6d-8004-db4e5663977b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:46.619713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457aa26-d945-4d6d-8004-db4e5663977b service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:46.620801 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457aa26-d945-4d6d-8004-db4e5663977b service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:46.623629 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457aa26-d945-4d6d-8004-db4e5663977b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:46.648501 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457aa26-d945-4d6d-8004-db4e5663977b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:46.650123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457aa26-d945-4d6d-8004-db4e5663977b service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:46.666349 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e401c-40f3-415f-92a5-5cf2043da69a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:46.667924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e401c-40f3-415f-92a5-5cf2043da69a service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:46.680072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 984/1980] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:46 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:46.681046 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 997/1981] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:46 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:49.311990 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457aa26-d945-4d6d-8004-db4e5663977b service nova] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:49.321619 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457aa26-d945-4d6d-8004-db4e5663977b service nova] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:49.325175 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd03409-e366-4436-a1e1-409d22f4c914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:49.325808 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd03409-e366-4436-a1e1-409d22f4c914 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:49.326123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd03409-e366-4436-a1e1-409d22f4c914 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:49.326397 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd03409-e366-4436-a1e1-409d22f4c914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:49.335649 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd03409-e366-4436-a1e1-409d22f4c914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:49.337097 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd03409-e366-4436-a1e1-409d22f4c914 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:49.346939 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 985/1982] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:49 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:03:50.030185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e401c-40f3-415f-92a5-5cf2043da69a service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:03:50.045464 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e401c-40f3-415f-92a5-5cf2043da69a service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:03:50.049456 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f449fc-8f42-4dfb-9e5f-54f695856518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:03:50.050118 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f449fc-8f42-4dfb-9e5f-54f695856518 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:03:50.050400 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f449fc-8f42-4dfb-9e5f-54f695856518 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:03:50.050672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f449fc-8f42-4dfb-9e5f-54f695856518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:03:50.123406 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f449fc-8f42-4dfb-9e5f-54f695856518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:03:50.124852 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f449fc-8f42-4dfb-9e5f-54f695856518 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:03:50.137159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 998/1983] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:03:50 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:00.628056 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd03409-e366-4436-a1e1-409d22f4c914 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:00.690920 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd03409-e366-4436-a1e1-409d22f4c914 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:00.695542 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff6c8a-28da-448d-bedb-3a44964886c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:00.696389 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff6c8a-28da-448d-bedb-3a44964886c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:00.696732 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff6c8a-28da-448d-bedb-3a44964886c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:00.696940 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff6c8a-28da-448d-bedb-3a44964886c1 admin admin] PATH_INFO: `/v3/users/5e89691c9b0f4e9395f7ccf8d7e7fd94` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:00.698165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff6c8a-28da-448d-bedb-3a44964886c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e89691c9b0f4e9395f7ccf8d7e7fd94)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:00.700105 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff6c8a-28da-448d-bedb-3a44964886c1 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:00.742993 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-9bff6c8a-28da-448d-bedb-3a44964886c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e89691c9b0f4e9395f7ccf8d7e7fd94'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:00.754826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-9bff6c8a-28da-448d-bedb-3a44964886c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e89691c9b0f4e9395f7ccf8d7e7fd94'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:00.761655 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-9bff6c8a-28da-448d-bedb-3a44964886c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e89691c9b0f4e9395f7ccf8d7e7fd94'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:00.768725 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-9bff6c8a-28da-448d-bedb-3a44964886c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e89691c9b0f4e9395f7ccf8d7e7fd94'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:00.769347 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-9bff6c8a-28da-448d-bedb-3a44964886c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e89691c9b0f4e9395f7ccf8d7e7fd94'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:00.774958 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 986/1984] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:00 2021] DELETE /identity/v3/users/5e89691c9b0f4e9395f7ccf8d7e7fd94 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:00.779486 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5459d7b-60c6-43c8-90ae-85bb55cf48f3 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:00.779985 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5459d7b-60c6-43c8-90ae-85bb55cf48f3 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:00.780076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5459d7b-60c6-43c8-90ae-85bb55cf48f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:00.797128 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-c5459d7b-60c6-43c8-90ae-85bb55cf48f3 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:00.798352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c5459d7b-60c6-43c8-90ae-85bb55cf48f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:00.853249 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 999/1985] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:00.862897 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff6c8a-28da-448d-bedb-3a44964886c1 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:00.864275 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9bff6c8a-28da-448d-bedb-3a44964886c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:00.920292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff6c8a-28da-448d-bedb-3a44964886c1 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:00.923969 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc08a42-8b44-499a-8098-c0b4b35a9ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:00.924602 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc08a42-8b44-499a-8098-c0b4b35a9ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:00.924884 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc08a42-8b44-499a-8098-c0b4b35a9ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:00.925158 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc08a42-8b44-499a-8098-c0b4b35a9ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:00.934007 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc08a42-8b44-499a-8098-c0b4b35a9ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:00.935420 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc08a42-8b44-499a-8098-c0b4b35a9ad2 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:00.944998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 987/1986] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:01.206461 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5459d7b-60c6-43c8-90ae-85bb55cf48f3 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:01.207870 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c5459d7b-60c6-43c8-90ae-85bb55cf48f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:01.230571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5459d7b-60c6-43c8-90ae-85bb55cf48f3 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:01.230571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347354a6-1762-45cb-a03c-65547a9ecb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:01.230571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347354a6-1762-45cb-a03c-65547a9ecb55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:01.230571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347354a6-1762-45cb-a03c-65547a9ecb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:01.230897 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347354a6-1762-45cb-a03c-65547a9ecb55 admin admin] PATH_INFO: `/v3/projects/4e6a88ec0773417ba40586782d846f58` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:01.230897 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347354a6-1762-45cb-a03c-65547a9ecb55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6a88ec0773417ba40586782d846f58)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:01.231981 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347354a6-1762-45cb-a03c-65547a9ecb55 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:01.277313 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-347354a6-1762-45cb-a03c-65547a9ecb55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6a88ec0773417ba40586782d846f58', 'request_id': 'req-347354a6-1762-45cb-a03c-65547a9ecb55'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.284240 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-347354a6-1762-45cb-a03c-65547a9ecb55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6a88ec0773417ba40586782d846f58', 'request_id': 'req-347354a6-1762-45cb-a03c-65547a9ecb55'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.290272 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-347354a6-1762-45cb-a03c-65547a9ecb55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6a88ec0773417ba40586782d846f58', 'request_id': 'req-347354a6-1762-45cb-a03c-65547a9ecb55'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.300671 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-347354a6-1762-45cb-a03c-65547a9ecb55 admin admin] The token cache is being invalidate because project 4e6a88ec0773417ba40586782d846f58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:01.300959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-347354a6-1762-45cb-a03c-65547a9ecb55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.301603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-347354a6-1762-45cb-a03c-65547a9ecb55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.303161 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1000/1987] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:01 2021] DELETE /identity/v3/projects/4e6a88ec0773417ba40586782d846f58 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:01.307049 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc08a42-8b44-499a-8098-c0b4b35a9ad2 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:01.316868 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc08a42-8b44-499a-8098-c0b4b35a9ad2 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:01.369045 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cacc51-ac1d-480a-815a-4a6098368074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:01.369821 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cacc51-ac1d-480a-815a-4a6098368074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:01.370146 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cacc51-ac1d-480a-815a-4a6098368074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:01.370418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cacc51-ac1d-480a-815a-4a6098368074 admin admin] PATH_INFO: `/v3/users/52901a931694415eae1f5f4e6d8d1a4c` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:01.371600 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cacc51-ac1d-480a-815a-4a6098368074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52901a931694415eae1f5f4e6d8d1a4c)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:01.373751 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cacc51-ac1d-480a-815a-4a6098368074 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:01.418116 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-f8cacc51-ac1d-480a-815a-4a6098368074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52901a931694415eae1f5f4e6d8d1a4c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.430061 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-f8cacc51-ac1d-480a-815a-4a6098368074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52901a931694415eae1f5f4e6d8d1a4c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.436382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-f8cacc51-ac1d-480a-815a-4a6098368074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52901a931694415eae1f5f4e6d8d1a4c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.443094 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-f8cacc51-ac1d-480a-815a-4a6098368074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52901a931694415eae1f5f4e6d8d1a4c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.443708 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-f8cacc51-ac1d-480a-815a-4a6098368074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52901a931694415eae1f5f4e6d8d1a4c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.449384 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 988/1988] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:01 2021] DELETE /identity/v3/users/52901a931694415eae1f5f4e6d8d1a4c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:01.710005 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347354a6-1762-45cb-a03c-65547a9ecb55 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:01.711758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-347354a6-1762-45cb-a03c-65547a9ecb55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:01.728132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347354a6-1762-45cb-a03c-65547a9ecb55 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:01.783986 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb386a3-8ad6-429d-b900-349f56e62b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:01.784834 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb386a3-8ad6-429d-b900-349f56e62b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:01.785111 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb386a3-8ad6-429d-b900-349f56e62b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:01.785380 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb386a3-8ad6-429d-b900-349f56e62b00 admin admin] PATH_INFO: `/v3/projects/573bac46199b401aa7ace6926ffdb830` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:01.786581 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb386a3-8ad6-429d-b900-349f56e62b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=573bac46199b401aa7ace6926ffdb830)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:01.788461 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb386a3-8ad6-429d-b900-349f56e62b00 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:01.831129 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6eb386a3-8ad6-429d-b900-349f56e62b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '573bac46199b401aa7ace6926ffdb830', 'request_id': 'req-6eb386a3-8ad6-429d-b900-349f56e62b00'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.839607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6eb386a3-8ad6-429d-b900-349f56e62b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '573bac46199b401aa7ace6926ffdb830', 'request_id': 'req-6eb386a3-8ad6-429d-b900-349f56e62b00'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.846450 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6eb386a3-8ad6-429d-b900-349f56e62b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '573bac46199b401aa7ace6926ffdb830', 'request_id': 'req-6eb386a3-8ad6-429d-b900-349f56e62b00'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.856472 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6eb386a3-8ad6-429d-b900-349f56e62b00 admin admin] The token cache is being invalidate because project 573bac46199b401aa7ace6926ffdb830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:01.856759 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6eb386a3-8ad6-429d-b900-349f56e62b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.857385 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6eb386a3-8ad6-429d-b900-349f56e62b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.858941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1001/1989] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:01 2021] DELETE /identity/v3/projects/573bac46199b401aa7ace6926ffdb830 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:01.862923 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cacc51-ac1d-480a-815a-4a6098368074 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:01.864435 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f8cacc51-ac1d-480a-815a-4a6098368074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:01.876905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cacc51-ac1d-480a-815a-4a6098368074 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:01.929083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0f27b-0238-4c30-b91b-7c0c07dd7a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:01.929863 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0f27b-0238-4c30-b91b-7c0c07dd7a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:01.930168 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0f27b-0238-4c30-b91b-7c0c07dd7a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:01.930438 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0f27b-0238-4c30-b91b-7c0c07dd7a75 admin admin] PATH_INFO: `/v3/users/c0ad00e764ba4d4b868feb5a1768de0a` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:01.931603 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0f27b-0238-4c30-b91b-7c0c07dd7a75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ad00e764ba4d4b868feb5a1768de0a)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:01.933482 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0f27b-0238-4c30-b91b-7c0c07dd7a75 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:01.976592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fff0f27b-0238-4c30-b91b-7c0c07dd7a75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ad00e764ba4d4b868feb5a1768de0a'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.987415 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fff0f27b-0238-4c30-b91b-7c0c07dd7a75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ad00e764ba4d4b868feb5a1768de0a'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:01.994175 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fff0f27b-0238-4c30-b91b-7c0c07dd7a75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ad00e764ba4d4b868feb5a1768de0a'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:02.000861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fff0f27b-0238-4c30-b91b-7c0c07dd7a75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ad00e764ba4d4b868feb5a1768de0a'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:02.001475 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fff0f27b-0238-4c30-b91b-7c0c07dd7a75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ad00e764ba4d4b868feb5a1768de0a'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:02.007202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 989/1990] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:01 2021] DELETE /identity/v3/users/c0ad00e764ba4d4b868feb5a1768de0a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:02.263033 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb386a3-8ad6-429d-b900-349f56e62b00 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:02.264468 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6eb386a3-8ad6-429d-b900-349f56e62b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:02.278895 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb386a3-8ad6-429d-b900-349f56e62b00 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:02.337118 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d26fc4-6ceb-4129-8759-3a1a4dd60a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:02.337995 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d26fc4-6ceb-4129-8759-3a1a4dd60a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:02.338287 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d26fc4-6ceb-4129-8759-3a1a4dd60a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:02.338563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d26fc4-6ceb-4129-8759-3a1a4dd60a0a admin admin] PATH_INFO: `/v3/projects/71d8375be715461c94624c54e711b602` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:02.339839 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d26fc4-6ceb-4129-8759-3a1a4dd60a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d8375be715461c94624c54e711b602)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:02.341790 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d26fc4-6ceb-4129-8759-3a1a4dd60a0a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:02.386576 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-28d26fc4-6ceb-4129-8759-3a1a4dd60a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d8375be715461c94624c54e711b602', 'request_id': 'req-28d26fc4-6ceb-4129-8759-3a1a4dd60a0a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:02.397153 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-28d26fc4-6ceb-4129-8759-3a1a4dd60a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d8375be715461c94624c54e711b602', 'request_id': 'req-28d26fc4-6ceb-4129-8759-3a1a4dd60a0a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:02.401381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-28d26fc4-6ceb-4129-8759-3a1a4dd60a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d8375be715461c94624c54e711b602', 'request_id': 'req-28d26fc4-6ceb-4129-8759-3a1a4dd60a0a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:02.414011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-28d26fc4-6ceb-4129-8759-3a1a4dd60a0a admin admin] The token cache is being invalidate because project 71d8375be715461c94624c54e711b602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:02.414011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-28d26fc4-6ceb-4129-8759-3a1a4dd60a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:02.414407 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-28d26fc4-6ceb-4129-8759-3a1a4dd60a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:02.415924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1002/1991] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:02 2021] DELETE /identity/v3/projects/71d8375be715461c94624c54e711b602 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:02.422791 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581a05c-4804-4d6d-8787-cf0c7021232d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:02.423074 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581a05c-4804-4d6d-8787-cf0c7021232d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:02.423348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581a05c-4804-4d6d-8787-cf0c7021232d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:02.441193 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-8581a05c-4804-4d6d-8787-cf0c7021232d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:02.442348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8581a05c-4804-4d6d-8787-cf0c7021232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:02.501586 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 990/1992] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:02.509378 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d9a71-99f1-4518-8321-64ec1cb0c4ee None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:02.509664 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d9a71-99f1-4518-8321-64ec1cb0c4ee None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:02.509934 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d9a71-99f1-4518-8321-64ec1cb0c4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:02.527972 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-117d9a71-99f1-4518-8321-64ec1cb0c4ee None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:02.529148 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-117d9a71-99f1-4518-8321-64ec1cb0c4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:02.537140 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1003/1993] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:02.541143 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581a05c-4804-4d6d-8787-cf0c7021232d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:02.550958 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581a05c-4804-4d6d-8787-cf0c7021232d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:02.555386 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5377c4-433f-436b-be8e-5e96da45b65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:02.556020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5377c4-433f-436b-be8e-5e96da45b65c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:02.556295 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5377c4-433f-436b-be8e-5e96da45b65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:02.556565 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5377c4-433f-436b-be8e-5e96da45b65c admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:02.557282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5377c4-433f-436b-be8e-5e96da45b65c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:04:02.557607 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5377c4-433f-436b-be8e-5e96da45b65c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:02.559209 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5377c4-433f-436b-be8e-5e96da45b65c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:02.570688 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 991/1994] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:04:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:04:02.574796 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d9a71-99f1-4518-8321-64ec1cb0c4ee None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:02.583729 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d9a71-99f1-4518-8321-64ec1cb0c4ee None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:02.588422 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d06f1-464f-42c1-bf6c-4319dae6978a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:02.589063 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d06f1-464f-42c1-bf6c-4319dae6978a admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:02.589367 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d06f1-464f-42c1-bf6c-4319dae6978a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:02.589643 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d06f1-464f-42c1-bf6c-4319dae6978a admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:02.590387 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d06f1-464f-42c1-bf6c-4319dae6978a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:02.592268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d06f1-464f-42c1-bf6c-4319dae6978a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:02.616933 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1004/1995] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:02 2021] POST /identity/v3/projects => generated 367 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:02.620647 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5377c4-433f-436b-be8e-5e96da45b65c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:02.631265 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5377c4-433f-436b-be8e-5e96da45b65c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:02.684440 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96ea38-4bbd-417c-8e71-37b63c332991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:02.685110 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96ea38-4bbd-417c-8e71-37b63c332991 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:02.685393 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96ea38-4bbd-417c-8e71-37b63c332991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:02.685667 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96ea38-4bbd-417c-8e71-37b63c332991 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:02.686407 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96ea38-4bbd-417c-8e71-37b63c332991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:02.688986 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96ea38-4bbd-417c-8e71-37b63c332991 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:02.708555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 992/1996] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:02 2021] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:04:02.712452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d06f1-464f-42c1-bf6c-4319dae6978a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:02.722336 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d06f1-464f-42c1-bf6c-4319dae6978a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:02.726930 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23603bb6-9262-4d31-9289-3366f461eed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:02.727583 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23603bb6-9262-4d31-9289-3366f461eed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:02.727866 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23603bb6-9262-4d31-9289-3366f461eed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:02.728145 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23603bb6-9262-4d31-9289-3366f461eed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:02.728880 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23603bb6-9262-4d31-9289-3366f461eed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:02.730507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23603bb6-9262-4d31-9289-3366f461eed5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:02.741377 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1005/1997] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:02.745223 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96ea38-4bbd-417c-8e71-37b63c332991 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:02.755727 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96ea38-4bbd-417c-8e71-37b63c332991 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:02.760363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d85ce-1fd5-4a3c-9903-dcfbc5ed6543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:02.761016 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d85ce-1fd5-4a3c-9903-dcfbc5ed6543 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:02.761294 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d85ce-1fd5-4a3c-9903-dcfbc5ed6543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:02.761595 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d85ce-1fd5-4a3c-9903-dcfbc5ed6543 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:02.762367 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d85ce-1fd5-4a3c-9903-dcfbc5ed6543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:02.764067 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d85ce-1fd5-4a3c-9903-dcfbc5ed6543 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:02.774277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 993/1998] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:02.778266 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23603bb6-9262-4d31-9289-3366f461eed5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:02.788177 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23603bb6-9262-4d31-9289-3366f461eed5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:02.792949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f24468-9573-40cd-a42c-c7e711c007b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:02.793841 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f24468-9573-40cd-a42c-c7e711c007b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:02.794267 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f24468-9573-40cd-a42c-c7e711c007b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:02.794444 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f24468-9573-40cd-a42c-c7e711c007b4 admin admin] PATH_INFO: `/v3/projects/13a97edaa5c64af993a167be7d499771/users/1652c5cc8fc047f0b66521291bac424c/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:02.810543 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f24468-9573-40cd-a42c-c7e711c007b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a97edaa5c64af993a167be7d499771, user_id=1652c5cc8fc047f0b66521291bac424c, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:02.813861 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f24468-9573-40cd-a42c-c7e711c007b4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:02.826885 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1006/1999] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:02 2021] PUT /identity/v3/projects/13a97edaa5c64af993a167be7d499771/users/1652c5cc8fc047f0b66521291bac424c/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:02.837892 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fd290-1603-4511-ba6e-261969b04b83 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:02.838216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fd290-1603-4511-ba6e-261969b04b83 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:02.838499 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fd290-1603-4511-ba6e-261969b04b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:02.866823 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-439fd290-1603-4511-ba6e-261969b04b83 None None] MFA Rules not processed for user `1652c5cc8fc047f0b66521291bac424c`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:02.868533 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-439fd290-1603-4511-ba6e-261969b04b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:02.935884 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 994/2000] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:02 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:02.948037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f24468-9573-40cd-a42c-c7e711c007b4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:02.949663 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-44f24468-9573-40cd-a42c-c7e711c007b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:03.022453 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f24468-9573-40cd-a42c-c7e711c007b4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:03.026432 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c397a7-30a1-4ef8-b7db-2e830b1bb964 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48dcc22c7df4aed8fa6cf32e3c2ec51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:03.027161 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c397a7-30a1-4ef8-b7db-2e830b1bb964 service glance] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:03.027444 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c397a7-30a1-4ef8-b7db-2e830b1bb964 service glance] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:03.027716 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c397a7-30a1-4ef8-b7db-2e830b1bb964 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:03.038672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c397a7-30a1-4ef8-b7db-2e830b1bb964 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:03.040125 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c397a7-30a1-4ef8-b7db-2e830b1bb964 service glance] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:03.050101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1007/2001] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:02 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:14.057170 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fd290-1603-4511-ba6e-261969b04b83 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:14.058777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-439fd290-1603-4511-ba6e-261969b04b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:14.127682 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fd290-1603-4511-ba6e-261969b04b83 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:14.132394 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838f350-b3fd-45b9-b98b-e93faaea02b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:14.133282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838f350-b3fd-45b9-b98b-e93faaea02b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:14.133567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838f350-b3fd-45b9-b98b-e93faaea02b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:14.133842 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838f350-b3fd-45b9-b98b-e93faaea02b9 admin admin] PATH_INFO: `/v3/users/d2f15941036a490ea7842433a24a7029` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:14.135107 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838f350-b3fd-45b9-b98b-e93faaea02b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f15941036a490ea7842433a24a7029)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:14.137014 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838f350-b3fd-45b9-b98b-e93faaea02b9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:14.182147 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2838f350-b3fd-45b9-b98b-e93faaea02b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f15941036a490ea7842433a24a7029'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:14.193655 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2838f350-b3fd-45b9-b98b-e93faaea02b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f15941036a490ea7842433a24a7029'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:14.201336 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2838f350-b3fd-45b9-b98b-e93faaea02b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f15941036a490ea7842433a24a7029'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:14.209072 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2838f350-b3fd-45b9-b98b-e93faaea02b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f15941036a490ea7842433a24a7029'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:14.209659 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2838f350-b3fd-45b9-b98b-e93faaea02b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f15941036a490ea7842433a24a7029'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:14.215367 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 995/2002] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:14 2021] DELETE /identity/v3/users/d2f15941036a490ea7842433a24a7029 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:14.219816 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35303167-4dee-4fe6-a0ee-1c577fd6e4bd None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:14.220236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35303167-4dee-4fe6-a0ee-1c577fd6e4bd None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:14.220375 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35303167-4dee-4fe6-a0ee-1c577fd6e4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:14.237041 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-35303167-4dee-4fe6-a0ee-1c577fd6e4bd None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:14.238232 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-35303167-4dee-4fe6-a0ee-1c577fd6e4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:14.294069 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1008/2003] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:14.303860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838f350-b3fd-45b9-b98b-e93faaea02b9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:14.305259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-2838f350-b3fd-45b9-b98b-e93faaea02b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:14.359673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838f350-b3fd-45b9-b98b-e93faaea02b9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:14.363249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec8542-5531-49d2-b9a9-f52082a52e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:14.363874 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec8542-5531-49d2-b9a9-f52082a52e03 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:14.364152 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec8542-5531-49d2-b9a9-f52082a52e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:14.364419 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec8542-5531-49d2-b9a9-f52082a52e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:14.373196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec8542-5531-49d2-b9a9-f52082a52e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:14.374633 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec8542-5531-49d2-b9a9-f52082a52e03 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:14.384007 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 996/2004] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:14.649740 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35303167-4dee-4fe6-a0ee-1c577fd6e4bd None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:14.651422 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-35303167-4dee-4fe6-a0ee-1c577fd6e4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:14.663797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35303167-4dee-4fe6-a0ee-1c577fd6e4bd None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:14.675767 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b8737-022a-4483-8086-944811491b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:14.676856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b8737-022a-4483-8086-944811491b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:14.677135 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b8737-022a-4483-8086-944811491b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:14.677475 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b8737-022a-4483-8086-944811491b61 admin admin] PATH_INFO: `/v3/projects/df4897d6c77544acaa0ad144e70cb582` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:14.678811 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b8737-022a-4483-8086-944811491b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df4897d6c77544acaa0ad144e70cb582)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:14.680631 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b8737-022a-4483-8086-944811491b61 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:14.731187 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-712b8737-022a-4483-8086-944811491b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df4897d6c77544acaa0ad144e70cb582', 'request_id': 'req-712b8737-022a-4483-8086-944811491b61'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:14.738637 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-712b8737-022a-4483-8086-944811491b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df4897d6c77544acaa0ad144e70cb582', 'request_id': 'req-712b8737-022a-4483-8086-944811491b61'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:14.744636 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-712b8737-022a-4483-8086-944811491b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df4897d6c77544acaa0ad144e70cb582', 'request_id': 'req-712b8737-022a-4483-8086-944811491b61'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:14.755637 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-712b8737-022a-4483-8086-944811491b61 admin admin] The token cache is being invalidate because project df4897d6c77544acaa0ad144e70cb582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:14.755922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-712b8737-022a-4483-8086-944811491b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:14.756545 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-712b8737-022a-4483-8086-944811491b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:14.758090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1009/2005] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:14 2021] DELETE /identity/v3/projects/df4897d6c77544acaa0ad144e70cb582 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:14.762059 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec8542-5531-49d2-b9a9-f52082a52e03 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:14.771398 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec8542-5531-49d2-b9a9-f52082a52e03 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:14.825901 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890f53b-023b-4f9f-aaef-b83a859237ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:14.826773 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890f53b-023b-4f9f-aaef-b83a859237ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:14.827055 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890f53b-023b-4f9f-aaef-b83a859237ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:14.827332 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890f53b-023b-4f9f-aaef-b83a859237ab admin admin] PATH_INFO: `/v3/users/d8445a12034943e689101c1848347bb2` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:14.828558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890f53b-023b-4f9f-aaef-b83a859237ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8445a12034943e689101c1848347bb2)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:14.830507 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890f53b-023b-4f9f-aaef-b83a859237ab admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:14.888382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7890f53b-023b-4f9f-aaef-b83a859237ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8445a12034943e689101c1848347bb2'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:14.899852 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7890f53b-023b-4f9f-aaef-b83a859237ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8445a12034943e689101c1848347bb2'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:14.908437 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7890f53b-023b-4f9f-aaef-b83a859237ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8445a12034943e689101c1848347bb2'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:14.914482 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7890f53b-023b-4f9f-aaef-b83a859237ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8445a12034943e689101c1848347bb2'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:14.915104 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7890f53b-023b-4f9f-aaef-b83a859237ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8445a12034943e689101c1848347bb2'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:14.920732 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 997/2006] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:14 2021] DELETE /identity/v3/users/d8445a12034943e689101c1848347bb2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:04:15.204783 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b8737-022a-4483-8086-944811491b61 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:15.206362 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-712b8737-022a-4483-8086-944811491b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:15.221871 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b8737-022a-4483-8086-944811491b61 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:15.284899 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22850d66-f5fd-4c74-a9e6-a0a2697e75ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:15.285759 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22850d66-f5fd-4c74-a9e6-a0a2697e75ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:15.286070 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22850d66-f5fd-4c74-a9e6-a0a2697e75ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:15.286343 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22850d66-f5fd-4c74-a9e6-a0a2697e75ce admin admin] PATH_INFO: `/v3/projects/2cc4607857704d06b713aa2e2986e048` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:15.287565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22850d66-f5fd-4c74-a9e6-a0a2697e75ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc4607857704d06b713aa2e2986e048)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:15.289442 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22850d66-f5fd-4c74-a9e6-a0a2697e75ce admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:15.334108 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-22850d66-f5fd-4c74-a9e6-a0a2697e75ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc4607857704d06b713aa2e2986e048', 'request_id': 'req-22850d66-f5fd-4c74-a9e6-a0a2697e75ce'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:15.341391 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-22850d66-f5fd-4c74-a9e6-a0a2697e75ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc4607857704d06b713aa2e2986e048', 'request_id': 'req-22850d66-f5fd-4c74-a9e6-a0a2697e75ce'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:15.348135 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-22850d66-f5fd-4c74-a9e6-a0a2697e75ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc4607857704d06b713aa2e2986e048', 'request_id': 'req-22850d66-f5fd-4c74-a9e6-a0a2697e75ce'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:15.357895 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-22850d66-f5fd-4c74-a9e6-a0a2697e75ce admin admin] The token cache is being invalidate because project 2cc4607857704d06b713aa2e2986e048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:15.358206 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-22850d66-f5fd-4c74-a9e6-a0a2697e75ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:15.358821 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-22850d66-f5fd-4c74-a9e6-a0a2697e75ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:15.360384 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1010/2007] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:15 2021] DELETE /identity/v3/projects/2cc4607857704d06b713aa2e2986e048 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:15.366059 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6d23e-8887-433d-895e-ce834bfe6ad0 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:15.366519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6d23e-8887-433d-895e-ce834bfe6ad0 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:15.366643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6d23e-8887-433d-895e-ce834bfe6ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:15.383905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-0bc6d23e-8887-433d-895e-ce834bfe6ad0 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:15.385233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0bc6d23e-8887-433d-895e-ce834bfe6ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:15.443248 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 998/2008] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:15.451219 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86417c4a-1415-4c92-8648-93d576e0f55c None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:15.451512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86417c4a-1415-4c92-8648-93d576e0f55c None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:15.451796 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86417c4a-1415-4c92-8648-93d576e0f55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:15.470920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-86417c4a-1415-4c92-8648-93d576e0f55c None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:15.472104 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-86417c4a-1415-4c92-8648-93d576e0f55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:15.479785 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1011/2009] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:15.483788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6d23e-8887-433d-895e-ce834bfe6ad0 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:15.493164 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6d23e-8887-433d-895e-ce834bfe6ad0 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:15.497927 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d12cbf-cb4f-4c5a-b9e8-1c5e97ce9b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:15.498624 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d12cbf-cb4f-4c5a-b9e8-1c5e97ce9b7b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:15.498907 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d12cbf-cb4f-4c5a-b9e8-1c5e97ce9b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:15.499181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d12cbf-cb4f-4c5a-b9e8-1c5e97ce9b7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:15.499906 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d12cbf-cb4f-4c5a-b9e8-1c5e97ce9b7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:04:15.500237 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d12cbf-cb4f-4c5a-b9e8-1c5e97ce9b7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:15.501817 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d12cbf-cb4f-4c5a-b9e8-1c5e97ce9b7b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:15.512790 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 999/2010] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:04:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:04:15.517385 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86417c4a-1415-4c92-8648-93d576e0f55c None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:15.526189 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86417c4a-1415-4c92-8648-93d576e0f55c None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:15.530790 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e42a-5b17-4d51-a035-ae061c831b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:15.531480 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e42a-5b17-4d51-a035-ae061c831b0b admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:15.532258 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e42a-5b17-4d51-a035-ae061c831b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:15.532530 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e42a-5b17-4d51-a035-ae061c831b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:15.533235 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943e42a-5b17-4d51-a035-ae061c831b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:15.535158 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943e42a-5b17-4d51-a035-ae061c831b0b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:15.559851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1012/2011] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:15 2021] POST /identity/v3/projects => generated 357 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:15.564635 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d12cbf-cb4f-4c5a-b9e8-1c5e97ce9b7b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:15.574042 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d12cbf-cb4f-4c5a-b9e8-1c5e97ce9b7b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:15.634104 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac406fb2-38ee-4814-8d3c-5e553ca771a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:15.634765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac406fb2-38ee-4814-8d3c-5e553ca771a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:15.635044 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac406fb2-38ee-4814-8d3c-5e553ca771a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:15.635313 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac406fb2-38ee-4814-8d3c-5e553ca771a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:15.636007 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac406fb2-38ee-4814-8d3c-5e553ca771a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:15.637947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac406fb2-38ee-4814-8d3c-5e553ca771a6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:15.659089 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1000/2012] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:15 2021] POST /identity/v3/users => generated 279 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:15.663178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e42a-5b17-4d51-a035-ae061c831b0b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:15.673204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e42a-5b17-4d51-a035-ae061c831b0b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:15.678116 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff17af8-d1ea-415c-aa5b-df6d2e2bfe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:15.678780 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff17af8-d1ea-415c-aa5b-df6d2e2bfe0a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:15.679083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff17af8-d1ea-415c-aa5b-df6d2e2bfe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:15.679576 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff17af8-d1ea-415c-aa5b-df6d2e2bfe0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:15.680316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff17af8-d1ea-415c-aa5b-df6d2e2bfe0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:15.681918 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff17af8-d1ea-415c-aa5b-df6d2e2bfe0a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:15.693797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1013/2013] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:04:15.697626 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac406fb2-38ee-4814-8d3c-5e553ca771a6 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:15.708235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac406fb2-38ee-4814-8d3c-5e553ca771a6 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:15.712792 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25be277-dd6d-4904-925f-7429506c7be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:15.713439 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25be277-dd6d-4904-925f-7429506c7be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:15.713723 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25be277-dd6d-4904-925f-7429506c7be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:15.714059 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25be277-dd6d-4904-925f-7429506c7be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:15.714828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25be277-dd6d-4904-925f-7429506c7be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:15.716518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25be277-dd6d-4904-925f-7429506c7be4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:15.726559 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1001/2014] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:15 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:15.735992 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff17af8-d1ea-415c-aa5b-df6d2e2bfe0a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:15.746236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff17af8-d1ea-415c-aa5b-df6d2e2bfe0a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:15.751804 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8e121-597e-4d3f-a911-509d741f262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:15.752767 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e121-597e-4d3f-a911-509d741f262b admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:15.753051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e121-597e-4d3f-a911-509d741f262b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:15.753328 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e121-597e-4d3f-a911-509d741f262b admin admin] PATH_INFO: `/v3/projects/ffbd188d3a1c4a969377d90c550e8ab9/users/54e6dde0be214b7ca022d8322f92be8a/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:15.769227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8e121-597e-4d3f-a911-509d741f262b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffbd188d3a1c4a969377d90c550e8ab9, user_id=54e6dde0be214b7ca022d8322f92be8a, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:15.771895 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8e121-597e-4d3f-a911-509d741f262b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:15.785858 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1014/2015] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:15 2021] PUT /identity/v3/projects/ffbd188d3a1c4a969377d90c550e8ab9/users/54e6dde0be214b7ca022d8322f92be8a/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:15.795873 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29055c5-0296-449b-bdf6-b4b7045c0c02 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:15.796163 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29055c5-0296-449b-bdf6-b4b7045c0c02 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:15.796442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29055c5-0296-449b-bdf6-b4b7045c0c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:15.822115 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-a29055c5-0296-449b-bdf6-b4b7045c0c02 None None] MFA Rules not processed for user `54e6dde0be214b7ca022d8322f92be8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:15.823292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-a29055c5-0296-449b-bdf6-b4b7045c0c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:15.889805 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1002/2016] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:15 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:15.894638 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8e121-597e-4d3f-a911-509d741f262b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:15.963390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8e121-597e-4d3f-a911-509d741f262b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:15.968128 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e674a-4889-47cb-943b-8653012c8521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:15.968779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e674a-4889-47cb-943b-8653012c8521 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:15.969056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e674a-4889-47cb-943b-8653012c8521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:15.969326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e674a-4889-47cb-943b-8653012c8521 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:15.970082 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e674a-4889-47cb-943b-8653012c8521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:15.971962 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e674a-4889-47cb-943b-8653012c8521 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:15.997801 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1015/2017] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:15 2021] POST /identity/v3/projects => generated 355 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:16.002361 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29055c5-0296-449b-bdf6-b4b7045c0c02 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:16.012992 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29055c5-0296-449b-bdf6-b4b7045c0c02 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:16.066437 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a14c28-f9de-4a25-91fe-89b55a794e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:16.067127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a14c28-f9de-4a25-91fe-89b55a794e7c admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:16.067407 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a14c28-f9de-4a25-91fe-89b55a794e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:16.067706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a14c28-f9de-4a25-91fe-89b55a794e7c admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:16.068397 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a14c28-f9de-4a25-91fe-89b55a794e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:16.070321 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a14c28-f9de-4a25-91fe-89b55a794e7c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:16.089475 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1003/2018] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:16 2021] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:16.093438 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e674a-4889-47cb-943b-8653012c8521 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:16.103290 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e674a-4889-47cb-943b-8653012c8521 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:16.107748 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432b2f3-d5d2-4d3d-a617-1d58eb0a1e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:16.108392 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432b2f3-d5d2-4d3d-a617-1d58eb0a1e08 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:16.108672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432b2f3-d5d2-4d3d-a617-1d58eb0a1e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:16.108949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432b2f3-d5d2-4d3d-a617-1d58eb0a1e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:16.110210 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432b2f3-d5d2-4d3d-a617-1d58eb0a1e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:16.111778 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432b2f3-d5d2-4d3d-a617-1d58eb0a1e08 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:16.121809 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1016/2019] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:16 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:16.126528 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a14c28-f9de-4a25-91fe-89b55a794e7c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:16.136062 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a14c28-f9de-4a25-91fe-89b55a794e7c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:16.140578 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbed45a-bdf7-4ce1-9078-03edeed403aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:16.141455 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbed45a-bdf7-4ce1-9078-03edeed403aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:16.141737 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbed45a-bdf7-4ce1-9078-03edeed403aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:16.142042 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbed45a-bdf7-4ce1-9078-03edeed403aa admin admin] PATH_INFO: `/v3/projects/e3c67201ad034d51ad678108fe715999/users/bf4cc52280d24d17878182b2676e4253/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:16.155807 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbed45a-bdf7-4ce1-9078-03edeed403aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c67201ad034d51ad678108fe715999, user_id=bf4cc52280d24d17878182b2676e4253, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:16.158472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbed45a-bdf7-4ce1-9078-03edeed403aa admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:16.171113 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1004/2020] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:16 2021] PUT /identity/v3/projects/e3c67201ad034d51ad678108fe715999/users/bf4cc52280d24d17878182b2676e4253/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:16.175438 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432b2f3-d5d2-4d3d-a617-1d58eb0a1e08 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:16.185088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432b2f3-d5d2-4d3d-a617-1d58eb0a1e08 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:16.239332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e5409-ed31-4001-8ff9-33c5767d036e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:16.239990 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e5409-ed31-4001-8ff9-33c5767d036e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:16.240275 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e5409-ed31-4001-8ff9-33c5767d036e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:16.240553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e5409-ed31-4001-8ff9-33c5767d036e admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:16.241284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e5409-ed31-4001-8ff9-33c5767d036e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:16.242900 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e5409-ed31-4001-8ff9-33c5767d036e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:16.253249 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1017/2021] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:16 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:04:16.257360 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbed45a-bdf7-4ce1-9078-03edeed403aa admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:16.267406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbed45a-bdf7-4ce1-9078-03edeed403aa admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:16.272267 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b82f93-3f03-410a-b2ec-68a3fbaec687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:16.273198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b82f93-3f03-410a-b2ec-68a3fbaec687 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:16.273481 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b82f93-3f03-410a-b2ec-68a3fbaec687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:16.273760 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b82f93-3f03-410a-b2ec-68a3fbaec687 admin admin] PATH_INFO: `/v3/projects/e3c67201ad034d51ad678108fe715999/users/bf4cc52280d24d17878182b2676e4253/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:16.275792 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b82f93-3f03-410a-b2ec-68a3fbaec687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c67201ad034d51ad678108fe715999, user_id=bf4cc52280d24d17878182b2676e4253, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:16.278544 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b82f93-3f03-410a-b2ec-68a3fbaec687 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:16.289114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1005/2022] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:16 2021] PUT /identity/v3/projects/e3c67201ad034d51ad678108fe715999/users/bf4cc52280d24d17878182b2676e4253/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:16.300420 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ff2dd-64f4-491b-8512-b54e355b9d3e None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:16.300711 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ff2dd-64f4-491b-8512-b54e355b9d3e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:16.300992 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ff2dd-64f4-491b-8512-b54e355b9d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:16.327280 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-797ff2dd-64f4-491b-8512-b54e355b9d3e None None] MFA Rules not processed for user `bf4cc52280d24d17878182b2676e4253`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:16.328472 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-797ff2dd-64f4-491b-8512-b54e355b9d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:16.393217 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1018/2023] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:16 2021] POST /identity/v3/auth/tokens => generated 3289 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:16.403790 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b82f93-3f03-410a-b2ec-68a3fbaec687 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:16.405664 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f4b82f93-3f03-410a-b2ec-68a3fbaec687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:16.462509 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b82f93-3f03-410a-b2ec-68a3fbaec687 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:16.466476 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347e009-1dde-41bf-857c-2d49a4b1bbd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:16.467124 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347e009-1dde-41bf-857c-2d49a4b1bbd7 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:16.467405 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347e009-1dde-41bf-857c-2d49a4b1bbd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:16.467683 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347e009-1dde-41bf-857c-2d49a4b1bbd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:16.477167 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347e009-1dde-41bf-857c-2d49a4b1bbd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:16.478641 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347e009-1dde-41bf-857c-2d49a4b1bbd7 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:16.488517 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1006/2024] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:16 2021] GET /identity/v3/auth/tokens => generated 3289 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:16.556894 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ff2dd-64f4-491b-8512-b54e355b9d3e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:16.566191 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ff2dd-64f4-491b-8512-b54e355b9d3e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:16.569769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b25bf-37b0-4072-90fe-9d901fa7cc6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:16.570435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b25bf-37b0-4072-90fe-9d901fa7cc6f service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:16.570719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b25bf-37b0-4072-90fe-9d901fa7cc6f service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:16.570994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b25bf-37b0-4072-90fe-9d901fa7cc6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:16.627219 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b25bf-37b0-4072-90fe-9d901fa7cc6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:16.628644 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b25bf-37b0-4072-90fe-9d901fa7cc6f service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:16.637261 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1019/2025] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:16 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:18.101392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347e009-1dde-41bf-857c-2d49a4b1bbd7 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:18.102880 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-a347e009-1dde-41bf-857c-2d49a4b1bbd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:18.173615 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347e009-1dde-41bf-857c-2d49a4b1bbd7 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:18.178491 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e052e-d5be-4f69-803b-3377d2c0f234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:18.180310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e052e-d5be-4f69-803b-3377d2c0f234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:18.180591 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e052e-d5be-4f69-803b-3377d2c0f234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:18.180864 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e052e-d5be-4f69-803b-3377d2c0f234 admin admin] PATH_INFO: `/v3/users/bd9b083428ce46c496c85bd4e15dd463` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:18.182174 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e052e-d5be-4f69-803b-3377d2c0f234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd9b083428ce46c496c85bd4e15dd463)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:18.184003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e052e-d5be-4f69-803b-3377d2c0f234 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:18.237439 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-9e5e052e-d5be-4f69-803b-3377d2c0f234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd9b083428ce46c496c85bd4e15dd463'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:18.248946 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-9e5e052e-d5be-4f69-803b-3377d2c0f234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd9b083428ce46c496c85bd4e15dd463'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:18.257227 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-9e5e052e-d5be-4f69-803b-3377d2c0f234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd9b083428ce46c496c85bd4e15dd463'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:18.264752 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-9e5e052e-d5be-4f69-803b-3377d2c0f234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd9b083428ce46c496c85bd4e15dd463'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:18.265400 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-9e5e052e-d5be-4f69-803b-3377d2c0f234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd9b083428ce46c496c85bd4e15dd463'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:18.271185 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1007/2026] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:18 2021] DELETE /identity/v3/users/bd9b083428ce46c496c85bd4e15dd463 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:18.275766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa34e-9a9f-4dc5-b7bd-aae845d57690 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:18.276215 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa34e-9a9f-4dc5-b7bd-aae845d57690 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:18.276302 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa34e-9a9f-4dc5-b7bd-aae845d57690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:18.294499 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-dd0aa34e-9a9f-4dc5-b7bd-aae845d57690 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:18.295628 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-dd0aa34e-9a9f-4dc5-b7bd-aae845d57690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:18.356632 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1020/2027] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:18.370637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e052e-d5be-4f69-803b-3377d2c0f234 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:18.372404 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9e5e052e-d5be-4f69-803b-3377d2c0f234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:18.431763 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e052e-d5be-4f69-803b-3377d2c0f234 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:18.435422 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c4d3c-0d6d-4409-a1fd-9f35004416e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:18.436057 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4d3c-0d6d-4409-a1fd-9f35004416e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:18.436337 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4d3c-0d6d-4409-a1fd-9f35004416e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:18.436611 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4d3c-0d6d-4409-a1fd-9f35004416e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:18.446175 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c4d3c-0d6d-4409-a1fd-9f35004416e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:18.447599 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c4d3c-0d6d-4409-a1fd-9f35004416e0 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:18.456760 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1008/2028] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:18.716527 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0aa34e-9a9f-4dc5-b7bd-aae845d57690 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:18.717959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-dd0aa34e-9a9f-4dc5-b7bd-aae845d57690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:18.731540 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0aa34e-9a9f-4dc5-b7bd-aae845d57690 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:18.740910 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f453f-b571-4884-a265-003444eeea2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:18.741780 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f453f-b571-4884-a265-003444eeea2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:18.742095 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f453f-b571-4884-a265-003444eeea2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:18.742380 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f453f-b571-4884-a265-003444eeea2a admin admin] PATH_INFO: `/v3/projects/7341f37fb50e44c497aa8049ad85662a` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:18.743548 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f453f-b571-4884-a265-003444eeea2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7341f37fb50e44c497aa8049ad85662a)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:18.745616 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f453f-b571-4884-a265-003444eeea2a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:18.793484 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-648f453f-b571-4884-a265-003444eeea2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7341f37fb50e44c497aa8049ad85662a', 'request_id': 'req-648f453f-b571-4884-a265-003444eeea2a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:18.802128 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-648f453f-b571-4884-a265-003444eeea2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7341f37fb50e44c497aa8049ad85662a', 'request_id': 'req-648f453f-b571-4884-a265-003444eeea2a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:18.808546 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-648f453f-b571-4884-a265-003444eeea2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7341f37fb50e44c497aa8049ad85662a', 'request_id': 'req-648f453f-b571-4884-a265-003444eeea2a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:18.818854 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-648f453f-b571-4884-a265-003444eeea2a admin admin] The token cache is being invalidate because project 7341f37fb50e44c497aa8049ad85662a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:18.819142 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-648f453f-b571-4884-a265-003444eeea2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:18.819782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-648f453f-b571-4884-a265-003444eeea2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:18.821312 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1021/2029] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:18 2021] DELETE /identity/v3/projects/7341f37fb50e44c497aa8049ad85662a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:18.826909 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fccf3-859f-4d0a-9f02-3892649d05f8 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:18.827196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fccf3-859f-4d0a-9f02-3892649d05f8 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:18.827472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fccf3-859f-4d0a-9f02-3892649d05f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:18.853316 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-d62fccf3-859f-4d0a-9f02-3892649d05f8 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:18.854677 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d62fccf3-859f-4d0a-9f02-3892649d05f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:18.933894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1009/2030] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:18.944020 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31429b0e-df7c-49c2-b0cb-4ad2f4c54167 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:18.944403 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31429b0e-df7c-49c2-b0cb-4ad2f4c54167 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:18.944686 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31429b0e-df7c-49c2-b0cb-4ad2f4c54167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:18.963972 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-31429b0e-df7c-49c2-b0cb-4ad2f4c54167 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:18.965184 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-31429b0e-df7c-49c2-b0cb-4ad2f4c54167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:18.973135 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1022/2031] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:18.977553 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fccf3-859f-4d0a-9f02-3892649d05f8 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:18.988023 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fccf3-859f-4d0a-9f02-3892649d05f8 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:18.992905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87036fd-7feb-40f6-afaa-44b2bfba2785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:18.993798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87036fd-7feb-40f6-afaa-44b2bfba2785 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:18.994161 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87036fd-7feb-40f6-afaa-44b2bfba2785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:18.994435 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87036fd-7feb-40f6-afaa-44b2bfba2785 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:18.995190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87036fd-7feb-40f6-afaa-44b2bfba2785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:04:18.995766 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87036fd-7feb-40f6-afaa-44b2bfba2785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:18.997598 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87036fd-7feb-40f6-afaa-44b2bfba2785 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:19.011261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1010/2032] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:04:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:04:19.018597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31429b0e-df7c-49c2-b0cb-4ad2f4c54167 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:19.028945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31429b0e-df7c-49c2-b0cb-4ad2f4c54167 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:19.033902 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bbfea-597d-4b5d-ba15-986da311ceaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:19.034609 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bbfea-597d-4b5d-ba15-986da311ceaf admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:19.034894 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bbfea-597d-4b5d-ba15-986da311ceaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:19.035173 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bbfea-597d-4b5d-ba15-986da311ceaf admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:19.035926 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bbfea-597d-4b5d-ba15-986da311ceaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:19.037820 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bbfea-597d-4b5d-ba15-986da311ceaf admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:19.084090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1023/2033] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:19 2021] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:19.088870 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87036fd-7feb-40f6-afaa-44b2bfba2785 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:19.099807 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87036fd-7feb-40f6-afaa-44b2bfba2785 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:19.178543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db8c9-5d4c-4e07-acff-da8c387a7c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:19.180083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db8c9-5d4c-4e07-acff-da8c387a7c5b admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:19.180811 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db8c9-5d4c-4e07-acff-da8c387a7c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:19.181465 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db8c9-5d4c-4e07-acff-da8c387a7c5b admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:19.182377 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245db8c9-5d4c-4e07-acff-da8c387a7c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:19.184856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245db8c9-5d4c-4e07-acff-da8c387a7c5b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:19.225695 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1011/2034] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:19 2021] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:19.226816 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bbfea-597d-4b5d-ba15-986da311ceaf admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:19.239832 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bbfea-597d-4b5d-ba15-986da311ceaf admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:19.246338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c50d1-d1fd-4e1b-9da9-f706b33833bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:19.247264 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c50d1-d1fd-4e1b-9da9-f706b33833bc admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:19.247550 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c50d1-d1fd-4e1b-9da9-f706b33833bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:19.247877 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c50d1-d1fd-4e1b-9da9-f706b33833bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:19.248676 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c50d1-d1fd-4e1b-9da9-f706b33833bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:19.251053 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c50d1-d1fd-4e1b-9da9-f706b33833bc admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:19.265768 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1024/2035] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:19 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:04:19.269819 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db8c9-5d4c-4e07-acff-da8c387a7c5b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:19.285727 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db8c9-5d4c-4e07-acff-da8c387a7c5b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:19.293934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fcd38-b58e-4cff-903b-d0ee6c7ab594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:19.295245 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fcd38-b58e-4cff-903b-d0ee6c7ab594 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:19.295724 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fcd38-b58e-4cff-903b-d0ee6c7ab594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:19.297942 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fcd38-b58e-4cff-903b-d0ee6c7ab594 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:19.298766 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fcd38-b58e-4cff-903b-d0ee6c7ab594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:19.300611 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fcd38-b58e-4cff-903b-d0ee6c7ab594 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:19.320952 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1012/2036] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:19 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:19.322121 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c50d1-d1fd-4e1b-9da9-f706b33833bc admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:19.335574 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c50d1-d1fd-4e1b-9da9-f706b33833bc admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:19.342372 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b94d8d-ea20-4e57-ab58-c0468cabb6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:19.343273 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b94d8d-ea20-4e57-ab58-c0468cabb6d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:19.343719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b94d8d-ea20-4e57-ab58-c0468cabb6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:19.344683 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b94d8d-ea20-4e57-ab58-c0468cabb6d4 admin admin] PATH_INFO: `/v3/projects/8898601d1a3c4e7a9521227e6b95da4c/users/8823c7d913324ea0983e0945df10aa0f/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:19.372966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b94d8d-ea20-4e57-ab58-c0468cabb6d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8898601d1a3c4e7a9521227e6b95da4c, user_id=8823c7d913324ea0983e0945df10aa0f, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:19.375692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b94d8d-ea20-4e57-ab58-c0468cabb6d4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:19.390451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1025/2037] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:19 2021] PUT /identity/v3/projects/8898601d1a3c4e7a9521227e6b95da4c/users/8823c7d913324ea0983e0945df10aa0f/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:19.401727 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7482a-0d3d-4ac6-b581-ea4a12b72bd5 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:19.402035 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7482a-0d3d-4ac6-b581-ea4a12b72bd5 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:19.402545 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7482a-0d3d-4ac6-b581-ea4a12b72bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:19.448870 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-25a7482a-0d3d-4ac6-b581-ea4a12b72bd5 None None] MFA Rules not processed for user `8823c7d913324ea0983e0945df10aa0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:19.448870 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-25a7482a-0d3d-4ac6-b581-ea4a12b72bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:19.538472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1013/2038] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:19 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:19.543302 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b94d8d-ea20-4e57-ab58-c0468cabb6d4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:19.645964 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b94d8d-ea20-4e57-ab58-c0468cabb6d4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:19.652728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26880f-ca85-470b-990a-8ceedafae0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:19.653859 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26880f-ca85-470b-990a-8ceedafae0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:19.654235 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26880f-ca85-470b-990a-8ceedafae0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:19.654576 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26880f-ca85-470b-990a-8ceedafae0e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:19.655369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26880f-ca85-470b-990a-8ceedafae0e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:19.658432 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26880f-ca85-470b-990a-8ceedafae0e3 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:19.694593 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1026/2039] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:19 2021] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:04:19.698337 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7482a-0d3d-4ac6-b581-ea4a12b72bd5 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:19.711064 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7482a-0d3d-4ac6-b581-ea4a12b72bd5 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:19.766292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944296c-0673-4efe-99ab-4746089a0752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:19.767035 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944296c-0673-4efe-99ab-4746089a0752 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:19.767318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944296c-0673-4efe-99ab-4746089a0752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:19.767592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944296c-0673-4efe-99ab-4746089a0752 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:19.768296 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944296c-0673-4efe-99ab-4746089a0752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:19.770221 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944296c-0673-4efe-99ab-4746089a0752 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:19.790756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1014/2040] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:19 2021] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:19.794958 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26880f-ca85-470b-990a-8ceedafae0e3 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:19.805912 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26880f-ca85-470b-990a-8ceedafae0e3 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:19.810489 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744cbcc-3ae4-42bf-bf75-6400bcbe60e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:19.811134 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744cbcc-3ae4-42bf-bf75-6400bcbe60e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:19.811415 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744cbcc-3ae4-42bf-bf75-6400bcbe60e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:19.811689 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744cbcc-3ae4-42bf-bf75-6400bcbe60e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:19.812430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744cbcc-3ae4-42bf-bf75-6400bcbe60e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:19.814003 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744cbcc-3ae4-42bf-bf75-6400bcbe60e0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:19.824821 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1027/2041] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:19.829802 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944296c-0673-4efe-99ab-4746089a0752 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:19.839358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944296c-0673-4efe-99ab-4746089a0752 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:19.844427 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcfc65-ef5d-432c-b2a6-79775253ba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:19.845077 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcfc65-ef5d-432c-b2a6-79775253ba77 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:19.845356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcfc65-ef5d-432c-b2a6-79775253ba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:19.845627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcfc65-ef5d-432c-b2a6-79775253ba77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:19.846414 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcfc65-ef5d-432c-b2a6-79775253ba77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:19.847985 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcfc65-ef5d-432c-b2a6-79775253ba77 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:19.857730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1015/2042] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:19 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:04:19.861630 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744cbcc-3ae4-42bf-bf75-6400bcbe60e0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:19.871450 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744cbcc-3ae4-42bf-bf75-6400bcbe60e0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:19.876676 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cc1f5-708e-44bf-83fe-15ce189fbd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:19.877572 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cc1f5-708e-44bf-83fe-15ce189fbd8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:19.877852 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cc1f5-708e-44bf-83fe-15ce189fbd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:19.878173 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cc1f5-708e-44bf-83fe-15ce189fbd8f admin admin] PATH_INFO: `/v3/projects/5c465da5589040a5ae99092df3937fbe/users/b0c15fc80d70436ebd5480f0b710f67e/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:19.893535 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cc1f5-708e-44bf-83fe-15ce189fbd8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c465da5589040a5ae99092df3937fbe, user_id=b0c15fc80d70436ebd5480f0b710f67e, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:19.898547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cc1f5-708e-44bf-83fe-15ce189fbd8f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:19.912547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1028/2043] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:19 2021] PUT /identity/v3/projects/5c465da5589040a5ae99092df3937fbe/users/b0c15fc80d70436ebd5480f0b710f67e/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:19.923282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b26b9d-5062-4521-95b6-2b90b3128978 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:19.923568 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b26b9d-5062-4521-95b6-2b90b3128978 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:19.923923 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b26b9d-5062-4521-95b6-2b90b3128978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:19.952493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-07b26b9d-5062-4521-95b6-2b90b3128978 None None] MFA Rules not processed for user `b0c15fc80d70436ebd5480f0b710f67e`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:19.954205 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-07b26b9d-5062-4521-95b6-2b90b3128978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:20.014832 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1016/2044] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:19 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:20.019860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cc1f5-708e-44bf-83fe-15ce189fbd8f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:20.085161 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cc1f5-708e-44bf-83fe-15ce189fbd8f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:20.089800 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291d783-de3b-4e0c-a058-b3b28f234c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:20.090473 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291d783-de3b-4e0c-a058-b3b28f234c10 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:20.090751 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291d783-de3b-4e0c-a058-b3b28f234c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:20.091026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291d783-de3b-4e0c-a058-b3b28f234c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:20.091718 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291d783-de3b-4e0c-a058-b3b28f234c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:20.093669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291d783-de3b-4e0c-a058-b3b28f234c10 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:20.118902 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1029/2045] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:20 2021] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:20.123307 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b26b9d-5062-4521-95b6-2b90b3128978 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:20.134691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b26b9d-5062-4521-95b6-2b90b3128978 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:20.188957 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabceaad-b46d-41f7-8457-769c5827988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:20.189642 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabceaad-b46d-41f7-8457-769c5827988c admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:20.189894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabceaad-b46d-41f7-8457-769c5827988c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:20.190202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabceaad-b46d-41f7-8457-769c5827988c admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:20.190918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabceaad-b46d-41f7-8457-769c5827988c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:20.192828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabceaad-b46d-41f7-8457-769c5827988c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:20.213021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1017/2046] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:20 2021] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:20.217260 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291d783-de3b-4e0c-a058-b3b28f234c10 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:20.230566 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291d783-de3b-4e0c-a058-b3b28f234c10 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:20.235476 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b6ef5-aff0-4d84-a8c2-771242374950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:20.236259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6ef5-aff0-4d84-a8c2-771242374950 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:20.236722 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6ef5-aff0-4d84-a8c2-771242374950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:20.237006 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6ef5-aff0-4d84-a8c2-771242374950 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:20.237768 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b6ef5-aff0-4d84-a8c2-771242374950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:20.239619 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b6ef5-aff0-4d84-a8c2-771242374950 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:20.250919 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1030/2047] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:20 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:20.255185 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabceaad-b46d-41f7-8457-769c5827988c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:20.266656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabceaad-b46d-41f7-8457-769c5827988c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:20.270864 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad42e7-0edc-4165-9e8b-117abed4f55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:20.271730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad42e7-0edc-4165-9e8b-117abed4f55d admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:20.272008 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad42e7-0edc-4165-9e8b-117abed4f55d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:20.272282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad42e7-0edc-4165-9e8b-117abed4f55d admin admin] PATH_INFO: `/v3/projects/8e1fc18fe6d7479d93fec103a90f77b3/users/cb9584aea5c04c3884ed03eb016ec7d8/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:20.286536 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad42e7-0edc-4165-9e8b-117abed4f55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1fc18fe6d7479d93fec103a90f77b3, user_id=cb9584aea5c04c3884ed03eb016ec7d8, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:20.289150 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad42e7-0edc-4165-9e8b-117abed4f55d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:20.301051 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1018/2048] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:20 2021] PUT /identity/v3/projects/8e1fc18fe6d7479d93fec103a90f77b3/users/cb9584aea5c04c3884ed03eb016ec7d8/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:04:20.304859 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b6ef5-aff0-4d84-a8c2-771242374950 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:20.315372 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b6ef5-aff0-4d84-a8c2-771242374950 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:20.370490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c18860-c4a5-4a50-89f7-4706e3e7e7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:20.371119 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c18860-c4a5-4a50-89f7-4706e3e7e7df admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:20.371337 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c18860-c4a5-4a50-89f7-4706e3e7e7df admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:20.371611 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c18860-c4a5-4a50-89f7-4706e3e7e7df admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:20.372608 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c18860-c4a5-4a50-89f7-4706e3e7e7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:20.374221 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c18860-c4a5-4a50-89f7-4706e3e7e7df admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:20.384293 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1031/2049] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:20 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:20.388395 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad42e7-0edc-4165-9e8b-117abed4f55d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:20.398975 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad42e7-0edc-4165-9e8b-117abed4f55d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:20.403876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69577f2e-b420-4eab-9bd5-ac25cbd87db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:20.404930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69577f2e-b420-4eab-9bd5-ac25cbd87db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:20.405394 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69577f2e-b420-4eab-9bd5-ac25cbd87db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:20.405642 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69577f2e-b420-4eab-9bd5-ac25cbd87db8 admin admin] PATH_INFO: `/v3/projects/8e1fc18fe6d7479d93fec103a90f77b3/users/cb9584aea5c04c3884ed03eb016ec7d8/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:20.407702 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69577f2e-b420-4eab-9bd5-ac25cbd87db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1fc18fe6d7479d93fec103a90f77b3, user_id=cb9584aea5c04c3884ed03eb016ec7d8, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:20.410343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69577f2e-b420-4eab-9bd5-ac25cbd87db8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:20.420266 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1019/2050] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:20 2021] PUT /identity/v3/projects/8e1fc18fe6d7479d93fec103a90f77b3/users/cb9584aea5c04c3884ed03eb016ec7d8/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:04:20.432577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac6a57-a1ed-482d-bbbb-2f1b29d3600f None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:20.432869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac6a57-a1ed-482d-bbbb-2f1b29d3600f None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:20.433155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac6a57-a1ed-482d-bbbb-2f1b29d3600f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:20.459593 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a0ac6a57-a1ed-482d-bbbb-2f1b29d3600f None None] MFA Rules not processed for user `cb9584aea5c04c3884ed03eb016ec7d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:20.460790 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a0ac6a57-a1ed-482d-bbbb-2f1b29d3600f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:20.526788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1032/2051] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:20 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:20.537896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69577f2e-b420-4eab-9bd5-ac25cbd87db8 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:20.539749 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-69577f2e-b420-4eab-9bd5-ac25cbd87db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:20.595390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69577f2e-b420-4eab-9bd5-ac25cbd87db8 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:20.599075 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba80ff9-8f59-49cc-895e-62ed93dd3cf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:20.599718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba80ff9-8f59-49cc-895e-62ed93dd3cf6 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:20.599996 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba80ff9-8f59-49cc-895e-62ed93dd3cf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:20.600299 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba80ff9-8f59-49cc-895e-62ed93dd3cf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:20.657538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba80ff9-8f59-49cc-895e-62ed93dd3cf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:20.659006 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba80ff9-8f59-49cc-895e-62ed93dd3cf6 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:20.667792 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1020/2052] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:20 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:21.965797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac6a57-a1ed-482d-bbbb-2f1b29d3600f None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:21.967194 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a0ac6a57-a1ed-482d-bbbb-2f1b29d3600f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:22.036950 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac6a57-a1ed-482d-bbbb-2f1b29d3600f None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:22.043557 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e82ed-8475-4f53-950c-7fbdcad091bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:22.044447 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e82ed-8475-4f53-950c-7fbdcad091bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:22.044732 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e82ed-8475-4f53-950c-7fbdcad091bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:22.045011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e82ed-8475-4f53-950c-7fbdcad091bf admin admin] PATH_INFO: `/v3/users/f7997a390ff5491b9addf8c5be68af38` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:22.046316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e82ed-8475-4f53-950c-7fbdcad091bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7997a390ff5491b9addf8c5be68af38)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:22.048282 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e82ed-8475-4f53-950c-7fbdcad091bf admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:22.096630 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6a7e82ed-8475-4f53-950c-7fbdcad091bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7997a390ff5491b9addf8c5be68af38'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:22.111236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6a7e82ed-8475-4f53-950c-7fbdcad091bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7997a390ff5491b9addf8c5be68af38'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:22.118569 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6a7e82ed-8475-4f53-950c-7fbdcad091bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7997a390ff5491b9addf8c5be68af38'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:22.119413 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6a7e82ed-8475-4f53-950c-7fbdcad091bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7997a390ff5491b9addf8c5be68af38'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:22.120157 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6a7e82ed-8475-4f53-950c-7fbdcad091bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7997a390ff5491b9addf8c5be68af38'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:22.133757 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1033/2053] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:21 2021] DELETE /identity/v3/users/f7997a390ff5491b9addf8c5be68af38 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:22.138382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad32e27-4b5b-4d13-ba9c-8d9d56e8286b None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:22.138839 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad32e27-4b5b-4d13-ba9c-8d9d56e8286b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:22.139356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad32e27-4b5b-4d13-ba9c-8d9d56e8286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:22.159381 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-aad32e27-4b5b-4d13-ba9c-8d9d56e8286b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:22.160663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-aad32e27-4b5b-4d13-ba9c-8d9d56e8286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:22.211610 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e82ed-8475-4f53-950c-7fbdcad091bf admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:22.213240 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6a7e82ed-8475-4f53-950c-7fbdcad091bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:22.256763 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1021/2054] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:22.269239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad32e27-4b5b-4d13-ba9c-8d9d56e8286b None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:22.271008 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-aad32e27-4b5b-4d13-ba9c-8d9d56e8286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:22.281562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e82ed-8475-4f53-950c-7fbdcad091bf admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:22.286348 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1315af9-00f9-4e68-992d-77509d82558e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:22.287078 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1315af9-00f9-4e68-992d-77509d82558e service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:22.287434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1315af9-00f9-4e68-992d-77509d82558e service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:22.287811 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1315af9-00f9-4e68-992d-77509d82558e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:22.290273 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f1315af9-00f9-4e68-992d-77509d82558e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:22.353376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad32e27-4b5b-4d13-ba9c-8d9d56e8286b None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:22.357861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e097b0-c84a-47c8-8f30-ff5ba145fc16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:22.358646 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e097b0-c84a-47c8-8f30-ff5ba145fc16 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:22.359052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e097b0-c84a-47c8-8f30-ff5ba145fc16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:22.359492 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e097b0-c84a-47c8-8f30-ff5ba145fc16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:22.379099 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e097b0-c84a-47c8-8f30-ff5ba145fc16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:22.380953 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e097b0-c84a-47c8-8f30-ff5ba145fc16 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:22.393030 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1315af9-00f9-4e68-992d-77509d82558e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:22.393260 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1022/2055] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:04:22.394646 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1315af9-00f9-4e68-992d-77509d82558e service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:22.408753 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1034/2056] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:22 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:22.924092 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e097b0-c84a-47c8-8f30-ff5ba145fc16 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:22.925671 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b8e097b0-c84a-47c8-8f30-ff5ba145fc16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:22.976520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e097b0-c84a-47c8-8f30-ff5ba145fc16 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:22.982393 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a2906-37d9-458f-9b3f-cb44d07f14d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:22.983317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a2906-37d9-458f-9b3f-cb44d07f14d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:22.983733 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a2906-37d9-458f-9b3f-cb44d07f14d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:22.984078 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a2906-37d9-458f-9b3f-cb44d07f14d4 admin admin] PATH_INFO: `/v3/projects/3edd0e67828a4dac985d13bb5924d4a5` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:22.986052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a2906-37d9-458f-9b3f-cb44d07f14d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3edd0e67828a4dac985d13bb5924d4a5)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:22.988047 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a2906-37d9-458f-9b3f-cb44d07f14d4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:23.038633 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1315af9-00f9-4e68-992d-77509d82558e service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:23.050337 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1315af9-00f9-4e68-992d-77509d82558e service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:23.059603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4965f-61af-4953-b5eb-6bfe9583859d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:23.060910 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4965f-61af-4953-b5eb-6bfe9583859d service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:23.061358 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4965f-61af-4953-b5eb-6bfe9583859d service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:23.061999 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4965f-61af-4953-b5eb-6bfe9583859d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:23.067800 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-93a4965f-61af-4953-b5eb-6bfe9583859d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:23.074800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-006a2906-37d9-458f-9b3f-cb44d07f14d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3edd0e67828a4dac985d13bb5924d4a5', 'request_id': 'req-006a2906-37d9-458f-9b3f-cb44d07f14d4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:23.097240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-006a2906-37d9-458f-9b3f-cb44d07f14d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3edd0e67828a4dac985d13bb5924d4a5', 'request_id': 'req-006a2906-37d9-458f-9b3f-cb44d07f14d4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:23.104967 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-006a2906-37d9-458f-9b3f-cb44d07f14d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3edd0e67828a4dac985d13bb5924d4a5', 'request_id': 'req-006a2906-37d9-458f-9b3f-cb44d07f14d4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:23.116964 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-006a2906-37d9-458f-9b3f-cb44d07f14d4 admin admin] The token cache is being invalidate because project 3edd0e67828a4dac985d13bb5924d4a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:23.117403 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-006a2906-37d9-458f-9b3f-cb44d07f14d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:23.118216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-006a2906-37d9-458f-9b3f-cb44d07f14d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:23.120217 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1023/2057] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:22 2021] DELETE /identity/v3/projects/3edd0e67828a4dac985d13bb5924d4a5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:23.124261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a2906-37d9-458f-9b3f-cb44d07f14d4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:23.125920 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-006a2906-37d9-458f-9b3f-cb44d07f14d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:23.159755 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4965f-61af-4953-b5eb-6bfe9583859d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:23.161456 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4965f-61af-4953-b5eb-6bfe9583859d service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:23.172995 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1035/2058] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:23 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:04:23.205885 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a2906-37d9-458f-9b3f-cb44d07f14d4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:23.217957 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf692f-c4bc-401e-a7ee-3108f0ea4a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:23.218914 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf692f-c4bc-401e-a7ee-3108f0ea4a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:23.219783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf692f-c4bc-401e-a7ee-3108f0ea4a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:23.220203 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf692f-c4bc-401e-a7ee-3108f0ea4a5b admin admin] PATH_INFO: `/v3/users/d593fbd3311b46e9a4588f49e2a5ea5c` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:23.221859 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf692f-c4bc-401e-a7ee-3108f0ea4a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d593fbd3311b46e9a4588f49e2a5ea5c)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:23.224734 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf692f-c4bc-401e-a7ee-3108f0ea4a5b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:23.317075 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-e2bf692f-c4bc-401e-a7ee-3108f0ea4a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd593fbd3311b46e9a4588f49e2a5ea5c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:23.334407 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-e2bf692f-c4bc-401e-a7ee-3108f0ea4a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd593fbd3311b46e9a4588f49e2a5ea5c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:23.341912 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-e2bf692f-c4bc-401e-a7ee-3108f0ea4a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd593fbd3311b46e9a4588f49e2a5ea5c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:23.350038 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-e2bf692f-c4bc-401e-a7ee-3108f0ea4a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd593fbd3311b46e9a4588f49e2a5ea5c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:23.350736 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-e2bf692f-c4bc-401e-a7ee-3108f0ea4a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd593fbd3311b46e9a4588f49e2a5ea5c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:23.356612 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1024/2059] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:23 2021] DELETE /identity/v3/users/d593fbd3311b46e9a4588f49e2a5ea5c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:23.656547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4965f-61af-4953-b5eb-6bfe9583859d service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:23.673099 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4965f-61af-4953-b5eb-6bfe9583859d service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:23.734605 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc42a4b-de99-44d5-a9f1-9f779bca1dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:23.735489 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc42a4b-de99-44d5-a9f1-9f779bca1dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:23.735775 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc42a4b-de99-44d5-a9f1-9f779bca1dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:23.736055 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc42a4b-de99-44d5-a9f1-9f779bca1dfc admin admin] PATH_INFO: `/v3/projects/41b8185ab9334ad48b604b8a435a55df` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:23.737247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc42a4b-de99-44d5-a9f1-9f779bca1dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=41b8185ab9334ad48b604b8a435a55df)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:23.740346 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc42a4b-de99-44d5-a9f1-9f779bca1dfc admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:23.800365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-dcc42a4b-de99-44d5-a9f1-9f779bca1dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b8185ab9334ad48b604b8a435a55df', 'request_id': 'req-dcc42a4b-de99-44d5-a9f1-9f779bca1dfc'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:23.809998 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-dcc42a4b-de99-44d5-a9f1-9f779bca1dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b8185ab9334ad48b604b8a435a55df', 'request_id': 'req-dcc42a4b-de99-44d5-a9f1-9f779bca1dfc'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:23.823793 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-dcc42a4b-de99-44d5-a9f1-9f779bca1dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b8185ab9334ad48b604b8a435a55df', 'request_id': 'req-dcc42a4b-de99-44d5-a9f1-9f779bca1dfc'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:23.837879 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-dcc42a4b-de99-44d5-a9f1-9f779bca1dfc admin admin] The token cache is being invalidate because project 41b8185ab9334ad48b604b8a435a55df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:23.838209 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-dcc42a4b-de99-44d5-a9f1-9f779bca1dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:23.838869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-dcc42a4b-de99-44d5-a9f1-9f779bca1dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:23.840727 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1036/2060] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:23 2021] DELETE /identity/v3/projects/41b8185ab9334ad48b604b8a435a55df => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:23.847533 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dff799-4bb0-4eb1-b479-b2fe205b35a9 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:23.848060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dff799-4bb0-4eb1-b479-b2fe205b35a9 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:23.848506 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dff799-4bb0-4eb1-b479-b2fe205b35a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:23.869353 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-39dff799-4bb0-4eb1-b479-b2fe205b35a9 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:23.870707 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-39dff799-4bb0-4eb1-b479-b2fe205b35a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:23.939678 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1025/2061] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:23.948756 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d8664-1550-4e8f-a031-62c535f8bc28 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:23.949091 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d8664-1550-4e8f-a031-62c535f8bc28 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:23.949382 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d8664-1550-4e8f-a031-62c535f8bc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:23.975186 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-733d8664-1550-4e8f-a031-62c535f8bc28 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:23.976204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-733d8664-1550-4e8f-a031-62c535f8bc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:23.985167 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1037/2062] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:23.991249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dff799-4bb0-4eb1-b479-b2fe205b35a9 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:24.001830 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dff799-4bb0-4eb1-b479-b2fe205b35a9 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:24.008206 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2287344-5b1e-4685-9173-6684ac9c067b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:24.008939 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2287344-5b1e-4685-9173-6684ac9c067b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:24.009325 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2287344-5b1e-4685-9173-6684ac9c067b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:24.009547 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2287344-5b1e-4685-9173-6684ac9c067b admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:24.010326 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2287344-5b1e-4685-9173-6684ac9c067b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:04:24.010631 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2287344-5b1e-4685-9173-6684ac9c067b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:24.012257 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2287344-5b1e-4685-9173-6684ac9c067b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:24.024200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1026/2063] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:04:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:04:24.028949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d8664-1550-4e8f-a031-62c535f8bc28 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:24.039544 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d8664-1550-4e8f-a031-62c535f8bc28 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:24.044170 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea0240-8d9d-4357-b651-ef7375a4d2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:24.044813 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea0240-8d9d-4357-b651-ef7375a4d2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:24.045096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea0240-8d9d-4357-b651-ef7375a4d2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:24.045373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea0240-8d9d-4357-b651-ef7375a4d2b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:24.046191 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea0240-8d9d-4357-b651-ef7375a4d2b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:24.048713 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea0240-8d9d-4357-b651-ef7375a4d2b0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:24.074487 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1038/2064] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:24 2021] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:04:24.079075 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2287344-5b1e-4685-9173-6684ac9c067b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:24.089164 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2287344-5b1e-4685-9173-6684ac9c067b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:24.148505 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928244e-a30b-4e79-8143-ac5d5d8e1aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:24.149191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928244e-a30b-4e79-8143-ac5d5d8e1aee admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:24.149472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928244e-a30b-4e79-8143-ac5d5d8e1aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:24.149745 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928244e-a30b-4e79-8143-ac5d5d8e1aee admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:24.150477 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928244e-a30b-4e79-8143-ac5d5d8e1aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:24.152371 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928244e-a30b-4e79-8143-ac5d5d8e1aee admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:24.171550 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1027/2065] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:24 2021] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:24.176227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea0240-8d9d-4357-b651-ef7375a4d2b0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:24.186861 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea0240-8d9d-4357-b651-ef7375a4d2b0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:24.192137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b402ab-fbdc-4f2e-8f3b-3a5c11354c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:24.192797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b402ab-fbdc-4f2e-8f3b-3a5c11354c49 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:24.193077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b402ab-fbdc-4f2e-8f3b-3a5c11354c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:24.193350 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b402ab-fbdc-4f2e-8f3b-3a5c11354c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:24.194201 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b402ab-fbdc-4f2e-8f3b-3a5c11354c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:24.195786 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b402ab-fbdc-4f2e-8f3b-3a5c11354c49 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:24.207665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1039/2066] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:24.212015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928244e-a30b-4e79-8143-ac5d5d8e1aee admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:24.222124 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928244e-a30b-4e79-8143-ac5d5d8e1aee admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:24.226723 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55fb1d-fbb0-40a7-a9ac-afc852c52e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:24.227377 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55fb1d-fbb0-40a7-a9ac-afc852c52e5c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:24.227651 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55fb1d-fbb0-40a7-a9ac-afc852c52e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:24.227923 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55fb1d-fbb0-40a7-a9ac-afc852c52e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:24.228655 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55fb1d-fbb0-40a7-a9ac-afc852c52e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:24.230269 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55fb1d-fbb0-40a7-a9ac-afc852c52e5c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:24.241782 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1028/2067] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:24.246516 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b402ab-fbdc-4f2e-8f3b-3a5c11354c49 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:24.258227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b402ab-fbdc-4f2e-8f3b-3a5c11354c49 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:24.263145 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9621a-6a22-4e2a-a5c8-7a53d8e70867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:24.264038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9621a-6a22-4e2a-a5c8-7a53d8e70867 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:24.264315 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9621a-6a22-4e2a-a5c8-7a53d8e70867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:24.264588 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9621a-6a22-4e2a-a5c8-7a53d8e70867 admin admin] PATH_INFO: `/v3/projects/0e594dac5c6c49f9b0306ea461515b39/users/61b2266ea0194853b86498c403e3d1b3/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:24.278949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9621a-6a22-4e2a-a5c8-7a53d8e70867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e594dac5c6c49f9b0306ea461515b39, user_id=61b2266ea0194853b86498c403e3d1b3, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:24.281568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9621a-6a22-4e2a-a5c8-7a53d8e70867 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:24.294966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1040/2068] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:24 2021] PUT /identity/v3/projects/0e594dac5c6c49f9b0306ea461515b39/users/61b2266ea0194853b86498c403e3d1b3/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:24.305778 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df911cc0-c80e-49d0-b1fc-0d4d34b1f937 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:24.306096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df911cc0-c80e-49d0-b1fc-0d4d34b1f937 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:24.306372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df911cc0-c80e-49d0-b1fc-0d4d34b1f937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:24.344690 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-df911cc0-c80e-49d0-b1fc-0d4d34b1f937 None None] MFA Rules not processed for user `61b2266ea0194853b86498c403e3d1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:24.346770 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-df911cc0-c80e-49d0-b1fc-0d4d34b1f937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:24.420312 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1029/2069] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:24 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:24.426298 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9621a-6a22-4e2a-a5c8-7a53d8e70867 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:24.504031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9621a-6a22-4e2a-a5c8-7a53d8e70867 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:24.512307 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ec47-43cd-474c-bbc8-e006e2accf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:24.513249 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ec47-43cd-474c-bbc8-e006e2accf3f admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:24.513597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ec47-43cd-474c-bbc8-e006e2accf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:24.513942 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ec47-43cd-474c-bbc8-e006e2accf3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:24.514920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9ec47-43cd-474c-bbc8-e006e2accf3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:24.517052 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9ec47-43cd-474c-bbc8-e006e2accf3f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:24.549717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1041/2070] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:24 2021] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:24.553732 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df911cc0-c80e-49d0-b1fc-0d4d34b1f937 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:24.566138 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df911cc0-c80e-49d0-b1fc-0d4d34b1f937 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:24.677394 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f01b8-a9d0-4246-976f-e13033de5290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:24.678227 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f01b8-a9d0-4246-976f-e13033de5290 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:24.678612 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f01b8-a9d0-4246-976f-e13033de5290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:24.678953 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f01b8-a9d0-4246-976f-e13033de5290 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:24.679752 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f01b8-a9d0-4246-976f-e13033de5290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:24.684855 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f01b8-a9d0-4246-976f-e13033de5290 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:24.718032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1030/2071] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:24 2021] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:24.722564 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ec47-43cd-474c-bbc8-e006e2accf3f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:24.733610 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ec47-43cd-474c-bbc8-e006e2accf3f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:24.739546 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b2fc1-afb0-465f-a333-3af66e496fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:24.740405 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b2fc1-afb0-465f-a333-3af66e496fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:24.740849 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b2fc1-afb0-465f-a333-3af66e496fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:24.741130 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b2fc1-afb0-465f-a333-3af66e496fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:24.741876 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b2fc1-afb0-465f-a333-3af66e496fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:24.743666 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b2fc1-afb0-465f-a333-3af66e496fd4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:24.759101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1042/2072] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:24 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:24.763279 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f01b8-a9d0-4246-976f-e13033de5290 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:24.773489 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f01b8-a9d0-4246-976f-e13033de5290 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:24.778233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ca2c3-1547-4113-8bef-0f14f578158b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:24.778888 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ca2c3-1547-4113-8bef-0f14f578158b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:24.779170 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ca2c3-1547-4113-8bef-0f14f578158b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:24.779446 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ca2c3-1547-4113-8bef-0f14f578158b admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:24.780184 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ca2c3-1547-4113-8bef-0f14f578158b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:24.781775 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ca2c3-1547-4113-8bef-0f14f578158b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:24.793040 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1031/2073] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:24.797481 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b2fc1-afb0-465f-a333-3af66e496fd4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:24.808346 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b2fc1-afb0-465f-a333-3af66e496fd4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:24.813442 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df942ed0-2e37-472e-a2c5-86dcf0777b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:24.814765 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df942ed0-2e37-472e-a2c5-86dcf0777b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:24.815048 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df942ed0-2e37-472e-a2c5-86dcf0777b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:24.815382 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df942ed0-2e37-472e-a2c5-86dcf0777b88 admin admin] PATH_INFO: `/v3/projects/874245f9c387453d8377bbf5033de151/users/53b27782ee314dbaa9a9088343cf8489/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:24.830537 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df942ed0-2e37-472e-a2c5-86dcf0777b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=874245f9c387453d8377bbf5033de151, user_id=53b27782ee314dbaa9a9088343cf8489, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:24.833641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df942ed0-2e37-472e-a2c5-86dcf0777b88 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:24.846753 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1043/2074] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:24 2021] PUT /identity/v3/projects/874245f9c387453d8377bbf5033de151/users/53b27782ee314dbaa9a9088343cf8489/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:24.856731 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fc627-0d48-431c-9382-1592d48b0fc8 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:24.857019 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fc627-0d48-431c-9382-1592d48b0fc8 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:24.857295 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fc627-0d48-431c-9382-1592d48b0fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:24.884751 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-df0fc627-0d48-431c-9382-1592d48b0fc8 None None] MFA Rules not processed for user `53b27782ee314dbaa9a9088343cf8489`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:24.885938 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-df0fc627-0d48-431c-9382-1592d48b0fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:24.950009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1032/2075] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:24 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:24.954188 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df942ed0-2e37-472e-a2c5-86dcf0777b88 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:25.015446 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df942ed0-2e37-472e-a2c5-86dcf0777b88 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:25.020702 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720993d5-f19c-47d2-8a9f-c7fada9f9bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:25.021458 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720993d5-f19c-47d2-8a9f-c7fada9f9bfa admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:25.021794 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720993d5-f19c-47d2-8a9f-c7fada9f9bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:25.022113 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720993d5-f19c-47d2-8a9f-c7fada9f9bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:25.023220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720993d5-f19c-47d2-8a9f-c7fada9f9bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:25.025225 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720993d5-f19c-47d2-8a9f-c7fada9f9bfa admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:25.053856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1044/2076] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:24 2021] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:25.060659 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fc627-0d48-431c-9382-1592d48b0fc8 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:25.074029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fc627-0d48-431c-9382-1592d48b0fc8 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:25.138219 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48540417-a694-4204-acad-15032895a7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:25.138909 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48540417-a694-4204-acad-15032895a7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:25.139171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48540417-a694-4204-acad-15032895a7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:25.139579 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48540417-a694-4204-acad-15032895a7d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:25.140365 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48540417-a694-4204-acad-15032895a7d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:25.143494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48540417-a694-4204-acad-15032895a7d3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:25.165934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1033/2077] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:25 2021] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:25.170430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720993d5-f19c-47d2-8a9f-c7fada9f9bfa admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:25.181223 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720993d5-f19c-47d2-8a9f-c7fada9f9bfa admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:25.188831 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c46f2-2591-4f15-972a-a39cd8a9afb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:25.189493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c46f2-2591-4f15-972a-a39cd8a9afb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:25.189772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c46f2-2591-4f15-972a-a39cd8a9afb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:25.190084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c46f2-2591-4f15-972a-a39cd8a9afb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:25.190850 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c46f2-2591-4f15-972a-a39cd8a9afb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:25.192561 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c46f2-2591-4f15-972a-a39cd8a9afb0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:25.207062 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1045/2078] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:25 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:04:25.211558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48540417-a694-4204-acad-15032895a7d3 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:25.224781 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48540417-a694-4204-acad-15032895a7d3 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:25.229645 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c43e3-d79f-42c4-b55b-c326231e650f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:25.230717 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c43e3-d79f-42c4-b55b-c326231e650f admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:25.231000 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c43e3-d79f-42c4-b55b-c326231e650f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:25.231275 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c43e3-d79f-42c4-b55b-c326231e650f admin admin] PATH_INFO: `/v3/projects/da75ac024a4c490886eff27c6d10d798/users/1e3523b916c94822a6358b1d187c5079/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:25.249684 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c43e3-d79f-42c4-b55b-c326231e650f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da75ac024a4c490886eff27c6d10d798, user_id=1e3523b916c94822a6358b1d187c5079, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:25.253090 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c43e3-d79f-42c4-b55b-c326231e650f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:25.266270 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1034/2079] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:25 2021] PUT /identity/v3/projects/da75ac024a4c490886eff27c6d10d798/users/1e3523b916c94822a6358b1d187c5079/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:25.270403 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c46f2-2591-4f15-972a-a39cd8a9afb0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:25.283425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c46f2-2591-4f15-972a-a39cd8a9afb0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:25.364011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3da630-adc9-403f-96b0-dee5c0e24151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:25.364771 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3da630-adc9-403f-96b0-dee5c0e24151 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:25.364961 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3da630-adc9-403f-96b0-dee5c0e24151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:25.365241 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3da630-adc9-403f-96b0-dee5c0e24151 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:25.366010 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3da630-adc9-403f-96b0-dee5c0e24151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:25.367623 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3da630-adc9-403f-96b0-dee5c0e24151 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:25.381300 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1046/2080] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:25 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:25.383782 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c43e3-d79f-42c4-b55b-c326231e650f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:25.401109 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c43e3-d79f-42c4-b55b-c326231e650f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:25.411551 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c1f8f-1766-47b2-b959-9e2bc69cf1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:25.412447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c1f8f-1766-47b2-b959-9e2bc69cf1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:25.412749 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c1f8f-1766-47b2-b959-9e2bc69cf1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:25.413070 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c1f8f-1766-47b2-b959-9e2bc69cf1c8 admin admin] PATH_INFO: `/v3/projects/da75ac024a4c490886eff27c6d10d798/users/1e3523b916c94822a6358b1d187c5079/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:25.416023 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c1f8f-1766-47b2-b959-9e2bc69cf1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da75ac024a4c490886eff27c6d10d798, user_id=1e3523b916c94822a6358b1d187c5079, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:25.419173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c1f8f-1766-47b2-b959-9e2bc69cf1c8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:25.444050 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1035/2081] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:25 2021] PUT /identity/v3/projects/da75ac024a4c490886eff27c6d10d798/users/1e3523b916c94822a6358b1d187c5079/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:25.445889 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc3eaf-cfa9-4beb-b7ab-807edfbade8b None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:25.446311 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc3eaf-cfa9-4beb-b7ab-807edfbade8b None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:25.446677 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc3eaf-cfa9-4beb-b7ab-807edfbade8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:25.448330 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4343927-5764-4930-b661-00993c162ac7 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:25.448799 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4343927-5764-4930-b661-00993c162ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:25.449137 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4343927-5764-4930-b661-00993c162ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:25.474096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-b4343927-5764-4930-b661-00993c162ac7 None None] MFA Rules not processed for user `35d37a3d8e504b8186182468b77dd114`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:25.475821 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b4343927-5764-4930-b661-00993c162ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:25.488124 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-b2fc3eaf-cfa9-4beb-b7ab-807edfbade8b None None] MFA Rules not processed for user `1e3523b916c94822a6358b1d187c5079`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:25.490418 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b2fc3eaf-cfa9-4beb-b7ab-807edfbade8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:25.559769 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1036/2082] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:25 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:25.581185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1047/2083] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:25 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:25.591101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4343927-5764-4930-b661-00993c162ac7 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:25.592534 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b4343927-5764-4930-b661-00993c162ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:25.653339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4343927-5764-4930-b661-00993c162ac7 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:25.658137 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f204224-e0cf-4a6e-b1bd-86894f61c2ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:25.658875 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f204224-e0cf-4a6e-b1bd-86894f61c2ce service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:25.659159 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f204224-e0cf-4a6e-b1bd-86894f61c2ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:25.659544 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f204224-e0cf-4a6e-b1bd-86894f61c2ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:25.669254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f204224-e0cf-4a6e-b1bd-86894f61c2ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:25.670700 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f204224-e0cf-4a6e-b1bd-86894f61c2ce service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:25.680129 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1037/2084] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:25 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:26.224344 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc3eaf-cfa9-4beb-b7ab-807edfbade8b None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:26.233658 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc3eaf-cfa9-4beb-b7ab-807edfbade8b None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:26.237778 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada7fec-5e49-495f-a4f7-c03bd3ddc7c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:26.238444 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada7fec-5e49-495f-a4f7-c03bd3ddc7c6 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:26.238728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada7fec-5e49-495f-a4f7-c03bd3ddc7c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:26.239003 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada7fec-5e49-495f-a4f7-c03bd3ddc7c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:26.294603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada7fec-5e49-495f-a4f7-c03bd3ddc7c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:26.295937 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada7fec-5e49-495f-a4f7-c03bd3ddc7c6 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:26.305717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1048/2085] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:26 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:27.198186 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f204224-e0cf-4a6e-b1bd-86894f61c2ce service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:27.212672 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-7f204224-e0cf-4a6e-b1bd-86894f61c2ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:27.281402 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f204224-e0cf-4a6e-b1bd-86894f61c2ce service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:27.286407 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7569980-c24c-4db1-926b-90dfbbaa34af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:27.287385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7569980-c24c-4db1-926b-90dfbbaa34af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:27.287695 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7569980-c24c-4db1-926b-90dfbbaa34af admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:27.288009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7569980-c24c-4db1-926b-90dfbbaa34af admin admin] PATH_INFO: `/v3/users/8823c7d913324ea0983e0945df10aa0f` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:27.289384 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7569980-c24c-4db1-926b-90dfbbaa34af admin admin] RBAC: Authorizing `identity:delete_user(user_id=8823c7d913324ea0983e0945df10aa0f)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:27.291329 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7569980-c24c-4db1-926b-90dfbbaa34af admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:27.339924 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d7569980-c24c-4db1-926b-90dfbbaa34af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8823c7d913324ea0983e0945df10aa0f'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:27.351730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d7569980-c24c-4db1-926b-90dfbbaa34af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8823c7d913324ea0983e0945df10aa0f'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:27.359960 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d7569980-c24c-4db1-926b-90dfbbaa34af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8823c7d913324ea0983e0945df10aa0f'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:27.367373 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d7569980-c24c-4db1-926b-90dfbbaa34af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8823c7d913324ea0983e0945df10aa0f'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:27.368000 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d7569980-c24c-4db1-926b-90dfbbaa34af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8823c7d913324ea0983e0945df10aa0f'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:27.374602 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1038/2086] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:27 2021] DELETE /identity/v3/users/8823c7d913324ea0983e0945df10aa0f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:27.379719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3471654-ab62-4a75-b001-83167a6e0183 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:27.380222 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3471654-ab62-4a75-b001-83167a6e0183 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:27.380328 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3471654-ab62-4a75-b001-83167a6e0183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:27.397636 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-d3471654-ab62-4a75-b001-83167a6e0183 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:27.398943 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d3471654-ab62-4a75-b001-83167a6e0183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:27.465805 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1049/2087] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:27.476083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7569980-c24c-4db1-926b-90dfbbaa34af admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:27.477772 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d7569980-c24c-4db1-926b-90dfbbaa34af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:27.531235 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3471654-ab62-4a75-b001-83167a6e0183 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:27.533388 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d3471654-ab62-4a75-b001-83167a6e0183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:27.545554 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7569980-c24c-4db1-926b-90dfbbaa34af admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:27.546641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3471654-ab62-4a75-b001-83167a6e0183 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:27.550130 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf565b-2045-4592-a11b-ac7de8dcf808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:27.550723 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf565b-2045-4592-a11b-ac7de8dcf808 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:27.551073 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf565b-2045-4592-a11b-ac7de8dcf808 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:27.551269 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf565b-2045-4592-a11b-ac7de8dcf808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:27.554810 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfb829-138b-466b-ab12-4a185ea2ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:27.555670 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb829-138b-466b-ab12-4a185ea2ab3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:27.555951 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb829-138b-466b-ab12-4a185ea2ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:27.556228 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb829-138b-466b-ab12-4a185ea2ab3a admin admin] PATH_INFO: `/v3/users/28384f466c3541358ecea856650f008c` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:27.557523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfb829-138b-466b-ab12-4a185ea2ab3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=28384f466c3541358ecea856650f008c)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:27.559456 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfb829-138b-466b-ab12-4a185ea2ab3a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:27.567764 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf565b-2045-4592-a11b-ac7de8dcf808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:27.569214 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf565b-2045-4592-a11b-ac7de8dcf808 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:27.579237 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1039/2088] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:27.615025 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-44cfb829-138b-466b-ab12-4a185ea2ab3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28384f466c3541358ecea856650f008c'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:27.629274 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-44cfb829-138b-466b-ab12-4a185ea2ab3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28384f466c3541358ecea856650f008c'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:27.647122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-44cfb829-138b-466b-ab12-4a185ea2ab3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28384f466c3541358ecea856650f008c'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:27.647920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-44cfb829-138b-466b-ab12-4a185ea2ab3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28384f466c3541358ecea856650f008c'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:27.650492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-44cfb829-138b-466b-ab12-4a185ea2ab3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28384f466c3541358ecea856650f008c'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:27.666016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1050/2089] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:27 2021] DELETE /identity/v3/users/28384f466c3541358ecea856650f008c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:27.959554 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf565b-2045-4592-a11b-ac7de8dcf808 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:27.978612 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfb829-138b-466b-ab12-4a185ea2ab3a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:27.980835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-44cfb829-138b-466b-ab12-4a185ea2ab3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:27.988739 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf565b-2045-4592-a11b-ac7de8dcf808 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:28.060722 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfb829-138b-466b-ab12-4a185ea2ab3a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:28.066084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:28.066944 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:28.067217 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:28.067486 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2 admin admin] PATH_INFO: `/v3/projects/8898601d1a3c4e7a9521227e6b95da4c` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:28.068686 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8898601d1a3c4e7a9521227e6b95da4c)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:28.070626 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:28.104237 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16281d8b-3782-4b49-8230-19b52ad436dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:28.105107 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16281d8b-3782-4b49-8230-19b52ad436dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:28.105421 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16281d8b-3782-4b49-8230-19b52ad436dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:28.105697 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16281d8b-3782-4b49-8230-19b52ad436dc admin admin] PATH_INFO: `/v3/projects/bb933fa80ed94ce5b6828e48e86a21c7` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:28.106939 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16281d8b-3782-4b49-8230-19b52ad436dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb933fa80ed94ce5b6828e48e86a21c7)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:28.108832 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16281d8b-3782-4b49-8230-19b52ad436dc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:28.124586 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8898601d1a3c4e7a9521227e6b95da4c', 'request_id': 'req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.133745 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8898601d1a3c4e7a9521227e6b95da4c', 'request_id': 'req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.140413 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8898601d1a3c4e7a9521227e6b95da4c', 'request_id': 'req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.152457 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2 admin admin] The token cache is being invalidate because project 8898601d1a3c4e7a9521227e6b95da4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:28.153106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.154105 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.155990 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1051/2090] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:27 2021] DELETE /identity/v3/projects/8898601d1a3c4e7a9521227e6b95da4c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:04:28.160106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:28.161485 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-16281d8b-3782-4b49-8230-19b52ad436dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb933fa80ed94ce5b6828e48e86a21c7', 'request_id': 'req-16281d8b-3782-4b49-8230-19b52ad436dc'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.161607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:28.169277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-16281d8b-3782-4b49-8230-19b52ad436dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb933fa80ed94ce5b6828e48e86a21c7', 'request_id': 'req-16281d8b-3782-4b49-8230-19b52ad436dc'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.176373 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-16281d8b-3782-4b49-8230-19b52ad436dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb933fa80ed94ce5b6828e48e86a21c7', 'request_id': 'req-16281d8b-3782-4b49-8230-19b52ad436dc'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.190790 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-16281d8b-3782-4b49-8230-19b52ad436dc admin admin] The token cache is being invalidate because project bb933fa80ed94ce5b6828e48e86a21c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:28.191394 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-16281d8b-3782-4b49-8230-19b52ad436dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.192296 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-16281d8b-3782-4b49-8230-19b52ad436dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.193845 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1040/2091] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:27 2021] DELETE /identity/v3/projects/bb933fa80ed94ce5b6828e48e86a21c7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:28.202486 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4937e3-34f1-4d61-b4bf-4181a0c89727 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:28.203096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4937e3-34f1-4d61-b4bf-4181a0c89727 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:28.203096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4937e3-34f1-4d61-b4bf-4181a0c89727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:28.223726 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-af4937e3-34f1-4d61-b4bf-4181a0c89727 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:28.225076 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-af4937e3-34f1-4d61-b4bf-4181a0c89727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:28.233286 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c174f7-a4a1-4c37-a480-6f102e3e9ed2 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:28.287622 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1041/2092] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:28.295116 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13737375-a950-4c49-bc3f-0e20117e6ead None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:28.295402 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13737375-a950-4c49-bc3f-0e20117e6ead None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:28.295676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13737375-a950-4c49-bc3f-0e20117e6ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:28.299650 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdcaf3-ce67-4389-88cb-ec8cd84db71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:28.300579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdcaf3-ce67-4389-88cb-ec8cd84db71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:28.300867 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdcaf3-ce67-4389-88cb-ec8cd84db71e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:28.301146 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdcaf3-ce67-4389-88cb-ec8cd84db71e admin admin] PATH_INFO: `/v3/users/b0c15fc80d70436ebd5480f0b710f67e` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:28.302493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdcaf3-ce67-4389-88cb-ec8cd84db71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0c15fc80d70436ebd5480f0b710f67e)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:28.305238 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdcaf3-ce67-4389-88cb-ec8cd84db71e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:28.329338 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-13737375-a950-4c49-bc3f-0e20117e6ead None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:28.331614 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-13737375-a950-4c49-bc3f-0e20117e6ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:28.343893 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1042/2093] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:28.345499 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13737375-a950-4c49-bc3f-0e20117e6ead None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:28.355929 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13737375-a950-4c49-bc3f-0e20117e6ead None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:28.362442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84973d73-627c-477d-98d0-a941222f96c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:28.363274 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84973d73-627c-477d-98d0-a941222f96c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:28.363571 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84973d73-627c-477d-98d0-a941222f96c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:28.363807 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84973d73-627c-477d-98d0-a941222f96c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:28.364079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-38bdcaf3-ce67-4389-88cb-ec8cd84db71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0c15fc80d70436ebd5480f0b710f67e'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.364582 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84973d73-627c-477d-98d0-a941222f96c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:04:28.364892 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84973d73-627c-477d-98d0-a941222f96c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:28.366696 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84973d73-627c-477d-98d0-a941222f96c9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:28.380334 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-38bdcaf3-ce67-4389-88cb-ec8cd84db71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0c15fc80d70436ebd5480f0b710f67e'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.381815 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1043/2094] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:04:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:04:28.386013 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84973d73-627c-477d-98d0-a941222f96c9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:28.392015 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-38bdcaf3-ce67-4389-88cb-ec8cd84db71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0c15fc80d70436ebd5480f0b710f67e'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.393123 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-38bdcaf3-ce67-4389-88cb-ec8cd84db71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0c15fc80d70436ebd5480f0b710f67e'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.393797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-38bdcaf3-ce67-4389-88cb-ec8cd84db71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0c15fc80d70436ebd5480f0b710f67e'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.402793 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84973d73-627c-477d-98d0-a941222f96c9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:28.408728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1052/2095] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:28 2021] DELETE /identity/v3/users/b0c15fc80d70436ebd5480f0b710f67e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:04:28.411744 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e3720-4292-4c70-8571-65ebcc78fd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:28.413440 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3720-4292-4c70-8571-65ebcc78fd4e admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:28.413835 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3720-4292-4c70-8571-65ebcc78fd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:28.415339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3720-4292-4c70-8571-65ebcc78fd4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:28.416677 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e3720-4292-4c70-8571-65ebcc78fd4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:28.419808 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e3720-4292-4c70-8571-65ebcc78fd4e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:28.457407 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1044/2096] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:28 2021] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:04:28.461773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdcaf3-ce67-4389-88cb-ec8cd84db71e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:28.463209 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-38bdcaf3-ce67-4389-88cb-ec8cd84db71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:28.534258 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdcaf3-ce67-4389-88cb-ec8cd84db71e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:28.594405 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d89ad-1092-4969-9fb0-b3ad84f68f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:28.595667 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d89ad-1092-4969-9fb0-b3ad84f68f49 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:28.595949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d89ad-1092-4969-9fb0-b3ad84f68f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:28.596230 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d89ad-1092-4969-9fb0-b3ad84f68f49 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:28.596948 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d89ad-1092-4969-9fb0-b3ad84f68f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:28.599057 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d89ad-1092-4969-9fb0-b3ad84f68f49 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:28.628917 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1053/2097] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:28 2021] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:04:28.630077 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e3720-4292-4c70-8571-65ebcc78fd4e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:28.640429 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e3720-4292-4c70-8571-65ebcc78fd4e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:28.645495 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee18ed-05e8-4a4c-9372-e94a1c94cc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:28.646644 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee18ed-05e8-4a4c-9372-e94a1c94cc1e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:28.646644 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee18ed-05e8-4a4c-9372-e94a1c94cc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:28.646844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee18ed-05e8-4a4c-9372-e94a1c94cc1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:28.647643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee18ed-05e8-4a4c-9372-e94a1c94cc1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:28.649092 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee18ed-05e8-4a4c-9372-e94a1c94cc1e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:28.664560 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1045/2098] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:28 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:28.665742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d89ad-1092-4969-9fb0-b3ad84f68f49 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:28.676783 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d89ad-1092-4969-9fb0-b3ad84f68f49 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:28.684761 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816dc04-b9b9-433d-aadd-dee602a69c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:28.685531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816dc04-b9b9-433d-aadd-dee602a69c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:28.685877 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816dc04-b9b9-433d-aadd-dee602a69c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:28.686167 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816dc04-b9b9-433d-aadd-dee602a69c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:28.686916 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816dc04-b9b9-433d-aadd-dee602a69c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:28.688629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816dc04-b9b9-433d-aadd-dee602a69c22 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:28.703280 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1054/2099] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:28 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:28.705651 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee18ed-05e8-4a4c-9372-e94a1c94cc1e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:28.706421 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816dc04-b9b9-433d-aadd-dee602a69c22 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:28.709884 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-18ee18ed-05e8-4a4c-9372-e94a1c94cc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:28.718864 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816dc04-b9b9-433d-aadd-dee602a69c22 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:28.724563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8740c85-5270-429e-a3d9-276215855a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:28.725398 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee18ed-05e8-4a4c-9372-e94a1c94cc1e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:28.725521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8740c85-5270-429e-a3d9-276215855a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:28.725876 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8740c85-5270-429e-a3d9-276215855a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:28.726209 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8740c85-5270-429e-a3d9-276215855a4f admin admin] PATH_INFO: `/v3/projects/9f16202549724b878f908d68384ec9c9/users/fedc11e2dbd74b919982a0657222cca4/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:28.737285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:28.738290 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:28.738571 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:28.738846 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46 admin admin] PATH_INFO: `/v3/projects/5c465da5589040a5ae99092df3937fbe` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:28.740114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c465da5589040a5ae99092df3937fbe)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:28.741332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8740c85-5270-429e-a3d9-276215855a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f16202549724b878f908d68384ec9c9, user_id=fedc11e2dbd74b919982a0657222cca4, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:28.742061 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:28.744036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8740c85-5270-429e-a3d9-276215855a4f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:28.762243 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1055/2100] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:28 2021] PUT /identity/v3/projects/9f16202549724b878f908d68384ec9c9/users/fedc11e2dbd74b919982a0657222cca4/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:28.763857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0f0b0-efac-49e8-97cc-1e35b2ecd3c6 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:28.764212 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0f0b0-efac-49e8-97cc-1e35b2ecd3c6 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:28.764551 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0f0b0-efac-49e8-97cc-1e35b2ecd3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:28.783201 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-0bc0f0b0-efac-49e8-97cc-1e35b2ecd3c6 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:28.784395 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-0bc0f0b0-efac-49e8-97cc-1e35b2ecd3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:28.791506 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c465da5589040a5ae99092df3937fbe', 'request_id': 'req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.798948 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c465da5589040a5ae99092df3937fbe', 'request_id': 'req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.807106 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c465da5589040a5ae99092df3937fbe', 'request_id': 'req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.817958 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46 admin admin] The token cache is being invalidate because project 5c465da5589040a5ae99092df3937fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:28.818279 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.818949 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.820902 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1046/2101] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:28 2021] DELETE /identity/v3/projects/5c465da5589040a5ae99092df3937fbe => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:28.824756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:28.826139 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:28.843952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1056/2102] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:28.855344 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0f0b0-efac-49e8-97cc-1e35b2ecd3c6 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:28.856741 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-0bc0f0b0-efac-49e8-97cc-1e35b2ecd3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:28.900635 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7fb4f-5b45-4618-b6de-fdf9b2d20e46 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:28.905499 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe543a71-2dad-4be6-afc6-57bdd0a7d629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:28.906500 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543a71-2dad-4be6-afc6-57bdd0a7d629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:28.906704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543a71-2dad-4be6-afc6-57bdd0a7d629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:28.906957 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543a71-2dad-4be6-afc6-57bdd0a7d629 admin admin] PATH_INFO: `/v3/users/cb9584aea5c04c3884ed03eb016ec7d8` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:28.908753 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe543a71-2dad-4be6-afc6-57bdd0a7d629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9584aea5c04c3884ed03eb016ec7d8)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:28.910706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe543a71-2dad-4be6-afc6-57bdd0a7d629 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:28.919569 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0f0b0-efac-49e8-97cc-1e35b2ecd3c6 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:28.923417 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c3b84-bdb2-4453-8d3e-9a3a903bda4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:28.924017 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c3b84-bdb2-4453-8d3e-9a3a903bda4a service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:28.924306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c3b84-bdb2-4453-8d3e-9a3a903bda4a service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:28.924588 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c3b84-bdb2-4453-8d3e-9a3a903bda4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:28.934507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c3b84-bdb2-4453-8d3e-9a3a903bda4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:28.936176 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c3b84-bdb2-4453-8d3e-9a3a903bda4a service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:28.948384 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1057/2103] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:04:28.962779 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fe543a71-2dad-4be6-afc6-57bdd0a7d629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9584aea5c04c3884ed03eb016ec7d8'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.977230 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fe543a71-2dad-4be6-afc6-57bdd0a7d629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9584aea5c04c3884ed03eb016ec7d8'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.987010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fe543a71-2dad-4be6-afc6-57bdd0a7d629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9584aea5c04c3884ed03eb016ec7d8'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.996545 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fe543a71-2dad-4be6-afc6-57bdd0a7d629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9584aea5c04c3884ed03eb016ec7d8'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:28.997686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fe543a71-2dad-4be6-afc6-57bdd0a7d629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9584aea5c04c3884ed03eb016ec7d8'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:29.005092 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1047/2104] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:28 2021] DELETE /identity/v3/users/cb9584aea5c04c3884ed03eb016ec7d8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:04:29.403421 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c3b84-bdb2-4453-8d3e-9a3a903bda4a service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:29.421226 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c3b84-bdb2-4453-8d3e-9a3a903bda4a service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:29.515218 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f4d00-b826-4930-9ddb-8dc795cbb0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:29.516374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4d00-b826-4930-9ddb-8dc795cbb0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:29.516692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4d00-b826-4930-9ddb-8dc795cbb0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:29.516975 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4d00-b826-4930-9ddb-8dc795cbb0f7 admin admin] PATH_INFO: `/v3/projects/8e1fc18fe6d7479d93fec103a90f77b3` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:29.518253 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f4d00-b826-4930-9ddb-8dc795cbb0f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1fc18fe6d7479d93fec103a90f77b3)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:29.520155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f4d00-b826-4930-9ddb-8dc795cbb0f7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:29.569555 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d80f4d00-b826-4930-9ddb-8dc795cbb0f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1fc18fe6d7479d93fec103a90f77b3', 'request_id': 'req-d80f4d00-b826-4930-9ddb-8dc795cbb0f7'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:29.578794 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d80f4d00-b826-4930-9ddb-8dc795cbb0f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1fc18fe6d7479d93fec103a90f77b3', 'request_id': 'req-d80f4d00-b826-4930-9ddb-8dc795cbb0f7'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:29.587730 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d80f4d00-b826-4930-9ddb-8dc795cbb0f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1fc18fe6d7479d93fec103a90f77b3', 'request_id': 'req-d80f4d00-b826-4930-9ddb-8dc795cbb0f7'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:29.602828 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d80f4d00-b826-4930-9ddb-8dc795cbb0f7 admin admin] The token cache is being invalidate because project 8e1fc18fe6d7479d93fec103a90f77b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:29.603153 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d80f4d00-b826-4930-9ddb-8dc795cbb0f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:29.604413 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d80f4d00-b826-4930-9ddb-8dc795cbb0f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:29.605662 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1058/2105] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:29 2021] DELETE /identity/v3/projects/8e1fc18fe6d7479d93fec103a90f77b3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:04:29.611777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb94a8d-6115-4b00-a56b-58013026fe55 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:29.612290 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb94a8d-6115-4b00-a56b-58013026fe55 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:29.612394 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb94a8d-6115-4b00-a56b-58013026fe55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:29.636657 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-5fb94a8d-6115-4b00-a56b-58013026fe55 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:29.637911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-5fb94a8d-6115-4b00-a56b-58013026fe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:29.711880 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1048/2106] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:29.719550 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e4aee-18ee-4499-a002-8bd55e10309a None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:29.719987 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e4aee-18ee-4499-a002-8bd55e10309a None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:29.720331 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e4aee-18ee-4499-a002-8bd55e10309a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:29.762203 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-f22e4aee-18ee-4499-a002-8bd55e10309a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:29.763977 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f22e4aee-18ee-4499-a002-8bd55e10309a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:29.777037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1059/2107] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:29.781802 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb94a8d-6115-4b00-a56b-58013026fe55 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:29.792837 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb94a8d-6115-4b00-a56b-58013026fe55 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:29.799715 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf84a02-1338-477d-91e5-e879d2c8f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:29.800788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf84a02-1338-477d-91e5-e879d2c8f453 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:29.800788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf84a02-1338-477d-91e5-e879d2c8f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:29.800958 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf84a02-1338-477d-91e5-e879d2c8f453 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:29.801674 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf84a02-1338-477d-91e5-e879d2c8f453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:04:29.802008 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf84a02-1338-477d-91e5-e879d2c8f453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:29.804160 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf84a02-1338-477d-91e5-e879d2c8f453 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:29.821800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1049/2108] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:04:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:04:29.825930 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e4aee-18ee-4499-a002-8bd55e10309a None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:29.838840 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e4aee-18ee-4499-a002-8bd55e10309a None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:29.844315 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664a7da-65ab-4b22-bafd-f87c688ab78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:29.845630 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664a7da-65ab-4b22-bafd-f87c688ab78d admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:29.845915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664a7da-65ab-4b22-bafd-f87c688ab78d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:29.846247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664a7da-65ab-4b22-bafd-f87c688ab78d admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:29.846927 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664a7da-65ab-4b22-bafd-f87c688ab78d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:29.848859 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664a7da-65ab-4b22-bafd-f87c688ab78d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:29.886108 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1060/2109] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:29 2021] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:29.887050 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf84a02-1338-477d-91e5-e879d2c8f453 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:29.898252 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf84a02-1338-477d-91e5-e879d2c8f453 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:29.965697 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bbda4-20a2-4b4d-868a-73b99df5a52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:29.966504 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bbda4-20a2-4b4d-868a-73b99df5a52c admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:29.966777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bbda4-20a2-4b4d-868a-73b99df5a52c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:29.967216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bbda4-20a2-4b4d-868a-73b99df5a52c admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:29.968098 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bbda4-20a2-4b4d-868a-73b99df5a52c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:29.971695 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bbda4-20a2-4b4d-868a-73b99df5a52c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:30.002783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1050/2110] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:29 2021] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:04:30.006609 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664a7da-65ab-4b22-bafd-f87c688ab78d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:30.017716 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664a7da-65ab-4b22-bafd-f87c688ab78d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:30.023123 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7383b-7574-4565-a98b-3208016041a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:30.024507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7383b-7574-4565-a98b-3208016041a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:30.024507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7383b-7574-4565-a98b-3208016041a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:30.024507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7383b-7574-4565-a98b-3208016041a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:30.025249 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7383b-7574-4565-a98b-3208016041a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:30.026911 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7383b-7574-4565-a98b-3208016041a9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:30.040076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1061/2111] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:30 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:04:30.043902 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bbda4-20a2-4b4d-868a-73b99df5a52c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:30.054632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bbda4-20a2-4b4d-868a-73b99df5a52c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:30.061277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740d5d1-311b-45f5-8ed9-38e77039b96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:30.061277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d5d1-311b-45f5-8ed9-38e77039b96a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:30.061277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d5d1-311b-45f5-8ed9-38e77039b96a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:30.061277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d5d1-311b-45f5-8ed9-38e77039b96a admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:30.061761 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740d5d1-311b-45f5-8ed9-38e77039b96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:30.063211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740d5d1-311b-45f5-8ed9-38e77039b96a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:30.073816 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1051/2112] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:30 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:30.077811 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7383b-7574-4565-a98b-3208016041a9 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:30.089926 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7383b-7574-4565-a98b-3208016041a9 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:30.095844 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb2bee-48b3-4f5c-b782-508ea58c29a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:30.096746 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb2bee-48b3-4f5c-b782-508ea58c29a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:30.097031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb2bee-48b3-4f5c-b782-508ea58c29a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:30.097312 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb2bee-48b3-4f5c-b782-508ea58c29a6 admin admin] PATH_INFO: `/v3/projects/b6eaf458d3c84ba59b078dc0a3bf1763/users/0e440754469c4407840a651d560ce08a/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:30.114805 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb2bee-48b3-4f5c-b782-508ea58c29a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6eaf458d3c84ba59b078dc0a3bf1763, user_id=0e440754469c4407840a651d560ce08a, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:30.117477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb2bee-48b3-4f5c-b782-508ea58c29a6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:30.132123 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1062/2113] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:30 2021] PUT /identity/v3/projects/b6eaf458d3c84ba59b078dc0a3bf1763/users/0e440754469c4407840a651d560ce08a/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:04:30.137292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dfad4-c3cf-402f-9d4f-bc7287b129e1 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:30.137503 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dfad4-c3cf-402f-9d4f-bc7287b129e1 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:30.137925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dfad4-c3cf-402f-9d4f-bc7287b129e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:30.160298 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-bd5dfad4-c3cf-402f-9d4f-bc7287b129e1 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:30.161601 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-bd5dfad4-c3cf-402f-9d4f-bc7287b129e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:30.245806 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1052/2114] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:30.259079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb2bee-48b3-4f5c-b782-508ea58c29a6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:30.261646 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b9bb2bee-48b3-4f5c-b782-508ea58c29a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:30.338775 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb2bee-48b3-4f5c-b782-508ea58c29a6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:30.352595 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3071ca-d522-47c2-bb8e-615a3e17cae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:30.353240 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3071ca-d522-47c2-bb8e-615a3e17cae2 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:30.353535 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3071ca-d522-47c2-bb8e-615a3e17cae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:30.353826 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3071ca-d522-47c2-bb8e-615a3e17cae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:30.373421 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3071ca-d522-47c2-bb8e-615a3e17cae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:30.376846 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3071ca-d522-47c2-bb8e-615a3e17cae2 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:30.391303 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1063/2115] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:30.478355 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dfad4-c3cf-402f-9d4f-bc7287b129e1 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:30.480228 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-bd5dfad4-c3cf-402f-9d4f-bc7287b129e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:30.560881 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dfad4-c3cf-402f-9d4f-bc7287b129e1 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:30.565449 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed84bf-a8f5-4f87-9c39-fc6c110f305a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:30.566781 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed84bf-a8f5-4f87-9c39-fc6c110f305a service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:30.566781 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed84bf-a8f5-4f87-9c39-fc6c110f305a service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:30.566989 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed84bf-a8f5-4f87-9c39-fc6c110f305a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:30.568942 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-74ed84bf-a8f5-4f87-9c39-fc6c110f305a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:30.687892 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed84bf-a8f5-4f87-9c39-fc6c110f305a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:30.690197 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed84bf-a8f5-4f87-9c39-fc6c110f305a service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:30.703448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1053/2116] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:30 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:31.720214 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb619-5ddb-49d2-9e96-f429d91e1cdc None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:31.722215 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb619-5ddb-49d2-9e96-f429d91e1cdc None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:31.722723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb619-5ddb-49d2-9e96-f429d91e1cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:31.766358 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-e3bbb619-5ddb-49d2-9e96-f429d91e1cdc None None] MFA Rules not processed for user `0e440754469c4407840a651d560ce08a`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:31.767985 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e3bbb619-5ddb-49d2-9e96-f429d91e1cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:31.854841 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1064/2117] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:31 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:31.864875 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed84bf-a8f5-4f87-9c39-fc6c110f305a service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:31.878481 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed84bf-a8f5-4f87-9c39-fc6c110f305a service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:31.883180 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1c284-b6f6-4c57-8f01-3e9b5bb4812c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:31.883927 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c284-b6f6-4c57-8f01-3e9b5bb4812c service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:31.884423 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c284-b6f6-4c57-8f01-3e9b5bb4812c service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:31.884928 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c284-b6f6-4c57-8f01-3e9b5bb4812c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:31.895109 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1c284-b6f6-4c57-8f01-3e9b5bb4812c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:31.896675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1c284-b6f6-4c57-8f01-3e9b5bb4812c service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:31.906270 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1054/2118] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:31 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:33.171096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb619-5ddb-49d2-9e96-f429d91e1cdc None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:33.173187 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e3bbb619-5ddb-49d2-9e96-f429d91e1cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:33.189255 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb619-5ddb-49d2-9e96-f429d91e1cdc None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:33.194225 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7c2bb-6442-4bc9-8223-b35d1941049e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:33.195115 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7c2bb-6442-4bc9-8223-b35d1941049e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:33.195393 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7c2bb-6442-4bc9-8223-b35d1941049e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:33.195663 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7c2bb-6442-4bc9-8223-b35d1941049e admin admin] PATH_INFO: `/v3/users/61b2266ea0194853b86498c403e3d1b3` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:33.198766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7c2bb-6442-4bc9-8223-b35d1941049e admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b2266ea0194853b86498c403e3d1b3)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:33.213079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7c2bb-6442-4bc9-8223-b35d1941049e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:33.269900 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6ad7c2bb-6442-4bc9-8223-b35d1941049e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b2266ea0194853b86498c403e3d1b3'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:33.287773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6ad7c2bb-6442-4bc9-8223-b35d1941049e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b2266ea0194853b86498c403e3d1b3'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:33.301715 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6ad7c2bb-6442-4bc9-8223-b35d1941049e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b2266ea0194853b86498c403e3d1b3'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:33.302655 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6ad7c2bb-6442-4bc9-8223-b35d1941049e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b2266ea0194853b86498c403e3d1b3'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:33.303381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6ad7c2bb-6442-4bc9-8223-b35d1941049e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b2266ea0194853b86498c403e3d1b3'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:33.320097 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1065/2119] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:33 2021] DELETE /identity/v3/users/61b2266ea0194853b86498c403e3d1b3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:33.325519 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8244-a4b7-46c6-b08d-b7821180bd0f None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:33.326162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8244-a4b7-46c6-b08d-b7821180bd0f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:33.326162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8244-a4b7-46c6-b08d-b7821180bd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:33.354088 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-9b2c8244-a4b7-46c6-b08d-b7821180bd0f None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:33.355232 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9b2c8244-a4b7-46c6-b08d-b7821180bd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:33.472389 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488e018-9857-434c-a051-b9105249e828 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:33.472725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488e018-9857-434c-a051-b9105249e828 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:33.472998 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488e018-9857-434c-a051-b9105249e828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:33.488891 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1055/2120] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:33.503091 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c8244-a4b7-46c6-b08d-b7821180bd0f None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:33.504732 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9b2c8244-a4b7-46c6-b08d-b7821180bd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:33.510651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-5488e018-9857-434c-a051-b9105249e828 None None] MFA Rules not processed for user `0e440754469c4407840a651d560ce08a`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:33.524772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5488e018-9857-434c-a051-b9105249e828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:33.612537 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1066/2121] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:33 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:33.669765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c8244-a4b7-46c6-b08d-b7821180bd0f None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:33.683056 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffeacd-6aae-4e85-a7dc-d9dbd19dd0dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:33.683860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffeacd-6aae-4e85-a7dc-d9dbd19dd0dc service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:33.684249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffeacd-6aae-4e85-a7dc-d9dbd19dd0dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:33.684595 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffeacd-6aae-4e85-a7dc-d9dbd19dd0dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:33.706912 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffeacd-6aae-4e85-a7dc-d9dbd19dd0dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:33.708720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffeacd-6aae-4e85-a7dc-d9dbd19dd0dc service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:33.730418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1056/2122] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:04:33.796169 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488e018-9857-434c-a051-b9105249e828 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:33.797516 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5488e018-9857-434c-a051-b9105249e828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:33.821723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488e018-9857-434c-a051-b9105249e828 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:33.839665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166eadad-b736-4fc8-819a-104b621fe688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:33.841972 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eadad-b736-4fc8-819a-104b621fe688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:33.842487 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eadad-b736-4fc8-819a-104b621fe688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:33.843593 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eadad-b736-4fc8-819a-104b621fe688 admin admin] PATH_INFO: `/v3/users/54e6dde0be214b7ca022d8322f92be8a` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:33.845941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166eadad-b736-4fc8-819a-104b621fe688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e6dde0be214b7ca022d8322f92be8a)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:33.848108 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166eadad-b736-4fc8-819a-104b621fe688 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:33.937432 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-166eadad-b736-4fc8-819a-104b621fe688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e6dde0be214b7ca022d8322f92be8a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:33.976121 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-166eadad-b736-4fc8-819a-104b621fe688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e6dde0be214b7ca022d8322f92be8a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:33.990266 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-166eadad-b736-4fc8-819a-104b621fe688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e6dde0be214b7ca022d8322f92be8a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:33.991030 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-166eadad-b736-4fc8-819a-104b621fe688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e6dde0be214b7ca022d8322f92be8a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:33.992090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-166eadad-b736-4fc8-819a-104b621fe688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e6dde0be214b7ca022d8322f92be8a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:34.011985 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1067/2123] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:33 2021] DELETE /identity/v3/users/54e6dde0be214b7ca022d8322f92be8a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:34.016883 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccf72f-36dc-4119-a2f0-9c6e63a81b22 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:34.017331 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccf72f-36dc-4119-a2f0-9c6e63a81b22 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:34.017687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccf72f-36dc-4119-a2f0-9c6e63a81b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:34.053673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-92ccf72f-36dc-4119-a2f0-9c6e63a81b22 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:34.058024 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-92ccf72f-36dc-4119-a2f0-9c6e63a81b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:34.172532 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1057/2124] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:34.203772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166eadad-b736-4fc8-819a-104b621fe688 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:34.203772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-166eadad-b736-4fc8-819a-104b621fe688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:34.301035 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166eadad-b736-4fc8-819a-104b621fe688 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:34.320300 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175f4a3-5048-4444-91c1-c1f1ad95afe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:34.321064 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175f4a3-5048-4444-91c1-c1f1ad95afe2 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:34.321424 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175f4a3-5048-4444-91c1-c1f1ad95afe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:34.331161 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175f4a3-5048-4444-91c1-c1f1ad95afe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:34.345332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175f4a3-5048-4444-91c1-c1f1ad95afe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:34.348267 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175f4a3-5048-4444-91c1-c1f1ad95afe2 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:34.367469 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1068/2125] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:34.505477 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccf72f-36dc-4119-a2f0-9c6e63a81b22 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:34.507036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-92ccf72f-36dc-4119-a2f0-9c6e63a81b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:34.521691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccf72f-36dc-4119-a2f0-9c6e63a81b22 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:34.539336 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b21e7e-5860-4b26-9e79-25d636983a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:34.540411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b21e7e-5860-4b26-9e79-25d636983a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:34.540931 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b21e7e-5860-4b26-9e79-25d636983a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:34.541746 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b21e7e-5860-4b26-9e79-25d636983a37 admin admin] PATH_INFO: `/v3/projects/0e594dac5c6c49f9b0306ea461515b39` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:34.543910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b21e7e-5860-4b26-9e79-25d636983a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e594dac5c6c49f9b0306ea461515b39)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:34.548667 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b21e7e-5860-4b26-9e79-25d636983a37 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:34.683041 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-63b21e7e-5860-4b26-9e79-25d636983a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e594dac5c6c49f9b0306ea461515b39', 'request_id': 'req-63b21e7e-5860-4b26-9e79-25d636983a37'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:34.700277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-63b21e7e-5860-4b26-9e79-25d636983a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e594dac5c6c49f9b0306ea461515b39', 'request_id': 'req-63b21e7e-5860-4b26-9e79-25d636983a37'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:34.710843 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-63b21e7e-5860-4b26-9e79-25d636983a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e594dac5c6c49f9b0306ea461515b39', 'request_id': 'req-63b21e7e-5860-4b26-9e79-25d636983a37'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:34.756915 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-63b21e7e-5860-4b26-9e79-25d636983a37 admin admin] The token cache is being invalidate because project 0e594dac5c6c49f9b0306ea461515b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:34.758442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-63b21e7e-5860-4b26-9e79-25d636983a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:34.759502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-63b21e7e-5860-4b26-9e79-25d636983a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:34.764270 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1058/2126] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:34 2021] DELETE /identity/v3/projects/0e594dac5c6c49f9b0306ea461515b39 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:34.768405 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175f4a3-5048-4444-91c1-c1f1ad95afe2 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:34.784069 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175f4a3-5048-4444-91c1-c1f1ad95afe2 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:34.933109 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3363aa-3cb6-463b-a7dc-64486d4d290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:34.934020 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3363aa-3cb6-463b-a7dc-64486d4d290f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:34.934308 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3363aa-3cb6-463b-a7dc-64486d4d290f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:34.934584 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3363aa-3cb6-463b-a7dc-64486d4d290f admin admin] PATH_INFO: `/v3/users/53b27782ee314dbaa9a9088343cf8489` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:34.937758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3363aa-3cb6-463b-a7dc-64486d4d290f admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b27782ee314dbaa9a9088343cf8489)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:34.940359 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3363aa-3cb6-463b-a7dc-64486d4d290f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:35.034191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235759e-e68c-42a2-9ea3-6ba03fef7f5b None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:35.035122 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235759e-e68c-42a2-9ea3-6ba03fef7f5b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:35.035758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235759e-e68c-42a2-9ea3-6ba03fef7f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:35.108624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-8a3363aa-3cb6-463b-a7dc-64486d4d290f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b27782ee314dbaa9a9088343cf8489'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:35.126702 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-8a3363aa-3cb6-463b-a7dc-64486d4d290f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b27782ee314dbaa9a9088343cf8489'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:35.146718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-9235759e-e68c-42a2-9ea3-6ba03fef7f5b None None] MFA Rules not processed for user `fedc11e2dbd74b919982a0657222cca4`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:35.156511 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9235759e-e68c-42a2-9ea3-6ba03fef7f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:35.162424 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-8a3363aa-3cb6-463b-a7dc-64486d4d290f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b27782ee314dbaa9a9088343cf8489'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:35.163632 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-8a3363aa-3cb6-463b-a7dc-64486d4d290f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b27782ee314dbaa9a9088343cf8489'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:35.164743 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-8a3363aa-3cb6-463b-a7dc-64486d4d290f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b27782ee314dbaa9a9088343cf8489'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:35.190844 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1069/2127] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:34 2021] DELETE /identity/v3/users/53b27782ee314dbaa9a9088343cf8489 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:04:35.191790 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3363aa-3cb6-463b-a7dc-64486d4d290f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:35.193196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-8a3363aa-3cb6-463b-a7dc-64486d4d290f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:35.283520 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3363aa-3cb6-463b-a7dc-64486d4d290f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:35.299654 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c00dcc-f46f-4334-a249-78ba9a587868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:35.302338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c00dcc-f46f-4334-a249-78ba9a587868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:35.302655 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c00dcc-f46f-4334-a249-78ba9a587868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:35.303013 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c00dcc-f46f-4334-a249-78ba9a587868 admin admin] PATH_INFO: `/v3/projects/ffbd188d3a1c4a969377d90c550e8ab9` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:35.308926 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c00dcc-f46f-4334-a249-78ba9a587868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffbd188d3a1c4a969377d90c550e8ab9)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:35.317429 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c00dcc-f46f-4334-a249-78ba9a587868 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:35.322458 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1059/2128] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:35 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:35.470175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b1c00dcc-f46f-4334-a249-78ba9a587868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffbd188d3a1c4a969377d90c550e8ab9', 'request_id': 'req-b1c00dcc-f46f-4334-a249-78ba9a587868'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:35.491624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b1c00dcc-f46f-4334-a249-78ba9a587868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffbd188d3a1c4a969377d90c550e8ab9', 'request_id': 'req-b1c00dcc-f46f-4334-a249-78ba9a587868'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:35.507889 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b1c00dcc-f46f-4334-a249-78ba9a587868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffbd188d3a1c4a969377d90c550e8ab9', 'request_id': 'req-b1c00dcc-f46f-4334-a249-78ba9a587868'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:35.536318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235759e-e68c-42a2-9ea3-6ba03fef7f5b None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:35.538396 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9235759e-e68c-42a2-9ea3-6ba03fef7f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:35.545836 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b1c00dcc-f46f-4334-a249-78ba9a587868 admin admin] The token cache is being invalidate because project ffbd188d3a1c4a969377d90c550e8ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:35.546674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b1c00dcc-f46f-4334-a249-78ba9a587868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:35.547407 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b1c00dcc-f46f-4334-a249-78ba9a587868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:35.549916 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1070/2129] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:35 2021] DELETE /identity/v3/projects/ffbd188d3a1c4a969377d90c550e8ab9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:35.554717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c00dcc-f46f-4334-a249-78ba9a587868 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:35.564814 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b1c00dcc-f46f-4334-a249-78ba9a587868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:35.732588 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235759e-e68c-42a2-9ea3-6ba03fef7f5b None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:35.771598 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c00dcc-f46f-4334-a249-78ba9a587868 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:35.777464 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9092f5c-5995-4604-89cf-f4a0e30e8703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:35.778243 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9092f5c-5995-4604-89cf-f4a0e30e8703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:35.778553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9092f5c-5995-4604-89cf-f4a0e30e8703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:35.778842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9092f5c-5995-4604-89cf-f4a0e30e8703 admin admin] PATH_INFO: `/v3/users/bf4cc52280d24d17878182b2676e4253` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:35.780021 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9092f5c-5995-4604-89cf-f4a0e30e8703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf4cc52280d24d17878182b2676e4253)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:35.782087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9092f5c-5995-4604-89cf-f4a0e30e8703 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:35.869193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b9092f5c-5995-4604-89cf-f4a0e30e8703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf4cc52280d24d17878182b2676e4253'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:35.898282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517606d-4954-4f02-b5f7-7f13c3892122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:35.899402 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517606d-4954-4f02-b5f7-7f13c3892122 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:35.901946 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517606d-4954-4f02-b5f7-7f13c3892122 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:35.902645 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517606d-4954-4f02-b5f7-7f13c3892122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:35.905495 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b9092f5c-5995-4604-89cf-f4a0e30e8703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf4cc52280d24d17878182b2676e4253'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:35.906516 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9517606d-4954-4f02-b5f7-7f13c3892122 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:35.917037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b9092f5c-5995-4604-89cf-f4a0e30e8703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf4cc52280d24d17878182b2676e4253'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:35.917917 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b9092f5c-5995-4604-89cf-f4a0e30e8703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf4cc52280d24d17878182b2676e4253'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:35.918707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b9092f5c-5995-4604-89cf-f4a0e30e8703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf4cc52280d24d17878182b2676e4253'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:35.950305 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1071/2130] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:35 2021] DELETE /identity/v3/users/bf4cc52280d24d17878182b2676e4253 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:35.993320 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9092f5c-5995-4604-89cf-f4a0e30e8703 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:35.995116 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b9092f5c-5995-4604-89cf-f4a0e30e8703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:36.015736 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517606d-4954-4f02-b5f7-7f13c3892122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:36.017692 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517606d-4954-4f02-b5f7-7f13c3892122 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:36.038280 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1060/2131] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:35 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:36.135676 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9092f5c-5995-4604-89cf-f4a0e30e8703 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:36.142280 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:36.143311 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:36.143587 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:36.143863 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9 admin admin] PATH_INFO: `/v3/projects/874245f9c387453d8377bbf5033de151` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:36.145714 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=874245f9c387453d8377bbf5033de151)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:36.149097 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:36.221314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874245f9c387453d8377bbf5033de151', 'request_id': 'req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:36.231593 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874245f9c387453d8377bbf5033de151', 'request_id': 'req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:36.242132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874245f9c387453d8377bbf5033de151', 'request_id': 'req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:36.257485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9 admin admin] The token cache is being invalidate because project 874245f9c387453d8377bbf5033de151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:36.257784 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:36.258522 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:36.260948 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1072/2132] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:35 2021] DELETE /identity/v3/projects/874245f9c387453d8377bbf5033de151 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:36.265866 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517606d-4954-4f02-b5f7-7f13c3892122 service nova] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:36.268021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9517606d-4954-4f02-b5f7-7f13c3892122 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:36.290346 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517606d-4954-4f02-b5f7-7f13c3892122 service nova] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:36.404116 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:36.406658 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:36.443551 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1a985-06b7-4e07-91c9-842ba9e2be42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:36.444422 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1a985-06b7-4e07-91c9-842ba9e2be42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:36.444956 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1a985-06b7-4e07-91c9-842ba9e2be42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:36.445229 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1a985-06b7-4e07-91c9-842ba9e2be42 admin admin] PATH_INFO: `/v3/users/1e3523b916c94822a6358b1d187c5079` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:36.446549 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1a985-06b7-4e07-91c9-842ba9e2be42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3523b916c94822a6358b1d187c5079)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:36.448785 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1a985-06b7-4e07-91c9-842ba9e2be42 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:36.534500 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-afb1a985-06b7-4e07-91c9-842ba9e2be42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3523b916c94822a6358b1d187c5079'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:36.548722 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-afb1a985-06b7-4e07-91c9-842ba9e2be42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3523b916c94822a6358b1d187c5079'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:36.557767 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-afb1a985-06b7-4e07-91c9-842ba9e2be42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3523b916c94822a6358b1d187c5079'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:36.560665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308d8ef-7ad1-4602-b3a1-795b8d9401a9 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:36.568294 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff2468-a49c-486e-903e-bfa6c9575b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:36.569310 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff2468-a49c-486e-903e-bfa6c9575b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:36.570878 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-afb1a985-06b7-4e07-91c9-842ba9e2be42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3523b916c94822a6358b1d187c5079'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:36.571876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-afb1a985-06b7-4e07-91c9-842ba9e2be42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3523b916c94822a6358b1d187c5079'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:36.572033 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff2468-a49c-486e-903e-bfa6c9575b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:36.572482 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff2468-a49c-486e-903e-bfa6c9575b98 admin admin] PATH_INFO: `/v3/projects/e3c67201ad034d51ad678108fe715999` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:36.574349 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff2468-a49c-486e-903e-bfa6c9575b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3c67201ad034d51ad678108fe715999)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:36.576850 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff2468-a49c-486e-903e-bfa6c9575b98 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:36.593208 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1061/2133] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:36 2021] DELETE /identity/v3/users/1e3523b916c94822a6358b1d187c5079 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:36.648449 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-11ff2468-a49c-486e-903e-bfa6c9575b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3c67201ad034d51ad678108fe715999', 'request_id': 'req-11ff2468-a49c-486e-903e-bfa6c9575b98'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:36.659852 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-11ff2468-a49c-486e-903e-bfa6c9575b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3c67201ad034d51ad678108fe715999', 'request_id': 'req-11ff2468-a49c-486e-903e-bfa6c9575b98'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:36.671210 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-11ff2468-a49c-486e-903e-bfa6c9575b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3c67201ad034d51ad678108fe715999', 'request_id': 'req-11ff2468-a49c-486e-903e-bfa6c9575b98'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:36.695611 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-11ff2468-a49c-486e-903e-bfa6c9575b98 admin admin] The token cache is being invalidate because project e3c67201ad034d51ad678108fe715999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:36.696028 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-11ff2468-a49c-486e-903e-bfa6c9575b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:36.697300 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-11ff2468-a49c-486e-903e-bfa6c9575b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:36.699768 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1073/2134] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:36 2021] DELETE /identity/v3/projects/e3c67201ad034d51ad678108fe715999 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:36.713021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd7209-bba9-4cf7-b58d-0b817cd86442 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:36.713357 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd7209-bba9-4cf7-b58d-0b817cd86442 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:36.713632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd7209-bba9-4cf7-b58d-0b817cd86442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:36.749864 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-68bd7209-bba9-4cf7-b58d-0b817cd86442 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:36.755665 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-68bd7209-bba9-4cf7-b58d-0b817cd86442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:36.908560 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1062/2135] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:36.909264 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b44f0f-8dff-4c80-9bf4-12b4e2f52691 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:36.910262 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b44f0f-8dff-4c80-9bf4-12b4e2f52691 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:36.910729 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b44f0f-8dff-4c80-9bf4-12b4e2f52691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:36.963575 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-26b44f0f-8dff-4c80-9bf4-12b4e2f52691 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:36.965962 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-26b44f0f-8dff-4c80-9bf4-12b4e2f52691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:36.987906 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1074/2136] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:36.992569 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd7209-bba9-4cf7-b58d-0b817cd86442 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:37.004214 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd7209-bba9-4cf7-b58d-0b817cd86442 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:37.010549 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dcc3a-0229-48bb-8a09-5f20577a1326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:37.011319 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dcc3a-0229-48bb-8a09-5f20577a1326 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:37.011666 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dcc3a-0229-48bb-8a09-5f20577a1326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:37.012021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dcc3a-0229-48bb-8a09-5f20577a1326 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:37.013002 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915dcc3a-0229-48bb-8a09-5f20577a1326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:04:37.014056 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915dcc3a-0229-48bb-8a09-5f20577a1326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:37.015886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915dcc3a-0229-48bb-8a09-5f20577a1326 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:37.035779 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1063/2137] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:04:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:04:37.039988 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b44f0f-8dff-4c80-9bf4-12b4e2f52691 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:37.052316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b44f0f-8dff-4c80-9bf4-12b4e2f52691 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:37.059668 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54beded-115e-4e9d-9b52-116f046b8ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:37.060405 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54beded-115e-4e9d-9b52-116f046b8ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:37.060755 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54beded-115e-4e9d-9b52-116f046b8ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:37.061136 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54beded-115e-4e9d-9b52-116f046b8ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:37.062763 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54beded-115e-4e9d-9b52-116f046b8ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:37.067860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54beded-115e-4e9d-9b52-116f046b8ee8 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:37.109340 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1075/2138] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:37 2021] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:04:37.109946 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dcc3a-0229-48bb-8a09-5f20577a1326 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:37.122286 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dcc3a-0229-48bb-8a09-5f20577a1326 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:37.222385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232e152-6ffc-4f53-ac34-90b904d6a535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:37.223185 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232e152-6ffc-4f53-ac34-90b904d6a535 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:37.223474 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232e152-6ffc-4f53-ac34-90b904d6a535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:37.223806 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232e152-6ffc-4f53-ac34-90b904d6a535 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:37.224626 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232e152-6ffc-4f53-ac34-90b904d6a535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:37.227371 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232e152-6ffc-4f53-ac34-90b904d6a535 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:37.249864 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54beded-115e-4e9d-9b52-116f046b8ee8 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:37.253168 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d54beded-115e-4e9d-9b52-116f046b8ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:37.273898 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54beded-115e-4e9d-9b52-116f046b8ee8 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:37.274176 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1064/2139] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:37 2021] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:37.276207 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232e152-6ffc-4f53-ac34-90b904d6a535 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:37.291049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6757d87-16f1-4f4f-952e-582cf53fab19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:37.292289 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6757d87-16f1-4f4f-952e-582cf53fab19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:37.293277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232e152-6ffc-4f53-ac34-90b904d6a535 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:37.295915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6757d87-16f1-4f4f-952e-582cf53fab19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:37.296367 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6757d87-16f1-4f4f-952e-582cf53fab19 admin admin] PATH_INFO: `/v3/projects/da75ac024a4c490886eff27c6d10d798` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:37.298980 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d24f0-9079-49db-bf21-9dfe0cecba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:37.299636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d24f0-9079-49db-bf21-9dfe0cecba13 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:37.299922 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d24f0-9079-49db-bf21-9dfe0cecba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:37.300201 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d24f0-9079-49db-bf21-9dfe0cecba13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:37.301162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d24f0-9079-49db-bf21-9dfe0cecba13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:37.303262 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d24f0-9079-49db-bf21-9dfe0cecba13 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:37.315811 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1065/2140] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:37 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:37.321383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d24f0-9079-49db-bf21-9dfe0cecba13 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:37.326621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6757d87-16f1-4f4f-952e-582cf53fab19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da75ac024a4c490886eff27c6d10d798)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:37.335231 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d24f0-9079-49db-bf21-9dfe0cecba13 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:37.337493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6757d87-16f1-4f4f-952e-582cf53fab19 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:37.342275 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9e0c2-00e9-4389-b69a-48cdf23e54d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:37.343102 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9e0c2-00e9-4389-b69a-48cdf23e54d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:37.343398 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9e0c2-00e9-4389-b69a-48cdf23e54d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:37.343678 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9e0c2-00e9-4389-b69a-48cdf23e54d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:37.346096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9e0c2-00e9-4389-b69a-48cdf23e54d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:37.347945 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9e0c2-00e9-4389-b69a-48cdf23e54d4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:37.366745 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1066/2141] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:37 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:37.367769 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9e0c2-00e9-4389-b69a-48cdf23e54d4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:37.380312 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9e0c2-00e9-4389-b69a-48cdf23e54d4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:37.390861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a543d9b-1f16-467e-a06f-b0d1c834dc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:37.392316 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a543d9b-1f16-467e-a06f-b0d1c834dc80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:37.392597 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a543d9b-1f16-467e-a06f-b0d1c834dc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:37.392871 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a543d9b-1f16-467e-a06f-b0d1c834dc80 admin admin] PATH_INFO: `/v3/projects/3717c6604691411d83e0789888140eaa/users/21ce8d7c7e6640c2a0a80a7508308478/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:37.437241 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a543d9b-1f16-467e-a06f-b0d1c834dc80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3717c6604691411d83e0789888140eaa, user_id=21ce8d7c7e6640c2a0a80a7508308478, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:37.446281 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a543d9b-1f16-467e-a06f-b0d1c834dc80 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:37.464397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c6757d87-16f1-4f4f-952e-582cf53fab19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da75ac024a4c490886eff27c6d10d798', 'request_id': 'req-c6757d87-16f1-4f4f-952e-582cf53fab19'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:37.487953 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1067/2142] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:37 2021] PUT /identity/v3/projects/3717c6604691411d83e0789888140eaa/users/21ce8d7c7e6640c2a0a80a7508308478/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:37.488630 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c6757d87-16f1-4f4f-952e-582cf53fab19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da75ac024a4c490886eff27c6d10d798', 'request_id': 'req-c6757d87-16f1-4f4f-952e-582cf53fab19'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:37.491634 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba244db7-359f-45c3-ae2a-422dbc96850a None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:37.492266 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba244db7-359f-45c3-ae2a-422dbc96850a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:37.492981 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba244db7-359f-45c3-ae2a-422dbc96850a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:37.499724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c6757d87-16f1-4f4f-952e-582cf53fab19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da75ac024a4c490886eff27c6d10d798', 'request_id': 'req-c6757d87-16f1-4f4f-952e-582cf53fab19'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:37.516491 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c6757d87-16f1-4f4f-952e-582cf53fab19 admin admin] The token cache is being invalidate because project da75ac024a4c490886eff27c6d10d798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:37.517283 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c6757d87-16f1-4f4f-952e-582cf53fab19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:37.518247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c6757d87-16f1-4f4f-952e-582cf53fab19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:37.527976 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1076/2143] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:37 2021] DELETE /identity/v3/projects/da75ac024a4c490886eff27c6d10d798 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:04:37.531060 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31342f49-7774-41de-a986-e91736da14b1 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:37.532644 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31342f49-7774-41de-a986-e91736da14b1 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:37.533233 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31342f49-7774-41de-a986-e91736da14b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:37.557514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-ba244db7-359f-45c3-ae2a-422dbc96850a None None] MFA Rules not processed for user `21ce8d7c7e6640c2a0a80a7508308478`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:37.558773 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-ba244db7-359f-45c3-ae2a-422dbc96850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:37.574113 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-31342f49-7774-41de-a986-e91736da14b1 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:37.575622 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-31342f49-7774-41de-a986-e91736da14b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:37.700624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1077/2144] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:37.702304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf658ecd-e469-4803-a685-9f80a43e54dd None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:37.702835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf658ecd-e469-4803-a685-9f80a43e54dd None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:37.703219 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf658ecd-e469-4803-a685-9f80a43e54dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:37.706037 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1068/2145] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:37 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:37.710311 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba244db7-359f-45c3-ae2a-422dbc96850a None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:37.712287 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-ba244db7-359f-45c3-ae2a-422dbc96850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:37.730365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-cf658ecd-e469-4803-a685-9f80a43e54dd None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:37.732001 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-cf658ecd-e469-4803-a685-9f80a43e54dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:37.738809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba244db7-359f-45c3-ae2a-422dbc96850a None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:37.748670 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1933bb1-c67b-4725-b8a2-431c95408a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:37.749336 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1933bb1-c67b-4725-b8a2-431c95408a7c admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:37.749612 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1933bb1-c67b-4725-b8a2-431c95408a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:37.749892 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1933bb1-c67b-4725-b8a2-431c95408a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:37.750681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1933bb1-c67b-4725-b8a2-431c95408a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:37.752606 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1933bb1-c67b-4725-b8a2-431c95408a7c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:37.767700 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1078/2146] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:37.772577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf658ecd-e469-4803-a685-9f80a43e54dd None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:37.800846 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf658ecd-e469-4803-a685-9f80a43e54dd None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:37.806761 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1069/2147] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:37 2021] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:04:37.810397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534ccba-85d4-4dcb-a656-4f8e3a6f2baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:37.810965 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1933bb1-c67b-4725-b8a2-431c95408a7c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:37.811744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534ccba-85d4-4dcb-a656-4f8e3a6f2baf admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:37.813772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534ccba-85d4-4dcb-a656-4f8e3a6f2baf admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:37.814227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534ccba-85d4-4dcb-a656-4f8e3a6f2baf admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:37.815244 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534ccba-85d4-4dcb-a656-4f8e3a6f2baf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:04:37.816798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534ccba-85d4-4dcb-a656-4f8e3a6f2baf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:37.821650 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534ccba-85d4-4dcb-a656-4f8e3a6f2baf admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:37.850888 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1079/2148] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:04:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:04:37.851916 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534ccba-85d4-4dcb-a656-4f8e3a6f2baf admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:37.864114 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534ccba-85d4-4dcb-a656-4f8e3a6f2baf admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:37.954622 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1933bb1-c67b-4725-b8a2-431c95408a7c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:37.965717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8501b93-571f-4b5b-9a02-f78a8e19289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:37.966957 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8501b93-571f-4b5b-9a02-f78a8e19289a admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:37.967252 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8501b93-571f-4b5b-9a02-f78a8e19289a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:37.967600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8501b93-571f-4b5b-9a02-f78a8e19289a admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:37.968504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8501b93-571f-4b5b-9a02-f78a8e19289a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:37.971998 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8501b93-571f-4b5b-9a02-f78a8e19289a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:37.992407 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6a670-735b-47c1-921a-c419050586e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:37.993098 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6a670-735b-47c1-921a-c419050586e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:37.995080 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6a670-735b-47c1-921a-c419050586e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:37.995327 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6a670-735b-47c1-921a-c419050586e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:37.996048 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6a670-735b-47c1-921a-c419050586e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:38.004524 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6a670-735b-47c1-921a-c419050586e2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:38.030135 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1080/2149] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:37 2021] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:38.034356 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8501b93-571f-4b5b-9a02-f78a8e19289a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:38.050353 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1070/2150] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:37 2021] POST /identity/v3/users => generated 291 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:04:38.053971 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6a670-735b-47c1-921a-c419050586e2 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:38.076765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6a670-735b-47c1-921a-c419050586e2 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:38.170766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8501b93-571f-4b5b-9a02-f78a8e19289a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:38.176904 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af02d1-c1f7-4801-982e-bca75fe430ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:38.190379 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af02d1-c1f7-4801-982e-bca75fe430ab admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:38.192152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af02d1-c1f7-4801-982e-bca75fe430ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:38.192563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af02d1-c1f7-4801-982e-bca75fe430ab admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:38.194217 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af02d1-c1f7-4801-982e-bca75fe430ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:38.197522 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af02d1-c1f7-4801-982e-bca75fe430ab admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:38.231228 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c1502-bab5-4601-a502-e8a026ee18ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:38.231962 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c1502-bab5-4601-a502-e8a026ee18ca admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:38.232345 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c1502-bab5-4601-a502-e8a026ee18ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:38.232685 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c1502-bab5-4601-a502-e8a026ee18ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:38.233392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c1502-bab5-4601-a502-e8a026ee18ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:38.237815 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1081/2151] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:38 2021] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:38.238248 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c1502-bab5-4601-a502-e8a026ee18ca admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:38.247876 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af02d1-c1f7-4801-982e-bca75fe430ab admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:38.265721 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1071/2152] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:38 2021] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:38.270876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c1502-bab5-4601-a502-e8a026ee18ca admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:38.271021 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af02d1-c1f7-4801-982e-bca75fe430ab admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:38.287043 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd254e-c33f-4e40-8571-2accec040b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:38.287390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c1502-bab5-4601-a502-e8a026ee18ca admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:38.288920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd254e-c33f-4e40-8571-2accec040b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:38.290057 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd254e-c33f-4e40-8571-2accec040b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:38.290455 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd254e-c33f-4e40-8571-2accec040b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:38.291868 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd254e-c33f-4e40-8571-2accec040b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:38.294268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd254e-c33f-4e40-8571-2accec040b86 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:38.298563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2e462-74e1-4e54-be04-451c288215c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:38.299455 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2e462-74e1-4e54-be04-451c288215c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:38.299733 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2e462-74e1-4e54-be04-451c288215c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:38.300004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2e462-74e1-4e54-be04-451c288215c5 admin admin] PATH_INFO: `/v3/projects/a04c9c5c5b184ca0a10183046de491f6/users/3a1334cd5b6b4bc5a605996cbd4f8c42/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:38.309736 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1082/2153] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:38 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:38.315645 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd254e-c33f-4e40-8571-2accec040b86 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:38.338204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd254e-c33f-4e40-8571-2accec040b86 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:38.343943 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2e462-74e1-4e54-be04-451c288215c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04c9c5c5b184ca0a10183046de491f6, user_id=3a1334cd5b6b4bc5a605996cbd4f8c42, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:38.348552 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2e462-74e1-4e54-be04-451c288215c5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:38.350685 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffbd19-e849-40d3-a467-24b0cd9f59bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:38.351541 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffbd19-e849-40d3-a467-24b0cd9f59bd admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:38.351917 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffbd19-e849-40d3-a467-24b0cd9f59bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:38.354019 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffbd19-e849-40d3-a467-24b0cd9f59bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:38.355022 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffbd19-e849-40d3-a467-24b0cd9f59bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:38.361693 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffbd19-e849-40d3-a467-24b0cd9f59bd admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:38.407621 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1072/2154] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:38 2021] PUT /identity/v3/projects/a04c9c5c5b184ca0a10183046de491f6/users/3a1334cd5b6b4bc5a605996cbd4f8c42/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:04:38.410181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2e462-74e1-4e54-be04-451c288215c5 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:38.423932 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1083/2155] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:38 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:38.429081 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffbd19-e849-40d3-a467-24b0cd9f59bd admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:38.448504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffbd19-e849-40d3-a467-24b0cd9f59bd admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:38.553154 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2e462-74e1-4e54-be04-451c288215c5 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:38.567177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94525da9-7272-4079-afeb-722949f742f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:38.567843 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94525da9-7272-4079-afeb-722949f742f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:38.568450 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94525da9-7272-4079-afeb-722949f742f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:38.568815 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94525da9-7272-4079-afeb-722949f742f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:38.569646 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94525da9-7272-4079-afeb-722949f742f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:38.572636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94525da9-7272-4079-afeb-722949f742f4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:38.577708 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e984b8-c4e5-46c3-9c5d-7415833f15cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:38.578749 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e984b8-c4e5-46c3-9c5d-7415833f15cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:38.579023 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e984b8-c4e5-46c3-9c5d-7415833f15cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:38.579313 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e984b8-c4e5-46c3-9c5d-7415833f15cb admin admin] PATH_INFO: `/v3/projects/c72d43af974a4c66a15d78c86b87bdc8/users/5aad11fa81cf493fa9ff542d063d6f83/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:38.622076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e984b8-c4e5-46c3-9c5d-7415833f15cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72d43af974a4c66a15d78c86b87bdc8, user_id=5aad11fa81cf493fa9ff542d063d6f83, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:38.622969 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1073/2156] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:38 2021] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:38.624898 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e984b8-c4e5-46c3-9c5d-7415833f15cb admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:38.625089 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94525da9-7272-4079-afeb-722949f742f4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:38.667069 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1084/2157] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:38 2021] PUT /identity/v3/projects/c72d43af974a4c66a15d78c86b87bdc8/users/5aad11fa81cf493fa9ff542d063d6f83/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:38.669309 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94525da9-7272-4079-afeb-722949f742f4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:38.671180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6cdc9-d564-47f0-84c3-9a5ffd2375c9 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:38.671390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6cdc9-d564-47f0-84c3-9a5ffd2375c9 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:38.671686 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6cdc9-d564-47f0-84c3-9a5ffd2375c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:38.733309 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-3ca6cdc9-d564-47f0-84c3-9a5ffd2375c9 None None] MFA Rules not processed for user `5aad11fa81cf493fa9ff542d063d6f83`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:38.733309 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3ca6cdc9-d564-47f0-84c3-9a5ffd2375c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:38.800315 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6104b1-f330-4377-966e-9d29cf2af927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:38.800602 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6104b1-f330-4377-966e-9d29cf2af927 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:38.800849 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6104b1-f330-4377-966e-9d29cf2af927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:38.801125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6104b1-f330-4377-966e-9d29cf2af927 admin admin] PATH_INFO: `/v3/projects/a04c9c5c5b184ca0a10183046de491f6/users/3a1334cd5b6b4bc5a605996cbd4f8c42/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:38.804148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6104b1-f330-4377-966e-9d29cf2af927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04c9c5c5b184ca0a10183046de491f6, user_id=3a1334cd5b6b4bc5a605996cbd4f8c42, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:38.808273 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6104b1-f330-4377-966e-9d29cf2af927 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:38.839710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1074/2158] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:38 2021] PUT /identity/v3/projects/a04c9c5c5b184ca0a10183046de491f6/users/3a1334cd5b6b4bc5a605996cbd4f8c42/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:38.851511 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f7cb6-9d1e-4791-9a49-b9a730237daf None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:38.851802 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f7cb6-9d1e-4791-9a49-b9a730237daf None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:38.852083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f7cb6-9d1e-4791-9a49-b9a730237daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:38.903042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1085/2159] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:38 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:38.911382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-e20f7cb6-9d1e-4791-9a49-b9a730237daf None None] MFA Rules not processed for user `3a1334cd5b6b4bc5a605996cbd4f8c42`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:38.912606 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e20f7cb6-9d1e-4791-9a49-b9a730237daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:38.918798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6cdc9-d564-47f0-84c3-9a5ffd2375c9 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:38.920364 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3ca6cdc9-d564-47f0-84c3-9a5ffd2375c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:39.030056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6cdc9-d564-47f0-84c3-9a5ffd2375c9 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:39.136459 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1075/2160] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:38 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:39.151860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f7cb6-9d1e-4791-9a49-b9a730237daf None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:39.153875 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e20f7cb6-9d1e-4791-9a49-b9a730237daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:39.157409 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d0a1d-816e-452b-886d-1982f67e2a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:39.158379 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d0a1d-816e-452b-886d-1982f67e2a96 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:39.158659 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d0a1d-816e-452b-886d-1982f67e2a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:39.158935 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d0a1d-816e-452b-886d-1982f67e2a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:39.178036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f7cb6-9d1e-4791-9a49-b9a730237daf None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:39.189458 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d015c02-1584-4e83-bfe9-c5652af1c7f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:39.190494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d015c02-1584-4e83-bfe9-c5652af1c7f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:39.190784 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d015c02-1584-4e83-bfe9-c5652af1c7f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:39.192235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d015c02-1584-4e83-bfe9-c5652af1c7f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:39.222945 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d015c02-1584-4e83-bfe9-c5652af1c7f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:39.227080 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d015c02-1584-4e83-bfe9-c5652af1c7f9 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:39.264650 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1076/2161] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:39 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:39.281653 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d0a1d-816e-452b-886d-1982f67e2a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:39.283792 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d0a1d-816e-452b-886d-1982f67e2a96 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:39.297626 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1086/2162] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:38 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:04:39.356424 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d015c02-1584-4e83-bfe9-c5652af1c7f9 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:39.366507 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d015c02-1584-4e83-bfe9-c5652af1c7f9 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:39.376125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d51bc0-c599-4f98-9b39-39a589a88f54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:39.378045 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d51bc0-c599-4f98-9b39-39a589a88f54 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:39.379190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d51bc0-c599-4f98-9b39-39a589a88f54 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:39.379190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d51bc0-c599-4f98-9b39-39a589a88f54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:39.395793 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f86aea-ec30-4e4e-b260-88a2cd2c0122 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:39.396040 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f86aea-ec30-4e4e-b260-88a2cd2c0122 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:39.396548 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f86aea-ec30-4e4e-b260-88a2cd2c0122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:39.427772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-b1f86aea-ec30-4e4e-b260-88a2cd2c0122 None None] MFA Rules not processed for user `fedc11e2dbd74b919982a0657222cca4`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:39.434115 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b1f86aea-ec30-4e4e-b260-88a2cd2c0122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:39.535617 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d51bc0-c599-4f98-9b39-39a589a88f54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:39.537389 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d51bc0-c599-4f98-9b39-39a589a88f54 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:39.564295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1087/2163] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:39 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:39.573173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1077/2164] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:39 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:41.560962 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f86aea-ec30-4e4e-b260-88a2cd2c0122 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:41.562428 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b1f86aea-ec30-4e4e-b260-88a2cd2c0122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:41.796616 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f86aea-ec30-4e4e-b260-88a2cd2c0122 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:41.809048 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480fc5e-6025-485d-86f7-0996726bd782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:41.810671 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480fc5e-6025-485d-86f7-0996726bd782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:41.811122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480fc5e-6025-485d-86f7-0996726bd782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:41.811558 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480fc5e-6025-485d-86f7-0996726bd782 admin admin] PATH_INFO: `/v3/users/de1c0e981e6546179ebe76f7ec7068ea` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:41.813792 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480fc5e-6025-485d-86f7-0996726bd782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de1c0e981e6546179ebe76f7ec7068ea)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:41.817103 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480fc5e-6025-485d-86f7-0996726bd782 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:41.935760 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5480fc5e-6025-485d-86f7-0996726bd782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de1c0e981e6546179ebe76f7ec7068ea'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:41.977072 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5480fc5e-6025-485d-86f7-0996726bd782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de1c0e981e6546179ebe76f7ec7068ea'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:41.999525 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5480fc5e-6025-485d-86f7-0996726bd782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de1c0e981e6546179ebe76f7ec7068ea'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:42.004355 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5480fc5e-6025-485d-86f7-0996726bd782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de1c0e981e6546179ebe76f7ec7068ea'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:42.006110 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5480fc5e-6025-485d-86f7-0996726bd782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de1c0e981e6546179ebe76f7ec7068ea'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:42.059195 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1088/2165] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:41 2021] DELETE /identity/v3/users/de1c0e981e6546179ebe76f7ec7068ea => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:42.064101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f4d7b-779a-4822-a882-9dc9d0a23dd2 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:42.064505 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f4d7b-779a-4822-a882-9dc9d0a23dd2 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:42.064653 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f4d7b-779a-4822-a882-9dc9d0a23dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:42.101497 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-167f4d7b-779a-4822-a882-9dc9d0a23dd2 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:42.102835 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-167f4d7b-779a-4822-a882-9dc9d0a23dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:42.234221 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1078/2166] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:42.258618 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480fc5e-6025-485d-86f7-0996726bd782 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:42.269941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5480fc5e-6025-485d-86f7-0996726bd782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:42.407846 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480fc5e-6025-485d-86f7-0996726bd782 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:42.412446 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf9f69-7aff-4cd4-a71f-be42458e9b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:42.413509 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf9f69-7aff-4cd4-a71f-be42458e9b6f service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:42.414753 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf9f69-7aff-4cd4-a71f-be42458e9b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:42.415161 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf9f69-7aff-4cd4-a71f-be42458e9b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:42.429337 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf9f69-7aff-4cd4-a71f-be42458e9b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:42.430819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf9f69-7aff-4cd4-a71f-be42458e9b6f service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:42.454085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1089/2167] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:04:42.794133 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f4d7b-779a-4822-a882-9dc9d0a23dd2 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:42.795562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-167f4d7b-779a-4822-a882-9dc9d0a23dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:42.810918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f4d7b-779a-4822-a882-9dc9d0a23dd2 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:42.815718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e08f2-278e-4d36-9a0d-f97b2ae72bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:42.816816 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e08f2-278e-4d36-9a0d-f97b2ae72bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:42.817090 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e08f2-278e-4d36-9a0d-f97b2ae72bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:42.817534 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e08f2-278e-4d36-9a0d-f97b2ae72bdf admin admin] PATH_INFO: `/v3/projects/6f432745b7e847febb682060ab6ae363` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:42.818994 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e08f2-278e-4d36-9a0d-f97b2ae72bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f432745b7e847febb682060ab6ae363)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:42.822310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e08f2-278e-4d36-9a0d-f97b2ae72bdf admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:42.873768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-179e08f2-278e-4d36-9a0d-f97b2ae72bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f432745b7e847febb682060ab6ae363', 'request_id': 'req-179e08f2-278e-4d36-9a0d-f97b2ae72bdf'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:42.881225 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-179e08f2-278e-4d36-9a0d-f97b2ae72bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f432745b7e847febb682060ab6ae363', 'request_id': 'req-179e08f2-278e-4d36-9a0d-f97b2ae72bdf'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:42.888788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-179e08f2-278e-4d36-9a0d-f97b2ae72bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f432745b7e847febb682060ab6ae363', 'request_id': 'req-179e08f2-278e-4d36-9a0d-f97b2ae72bdf'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:42.901023 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-179e08f2-278e-4d36-9a0d-f97b2ae72bdf admin admin] The token cache is being invalidate because project 6f432745b7e847febb682060ab6ae363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:42.901283 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-179e08f2-278e-4d36-9a0d-f97b2ae72bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:42.901934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-179e08f2-278e-4d36-9a0d-f97b2ae72bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:42.909585 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1079/2168] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:42 2021] DELETE /identity/v3/projects/6f432745b7e847febb682060ab6ae363 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:42.910133 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a6d19-4856-400b-8f36-de3de7d5bf48 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:42.910584 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a6d19-4856-400b-8f36-de3de7d5bf48 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:42.910752 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a6d19-4856-400b-8f36-de3de7d5bf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:42.930167 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-780a6d19-4856-400b-8f36-de3de7d5bf48 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:42.931634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-780a6d19-4856-400b-8f36-de3de7d5bf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:42.991515 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1090/2169] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:43.000144 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee62a-e246-4baf-879c-e3b9c058db30 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:43.000428 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee62a-e246-4baf-879c-e3b9c058db30 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:43.000705 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee62a-e246-4baf-879c-e3b9c058db30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:43.019191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-1bcee62a-e246-4baf-879c-e3b9c058db30 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:43.020370 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1bcee62a-e246-4baf-879c-e3b9c058db30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:43.028293 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1080/2170] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:43.033293 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a6d19-4856-400b-8f36-de3de7d5bf48 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:43.052773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a6d19-4856-400b-8f36-de3de7d5bf48 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:43.064362 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1eb76-9d0c-41e6-824e-30210f3d0eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:43.065033 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1eb76-9d0c-41e6-824e-30210f3d0eca admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:43.065401 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1eb76-9d0c-41e6-824e-30210f3d0eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:43.065637 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1eb76-9d0c-41e6-824e-30210f3d0eca admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:43.066415 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1eb76-9d0c-41e6-824e-30210f3d0eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:04:43.066848 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1eb76-9d0c-41e6-824e-30210f3d0eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:43.070249 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1eb76-9d0c-41e6-824e-30210f3d0eca admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:43.090130 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcee62a-e246-4baf-879c-e3b9c058db30 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:43.101165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcee62a-e246-4baf-879c-e3b9c058db30 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:43.102169 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1091/2171] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:04:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:04:43.106285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d26d6-a596-45e0-b16f-23c61706d83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:43.106932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d26d6-a596-45e0-b16f-23c61706d83f admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:43.107208 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d26d6-a596-45e0-b16f-23c61706d83f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:43.107474 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d26d6-a596-45e0-b16f-23c61706d83f admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:43.108172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d26d6-a596-45e0-b16f-23c61706d83f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:43.110179 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d26d6-a596-45e0-b16f-23c61706d83f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:43.172005 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1081/2172] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:43 2021] POST /identity/v3/projects => generated 391 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:43.174662 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1eb76-9d0c-41e6-824e-30210f3d0eca admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:43.220617 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1eb76-9d0c-41e6-824e-30210f3d0eca admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:43.265773 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d26d6-a596-45e0-b16f-23c61706d83f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:43.267115 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-a91d26d6-a596-45e0-b16f-23c61706d83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:43.337851 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d26d6-a596-45e0-b16f-23c61706d83f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:43.338088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b27a45-cf4f-4e6e-8006-5090ca9e058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:43.338788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b27a45-cf4f-4e6e-8006-5090ca9e058a admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:43.339154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b27a45-cf4f-4e6e-8006-5090ca9e058a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:43.339522 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b27a45-cf4f-4e6e-8006-5090ca9e058a admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:43.340421 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b27a45-cf4f-4e6e-8006-5090ca9e058a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:43.342645 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b27a45-cf4f-4e6e-8006-5090ca9e058a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:43.344831 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7ce63-845c-497f-a37e-430313789eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:43.345691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7ce63-845c-497f-a37e-430313789eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:43.345968 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7ce63-845c-497f-a37e-430313789eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:43.346314 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7ce63-845c-497f-a37e-430313789eaf admin admin] PATH_INFO: `/v3/users/5aad11fa81cf493fa9ff542d063d6f83` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:43.348394 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7ce63-845c-497f-a37e-430313789eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aad11fa81cf493fa9ff542d063d6f83)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:43.351859 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7ce63-845c-497f-a37e-430313789eaf admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:43.369749 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1092/2173] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:43 2021] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:43.371889 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b27a45-cf4f-4e6e-8006-5090ca9e058a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:43.385704 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b27a45-cf4f-4e6e-8006-5090ca9e058a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:43.390995 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1ba1f-9e40-4e89-afd0-653187e0993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:43.392393 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1ba1f-9e40-4e89-afd0-653187e0993b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:43.392788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1ba1f-9e40-4e89-afd0-653187e0993b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:43.393074 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1ba1f-9e40-4e89-afd0-653187e0993b admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:43.393817 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1ba1f-9e40-4e89-afd0-653187e0993b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:43.396900 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1ba1f-9e40-4e89-afd0-653187e0993b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:43.414441 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1093/2174] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:43 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:43.415565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1ba1f-9e40-4e89-afd0-653187e0993b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:43.424684 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6cd7ce63-845c-497f-a37e-430313789eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aad11fa81cf493fa9ff542d063d6f83'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:43.430877 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1ba1f-9e40-4e89-afd0-653187e0993b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:43.436579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d401c2f-fa9e-40b2-9fbf-0e3289a82afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:43.437425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d401c2f-fa9e-40b2-9fbf-0e3289a82afb admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:43.437721 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d401c2f-fa9e-40b2-9fbf-0e3289a82afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:43.438559 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d401c2f-fa9e-40b2-9fbf-0e3289a82afb admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:43.439301 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d401c2f-fa9e-40b2-9fbf-0e3289a82afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:43.439766 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6cd7ce63-845c-497f-a37e-430313789eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aad11fa81cf493fa9ff542d063d6f83'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:43.440940 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d401c2f-fa9e-40b2-9fbf-0e3289a82afb admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:43.448965 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6cd7ce63-845c-497f-a37e-430313789eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aad11fa81cf493fa9ff542d063d6f83'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:43.460369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1094/2175] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:43 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:43.461584 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d401c2f-fa9e-40b2-9fbf-0e3289a82afb admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:43.469117 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6cd7ce63-845c-497f-a37e-430313789eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aad11fa81cf493fa9ff542d063d6f83'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:43.469872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6cd7ce63-845c-497f-a37e-430313789eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aad11fa81cf493fa9ff542d063d6f83'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:43.471918 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d401c2f-fa9e-40b2-9fbf-0e3289a82afb admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:43.475933 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1082/2176] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:43 2021] DELETE /identity/v3/users/5aad11fa81cf493fa9ff542d063d6f83 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:43.479532 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212ad7d-18bb-48a4-af9c-e0d747b62e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:43.480413 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212ad7d-18bb-48a4-af9c-e0d747b62e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:43.480633 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f73a10-d5f7-402a-a560-30d023b9f39d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:43.480745 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212ad7d-18bb-48a4-af9c-e0d747b62e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:43.480994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212ad7d-18bb-48a4-af9c-e0d747b62e26 admin admin] PATH_INFO: `/v3/projects/fd3a5613e65f48c6b759d17750797b33/users/7abeef348d064ed88c8a01d93120968d/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:43.481291 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f73a10-d5f7-402a-a560-30d023b9f39d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:43.481717 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f73a10-d5f7-402a-a560-30d023b9f39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:43.500333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-85f73a10-d5f7-402a-a560-30d023b9f39d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:43.502092 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-85f73a10-d5f7-402a-a560-30d023b9f39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:43.504890 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212ad7d-18bb-48a4-af9c-e0d747b62e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd3a5613e65f48c6b759d17750797b33, user_id=7abeef348d064ed88c8a01d93120968d, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:43.507827 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212ad7d-18bb-48a4-af9c-e0d747b62e26 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:43.530819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1095/2177] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:43 2021] PUT /identity/v3/projects/fd3a5613e65f48c6b759d17750797b33/users/7abeef348d064ed88c8a01d93120968d/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:43.545048 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b36729-945b-491f-b990-ccfd026622f6 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:43.545958 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b36729-945b-491f-b990-ccfd026622f6 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:43.546593 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b36729-945b-491f-b990-ccfd026622f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:43.591742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-02b36729-945b-491f-b990-ccfd026622f6 None None] MFA Rules not processed for user `7abeef348d064ed88c8a01d93120968d`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:43.593510 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-02b36729-945b-491f-b990-ccfd026622f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:43.640298 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1083/2178] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:43.657374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f73a10-d5f7-402a-a560-30d023b9f39d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:43.659295 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-85f73a10-d5f7-402a-a560-30d023b9f39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:43.720986 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1096/2179] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:43 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:43.754936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b36729-945b-491f-b990-ccfd026622f6 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:43.757642 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-02b36729-945b-491f-b990-ccfd026622f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:43.790068 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f73a10-d5f7-402a-a560-30d023b9f39d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:43.858279 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b36729-945b-491f-b990-ccfd026622f6 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:43.869933 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12667b-1dff-4478-91f6-04dcb01a1426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:43.871094 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12667b-1dff-4478-91f6-04dcb01a1426 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:43.871790 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12667b-1dff-4478-91f6-04dcb01a1426 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:43.872328 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12667b-1dff-4478-91f6-04dcb01a1426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:43.885115 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12667b-1dff-4478-91f6-04dcb01a1426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:43.886784 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12667b-1dff-4478-91f6-04dcb01a1426 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:43.910334 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1097/2180] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:43 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:04:43.914326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12667b-1dff-4478-91f6-04dcb01a1426 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:43.915922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-1c12667b-1dff-4478-91f6-04dcb01a1426 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:43.917464 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3498e-f0a8-462b-b067-1b14e99cd7a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:43.918138 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3498e-f0a8-462b-b067-1b14e99cd7a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:43.918418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3498e-f0a8-462b-b067-1b14e99cd7a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:43.918752 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3498e-f0a8-462b-b067-1b14e99cd7a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:43.990818 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12667b-1dff-4478-91f6-04dcb01a1426 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:44.014752 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c754b-708c-4cf2-91b7-743af28cd7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:44.015638 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c754b-708c-4cf2-91b7-743af28cd7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:44.015918 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c754b-708c-4cf2-91b7-743af28cd7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:44.016281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c754b-708c-4cf2-91b7-743af28cd7d1 admin admin] PATH_INFO: `/v3/users/21ce8d7c7e6640c2a0a80a7508308478` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:44.017560 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3498e-f0a8-462b-b067-1b14e99cd7a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:44.017679 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c754b-708c-4cf2-91b7-743af28cd7d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ce8d7c7e6640c2a0a80a7508308478)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:44.019079 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3498e-f0a8-462b-b067-1b14e99cd7a6 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:44.019519 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c754b-708c-4cf2-91b7-743af28cd7d1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:44.030019 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1084/2181] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:04:44.092677 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-9f9c754b-708c-4cf2-91b7-743af28cd7d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ce8d7c7e6640c2a0a80a7508308478'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:44.111282 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-9f9c754b-708c-4cf2-91b7-743af28cd7d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ce8d7c7e6640c2a0a80a7508308478'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:44.122706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-9f9c754b-708c-4cf2-91b7-743af28cd7d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ce8d7c7e6640c2a0a80a7508308478'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:44.123342 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-9f9c754b-708c-4cf2-91b7-743af28cd7d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ce8d7c7e6640c2a0a80a7508308478'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:44.124089 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-9f9c754b-708c-4cf2-91b7-743af28cd7d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ce8d7c7e6640c2a0a80a7508308478'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:44.146815 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969b545-190a-40ca-b784-57349659b6ae None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:44.147885 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969b545-190a-40ca-b784-57349659b6ae None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:44.148648 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969b545-190a-40ca-b784-57349659b6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:44.150329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1098/2182] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:43 2021] DELETE /identity/v3/users/21ce8d7c7e6640c2a0a80a7508308478 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:44.170938 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-f969b545-190a-40ca-b784-57349659b6ae None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:44.174342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f969b545-190a-40ca-b784-57349659b6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:44.255568 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1085/2183] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:44.296678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c754b-708c-4cf2-91b7-743af28cd7d1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:44.298961 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-9f9c754b-708c-4cf2-91b7-743af28cd7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:44.429257 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c754b-708c-4cf2-91b7-743af28cd7d1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:44.438597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe2c59-1470-4fca-affd-038f1d797c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:44.440325 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe2c59-1470-4fca-affd-038f1d797c44 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:44.441729 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe2c59-1470-4fca-affd-038f1d797c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:44.442036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe2c59-1470-4fca-affd-038f1d797c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:44.468702 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe2c59-1470-4fca-affd-038f1d797c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:44.471022 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe2c59-1470-4fca-affd-038f1d797c44 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:44.482384 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1099/2184] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:45.322618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969b545-190a-40ca-b784-57349659b6ae None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:45.325402 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f969b545-190a-40ca-b784-57349659b6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:45.339115 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969b545-190a-40ca-b784-57349659b6ae None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:45.345315 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3823c-1bad-4139-89b2-933de78bb2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:45.346555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3823c-1bad-4139-89b2-933de78bb2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:45.347168 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3823c-1bad-4139-89b2-933de78bb2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:45.347504 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3823c-1bad-4139-89b2-933de78bb2b1 admin admin] PATH_INFO: `/v3/projects/3717c6604691411d83e0789888140eaa` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:45.349334 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3823c-1bad-4139-89b2-933de78bb2b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3717c6604691411d83e0789888140eaa)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:45.351418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3823c-1bad-4139-89b2-933de78bb2b1 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:45.385169 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe2c59-1470-4fca-affd-038f1d797c44 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:45.386656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-09fe2c59-1470-4fca-affd-038f1d797c44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:45.409196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe2c59-1470-4fca-affd-038f1d797c44 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:45.421855 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb8483-28f6-4937-8f45-12fc4618e69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:45.423373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb8483-28f6-4937-8f45-12fc4618e69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:45.423718 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb8483-28f6-4937-8f45-12fc4618e69e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:45.427925 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb8483-28f6-4937-8f45-12fc4618e69e admin admin] PATH_INFO: `/v3/projects/c72d43af974a4c66a15d78c86b87bdc8` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:45.430405 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb8483-28f6-4937-8f45-12fc4618e69e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c72d43af974a4c66a15d78c86b87bdc8)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:45.432934 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb8483-28f6-4937-8f45-12fc4618e69e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:45.468174 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d0d3823c-1bad-4139-89b2-933de78bb2b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3717c6604691411d83e0789888140eaa', 'request_id': 'req-d0d3823c-1bad-4139-89b2-933de78bb2b1'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:45.481525 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d0d3823c-1bad-4139-89b2-933de78bb2b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3717c6604691411d83e0789888140eaa', 'request_id': 'req-d0d3823c-1bad-4139-89b2-933de78bb2b1'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:45.489310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d0d3823c-1bad-4139-89b2-933de78bb2b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3717c6604691411d83e0789888140eaa', 'request_id': 'req-d0d3823c-1bad-4139-89b2-933de78bb2b1'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:45.502530 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d0d3823c-1bad-4139-89b2-933de78bb2b1 admin admin] The token cache is being invalidate because project 3717c6604691411d83e0789888140eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:45.502815 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d0d3823c-1bad-4139-89b2-933de78bb2b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:45.503732 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d0d3823c-1bad-4139-89b2-933de78bb2b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:45.510271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1086/2185] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:45 2021] DELETE /identity/v3/projects/3717c6604691411d83e0789888140eaa => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:45.513563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3823c-1bad-4139-89b2-933de78bb2b1 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:45.515886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d0d3823c-1bad-4139-89b2-933de78bb2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:45.526920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5acb8483-28f6-4937-8f45-12fc4618e69e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c72d43af974a4c66a15d78c86b87bdc8', 'request_id': 'req-5acb8483-28f6-4937-8f45-12fc4618e69e'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:45.549962 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5acb8483-28f6-4937-8f45-12fc4618e69e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c72d43af974a4c66a15d78c86b87bdc8', 'request_id': 'req-5acb8483-28f6-4937-8f45-12fc4618e69e'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:45.558494 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5acb8483-28f6-4937-8f45-12fc4618e69e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c72d43af974a4c66a15d78c86b87bdc8', 'request_id': 'req-5acb8483-28f6-4937-8f45-12fc4618e69e'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:45.577316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5acb8483-28f6-4937-8f45-12fc4618e69e admin admin] The token cache is being invalidate because project c72d43af974a4c66a15d78c86b87bdc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:45.577942 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5acb8483-28f6-4937-8f45-12fc4618e69e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:45.580301 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5acb8483-28f6-4937-8f45-12fc4618e69e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:45.582497 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1100/2186] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:45 2021] DELETE /identity/v3/projects/c72d43af974a4c66a15d78c86b87bdc8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:45.588438 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2ec53-38f8-4da5-b341-b2b1b7937bed None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:45.589105 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2ec53-38f8-4da5-b341-b2b1b7937bed None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:45.589691 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2ec53-38f8-4da5-b341-b2b1b7937bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:45.621337 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-caf2ec53-38f8-4da5-b341-b2b1b7937bed None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:45.623351 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-caf2ec53-38f8-4da5-b341-b2b1b7937bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:45.636254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3823c-1bad-4139-89b2-933de78bb2b1 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:45.752628 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5715043-f8e3-45a7-aa63-f1e980e4292c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:45.753689 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715043-f8e3-45a7-aa63-f1e980e4292c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:45.754178 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715043-f8e3-45a7-aa63-f1e980e4292c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:45.754626 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715043-f8e3-45a7-aa63-f1e980e4292c admin admin] PATH_INFO: `/v3/users/3a1334cd5b6b4bc5a605996cbd4f8c42` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:45.756767 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5715043-f8e3-45a7-aa63-f1e980e4292c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a1334cd5b6b4bc5a605996cbd4f8c42)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:45.758990 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5715043-f8e3-45a7-aa63-f1e980e4292c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:45.766607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1101/2187] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:45.774802 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0e03-9f59-4812-a597-bd7dfd4de083 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:45.775132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0e03-9f59-4812-a597-bd7dfd4de083 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:45.775431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0e03-9f59-4812-a597-bd7dfd4de083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:45.811477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-9a8c0e03-9f59-4812-a597-bd7dfd4de083 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:45.813523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-9a8c0e03-9f59-4812-a597-bd7dfd4de083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:45.822523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1102/2188] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:45.826294 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c0e03-9f59-4812-a597-bd7dfd4de083 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:45.830913 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b5715043-f8e3-45a7-aa63-f1e980e4292c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a1334cd5b6b4bc5a605996cbd4f8c42'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:45.841020 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c0e03-9f59-4812-a597-bd7dfd4de083 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:45.844128 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b5715043-f8e3-45a7-aa63-f1e980e4292c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a1334cd5b6b4bc5a605996cbd4f8c42'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:45.846643 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6e1da-1133-4942-934d-35098d1a7ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:45.847297 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6e1da-1133-4942-934d-35098d1a7ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:45.847722 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6e1da-1133-4942-934d-35098d1a7ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:45.848025 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6e1da-1133-4942-934d-35098d1a7ff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:45.848755 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6e1da-1133-4942-934d-35098d1a7ff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:04:45.849453 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6e1da-1133-4942-934d-35098d1a7ff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:45.851543 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6e1da-1133-4942-934d-35098d1a7ff5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:45.855271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b5715043-f8e3-45a7-aa63-f1e980e4292c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a1334cd5b6b4bc5a605996cbd4f8c42'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:45.864151 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1103/2189] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:04:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 03:04:45.865854 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b5715043-f8e3-45a7-aa63-f1e980e4292c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a1334cd5b6b4bc5a605996cbd4f8c42'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:45.866632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b5715043-f8e3-45a7-aa63-f1e980e4292c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a1334cd5b6b4bc5a605996cbd4f8c42'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:45.868734 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6e1da-1133-4942-934d-35098d1a7ff5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:45.870650 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-aeb6e1da-1133-4942-934d-35098d1a7ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:45.878777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1087/2190] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:45 2021] DELETE /identity/v3/users/3a1334cd5b6b4bc5a605996cbd4f8c42 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:45.884704 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6e1da-1133-4942-934d-35098d1a7ff5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:45.944509 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d16f4-e5b2-477b-b1a4-89c44fe2a6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:45.945163 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d16f4-e5b2-477b-b1a4-89c44fe2a6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:45.945444 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d16f4-e5b2-477b-b1a4-89c44fe2a6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:45.945774 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d16f4-e5b2-477b-b1a4-89c44fe2a6e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:45.946654 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d16f4-e5b2-477b-b1a4-89c44fe2a6e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:45.948999 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d16f4-e5b2-477b-b1a4-89c44fe2a6e9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:45.982289 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1104/2191] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:45 2021] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:45.986934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5715043-f8e3-45a7-aa63-f1e980e4292c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:45.997076 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5715043-f8e3-45a7-aa63-f1e980e4292c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:46.062817 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cc890-a58c-4801-ac1e-537fc39469a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:46.064200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cc890-a58c-4801-ac1e-537fc39469a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.064489 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cc890-a58c-4801-ac1e-537fc39469a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.064766 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cc890-a58c-4801-ac1e-537fc39469a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.065485 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cc890-a58c-4801-ac1e-537fc39469a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:46.067770 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cc890-a58c-4801-ac1e-537fc39469a0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:46.090500 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1088/2192] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:45 2021] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:04:46.095036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d16f4-e5b2-477b-b1a4-89c44fe2a6e9 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:46.108261 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d16f4-e5b2-477b-b1a4-89c44fe2a6e9 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:46.114781 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025bf1d8-f1cd-46f7-bf90-af1080fe59ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:46.116988 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bf1d8-f1cd-46f7-bf90-af1080fe59ca admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.117350 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bf1d8-f1cd-46f7-bf90-af1080fe59ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.117626 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bf1d8-f1cd-46f7-bf90-af1080fe59ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.118394 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025bf1d8-f1cd-46f7-bf90-af1080fe59ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:46.120390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025bf1d8-f1cd-46f7-bf90-af1080fe59ca admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:46.134096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1105/2193] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:46 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:46.137345 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cc890-a58c-4801-ac1e-537fc39469a0 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:46.151997 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cc890-a58c-4801-ac1e-537fc39469a0 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:46.157467 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83289af9-76b8-454a-8428-6185d630356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:46.158249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289af9-76b8-454a-8428-6185d630356c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.158439 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289af9-76b8-454a-8428-6185d630356c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.158760 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289af9-76b8-454a-8428-6185d630356c admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.159525 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83289af9-76b8-454a-8428-6185d630356c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:46.161150 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83289af9-76b8-454a-8428-6185d630356c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:46.166589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025bf1d8-f1cd-46f7-bf90-af1080fe59ca admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:46.168694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-025bf1d8-f1cd-46f7-bf90-af1080fe59ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:46.178352 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1089/2194] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:46 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:46.187754 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025bf1d8-f1cd-46f7-bf90-af1080fe59ca admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:46.191103 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83289af9-76b8-454a-8428-6185d630356c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:46.196470 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dc3d0-4131-4664-887f-b5d46d758206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:46.197326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dc3d0-4131-4664-887f-b5d46d758206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.197606 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dc3d0-4131-4664-887f-b5d46d758206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.197913 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dc3d0-4131-4664-887f-b5d46d758206 admin admin] PATH_INFO: `/v3/projects/a04c9c5c5b184ca0a10183046de491f6` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.199162 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487dc3d0-4131-4664-887f-b5d46d758206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a04c9c5c5b184ca0a10183046de491f6)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:46.201049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487dc3d0-4131-4664-887f-b5d46d758206 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:46.209837 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83289af9-76b8-454a-8428-6185d630356c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:46.215302 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfe48d-d116-499e-972b-1364ac464fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:46.216188 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfe48d-d116-499e-972b-1364ac464fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.216499 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfe48d-d116-499e-972b-1364ac464fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.216718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfe48d-d116-499e-972b-1364ac464fe9 admin admin] PATH_INFO: `/v3/projects/25f71da95f0b450b8b2b067de5568b9a/users/80a001f228c34890aa035be19168be8d/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.233504 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfe48d-d116-499e-972b-1364ac464fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f71da95f0b450b8b2b067de5568b9a, user_id=80a001f228c34890aa035be19168be8d, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:46.236891 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfe48d-d116-499e-972b-1364ac464fe9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:46.252200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1090/2195] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:46 2021] PUT /identity/v3/projects/25f71da95f0b450b8b2b067de5568b9a/users/80a001f228c34890aa035be19168be8d/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:46.263221 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf3ad3-6fac-4623-842b-f24720fe525d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.263600 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf3ad3-6fac-4623-842b-f24720fe525d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.263963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf3ad3-6fac-4623-842b-f24720fe525d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.267901 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-487dc3d0-4131-4664-887f-b5d46d758206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a04c9c5c5b184ca0a10183046de491f6', 'request_id': 'req-487dc3d0-4131-4664-887f-b5d46d758206'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:46.276034 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-487dc3d0-4131-4664-887f-b5d46d758206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a04c9c5c5b184ca0a10183046de491f6', 'request_id': 'req-487dc3d0-4131-4664-887f-b5d46d758206'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:46.282876 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-487dc3d0-4131-4664-887f-b5d46d758206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a04c9c5c5b184ca0a10183046de491f6', 'request_id': 'req-487dc3d0-4131-4664-887f-b5d46d758206'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:46.292394 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-f7cf3ad3-6fac-4623-842b-f24720fe525d None None] MFA Rules not processed for user `80a001f228c34890aa035be19168be8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:46.293695 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f7cf3ad3-6fac-4623-842b-f24720fe525d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:46.295258 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-487dc3d0-4131-4664-887f-b5d46d758206 admin admin] The token cache is being invalidate because project a04c9c5c5b184ca0a10183046de491f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:46.295620 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-487dc3d0-4131-4664-887f-b5d46d758206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:46.296334 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-487dc3d0-4131-4664-887f-b5d46d758206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:46.298636 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1106/2196] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:46 2021] DELETE /identity/v3/projects/a04c9c5c5b184ca0a10183046de491f6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:04:46.304230 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddd570-288b-4efb-9bed-09fee9ac64c5 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.304515 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddd570-288b-4efb-9bed-09fee9ac64c5 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.304799 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddd570-288b-4efb-9bed-09fee9ac64c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.322383 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-7dddd570-288b-4efb-9bed-09fee9ac64c5 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:46.323565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7dddd570-288b-4efb-9bed-09fee9ac64c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:46.364303 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1091/2197] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:46 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:46.377140 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf3ad3-6fac-4623-842b-f24720fe525d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:46.378574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f7cf3ad3-6fac-4623-842b-f24720fe525d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:46.394391 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1107/2198] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:46.402654 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f6f8-2c7b-49e2-86b0-3655ba5a8bd3 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.402944 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f6f8-2c7b-49e2-86b0-3655ba5a8bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.403229 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f6f8-2c7b-49e2-86b0-3655ba5a8bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.423195 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-d087f6f8-2c7b-49e2-86b0-3655ba5a8bd3 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:46.424372 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d087f6f8-2c7b-49e2-86b0-3655ba5a8bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:46.432146 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1108/2199] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:46.438924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087f6f8-2c7b-49e2-86b0-3655ba5a8bd3 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:46.443121 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf3ad3-6fac-4623-842b-f24720fe525d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:46.446793 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68f3ff-1cf0-4d43-8675-71f57e7e1243 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48dcc22c7df4aed8fa6cf32e3c2ec51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:46.447419 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68f3ff-1cf0-4d43-8675-71f57e7e1243 service glance] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.447518 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087f6f8-2c7b-49e2-86b0-3655ba5a8bd3 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:46.447697 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68f3ff-1cf0-4d43-8675-71f57e7e1243 service glance] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.447968 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68f3ff-1cf0-4d43-8675-71f57e7e1243 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.452107 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34275b-a1c6-4c0a-87b3-56eda7cfacb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:46.452725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34275b-a1c6-4c0a-87b3-56eda7cfacb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.453004 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34275b-a1c6-4c0a-87b3-56eda7cfacb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.453274 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34275b-a1c6-4c0a-87b3-56eda7cfacb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.454729 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34275b-a1c6-4c0a-87b3-56eda7cfacb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:04:46.455033 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34275b-a1c6-4c0a-87b3-56eda7cfacb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:46.456643 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34275b-a1c6-4c0a-87b3-56eda7cfacb0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:46.456749 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68f3ff-1cf0-4d43-8675-71f57e7e1243 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:46.458169 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68f3ff-1cf0-4d43-8675-71f57e7e1243 service glance] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:46.466859 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1092/2200] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:46 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:46.470966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1109/2201] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:04:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:04:46.473096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68f3ff-1cf0-4d43-8675-71f57e7e1243 service glance] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:46.483925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68f3ff-1cf0-4d43-8675-71f57e7e1243 service glance] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:46.488803 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792b8a2-27ca-4dd8-82b4-af85e7ca11e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:46.489450 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792b8a2-27ca-4dd8-82b4-af85e7ca11e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.489728 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792b8a2-27ca-4dd8-82b4-af85e7ca11e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.490059 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792b8a2-27ca-4dd8-82b4-af85e7ca11e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.490768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792b8a2-27ca-4dd8-82b4-af85e7ca11e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:46.492681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792b8a2-27ca-4dd8-82b4-af85e7ca11e0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:46.520967 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1093/2202] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:46 2021] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:46.525065 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34275b-a1c6-4c0a-87b3-56eda7cfacb0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:46.535242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34275b-a1c6-4c0a-87b3-56eda7cfacb0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:46.590345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45728e-13e7-4ca1-bc25-f2d8eaca4524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:46.591016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45728e-13e7-4ca1-bc25-f2d8eaca4524 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.591300 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45728e-13e7-4ca1-bc25-f2d8eaca4524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.591577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45728e-13e7-4ca1-bc25-f2d8eaca4524 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.592316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45728e-13e7-4ca1-bc25-f2d8eaca4524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:46.594258 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45728e-13e7-4ca1-bc25-f2d8eaca4524 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:46.616535 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1110/2203] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:46 2021] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:46.617639 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792b8a2-27ca-4dd8-82b4-af85e7ca11e0 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:46.628603 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792b8a2-27ca-4dd8-82b4-af85e7ca11e0 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:46.633333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b284d5-193e-41de-93ed-c54f2a3c4c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:46.634428 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b284d5-193e-41de-93ed-c54f2a3c4c2c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.634791 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b284d5-193e-41de-93ed-c54f2a3c4c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.635066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b284d5-193e-41de-93ed-c54f2a3c4c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.635804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b284d5-193e-41de-93ed-c54f2a3c4c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:46.639485 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b284d5-193e-41de-93ed-c54f2a3c4c2c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:46.651555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1094/2204] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:46 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:46.653031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45728e-13e7-4ca1-bc25-f2d8eaca4524 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:46.667032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45728e-13e7-4ca1-bc25-f2d8eaca4524 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:46.671881 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0ba28-1f97-428e-8ad2-0313e5c34974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:46.673241 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0ba28-1f97-428e-8ad2-0313e5c34974 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.673787 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0ba28-1f97-428e-8ad2-0313e5c34974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.674271 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0ba28-1f97-428e-8ad2-0313e5c34974 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.675008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0ba28-1f97-428e-8ad2-0313e5c34974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:46.676575 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0ba28-1f97-428e-8ad2-0313e5c34974 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:46.687146 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1111/2205] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:46 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:46.691721 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b284d5-193e-41de-93ed-c54f2a3c4c2c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:46.702088 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b284d5-193e-41de-93ed-c54f2a3c4c2c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:46.707517 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f12fd-5e2c-4dcf-8275-8796cc52290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:46.708394 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f12fd-5e2c-4dcf-8275-8796cc52290f admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.708671 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f12fd-5e2c-4dcf-8275-8796cc52290f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.708944 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f12fd-5e2c-4dcf-8275-8796cc52290f admin admin] PATH_INFO: `/v3/projects/b32a4bf6e9f445798cd7925b18383645/users/b722933350f64dcebfa9b6cd0381f902/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.724706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f12fd-5e2c-4dcf-8275-8796cc52290f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b32a4bf6e9f445798cd7925b18383645, user_id=b722933350f64dcebfa9b6cd0381f902, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:46.727411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f12fd-5e2c-4dcf-8275-8796cc52290f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:46.742373 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1095/2206] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:46 2021] PUT /identity/v3/projects/b32a4bf6e9f445798cd7925b18383645/users/b722933350f64dcebfa9b6cd0381f902/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:46.753662 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf7fc3-ef3d-4594-bd29-7fc0b104df05 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.754214 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf7fc3-ef3d-4594-bd29-7fc0b104df05 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.754356 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf7fc3-ef3d-4594-bd29-7fc0b104df05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.793521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-5ccf7fc3-ef3d-4594-bd29-7fc0b104df05 None None] MFA Rules not processed for user `b722933350f64dcebfa9b6cd0381f902`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:46.795400 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5ccf7fc3-ef3d-4594-bd29-7fc0b104df05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:46.879945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1112/2207] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:46 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:46.886563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f12fd-5e2c-4dcf-8275-8796cc52290f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:46.958930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f12fd-5e2c-4dcf-8275-8796cc52290f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:46.964421 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fed55-09f6-4d1f-b4c3-0403f6b3df4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:46.965073 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fed55-09f6-4d1f-b4c3-0403f6b3df4e admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:46.965351 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fed55-09f6-4d1f-b4c3-0403f6b3df4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:46.965618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fed55-09f6-4d1f-b4c3-0403f6b3df4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:46.966345 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fed55-09f6-4d1f-b4c3-0403f6b3df4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:46.968294 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fed55-09f6-4d1f-b4c3-0403f6b3df4e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:46.998020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1096/2208] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:46 2021] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:47.001883 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf7fc3-ef3d-4594-bd29-7fc0b104df05 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:47.012643 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf7fc3-ef3d-4594-bd29-7fc0b104df05 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:47.068451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa037c6-cd3c-4f5f-a01b-7f7b2cdd738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:47.069118 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa037c6-cd3c-4f5f-a01b-7f7b2cdd738e admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:47.069400 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa037c6-cd3c-4f5f-a01b-7f7b2cdd738e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:47.069677 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa037c6-cd3c-4f5f-a01b-7f7b2cdd738e admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:47.070415 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa037c6-cd3c-4f5f-a01b-7f7b2cdd738e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:47.072342 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa037c6-cd3c-4f5f-a01b-7f7b2cdd738e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:47.092663 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1113/2209] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:47 2021] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:04:47.096654 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fed55-09f6-4d1f-b4c3-0403f6b3df4e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:47.106768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fed55-09f6-4d1f-b4c3-0403f6b3df4e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:47.111441 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fbfd9-f759-41ab-b4d1-03fddf324247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:47.112083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fbfd9-f759-41ab-b4d1-03fddf324247 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:47.112367 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fbfd9-f759-41ab-b4d1-03fddf324247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:47.112644 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fbfd9-f759-41ab-b4d1-03fddf324247 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:47.113378 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fbfd9-f759-41ab-b4d1-03fddf324247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:47.115010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fbfd9-f759-41ab-b4d1-03fddf324247 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:47.126287 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1097/2210] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:47.130171 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa037c6-cd3c-4f5f-a01b-7f7b2cdd738e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:47.139597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa037c6-cd3c-4f5f-a01b-7f7b2cdd738e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:47.144645 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd6baf-8ade-479c-bf4a-a1f5fbdfd4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:47.145503 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd6baf-8ade-479c-bf4a-a1f5fbdfd4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:47.145781 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd6baf-8ade-479c-bf4a-a1f5fbdfd4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:47.146090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd6baf-8ade-479c-bf4a-a1f5fbdfd4ef admin admin] PATH_INFO: `/v3/projects/2642607c3c7e4882ab8c8d38956fafd4/users/4057cff6d1544fdbb07077aaeea90dac/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:47.159952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd6baf-8ade-479c-bf4a-a1f5fbdfd4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2642607c3c7e4882ab8c8d38956fafd4, user_id=4057cff6d1544fdbb07077aaeea90dac, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:47.162534 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd6baf-8ade-479c-bf4a-a1f5fbdfd4ef admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:47.175089 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1114/2211] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:47 2021] PUT /identity/v3/projects/2642607c3c7e4882ab8c8d38956fafd4/users/4057cff6d1544fdbb07077aaeea90dac/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:47.178909 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fbfd9-f759-41ab-b4d1-03fddf324247 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:47.189178 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fbfd9-f759-41ab-b4d1-03fddf324247 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:47.247651 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac7ebe-030b-4414-8fde-d786076783b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:47.248314 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac7ebe-030b-4414-8fde-d786076783b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:47.248592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac7ebe-030b-4414-8fde-d786076783b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:47.248866 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac7ebe-030b-4414-8fde-d786076783b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:47.249608 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac7ebe-030b-4414-8fde-d786076783b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:47.251785 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac7ebe-030b-4414-8fde-d786076783b4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:47.261529 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1098/2212] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:47 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:47.265622 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd6baf-8ade-479c-bf4a-a1f5fbdfd4ef admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:47.276562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd6baf-8ade-479c-bf4a-a1f5fbdfd4ef admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:47.281134 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78480b08-6eb2-4c1e-8b38-22fcda117622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:47.282075 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78480b08-6eb2-4c1e-8b38-22fcda117622 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:47.282355 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78480b08-6eb2-4c1e-8b38-22fcda117622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:47.282626 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78480b08-6eb2-4c1e-8b38-22fcda117622 admin admin] PATH_INFO: `/v3/projects/2642607c3c7e4882ab8c8d38956fafd4/users/4057cff6d1544fdbb07077aaeea90dac/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:47.284692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78480b08-6eb2-4c1e-8b38-22fcda117622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2642607c3c7e4882ab8c8d38956fafd4, user_id=4057cff6d1544fdbb07077aaeea90dac, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:47.287347 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78480b08-6eb2-4c1e-8b38-22fcda117622 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:47.297568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1115/2213] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:47 2021] PUT /identity/v3/projects/2642607c3c7e4882ab8c8d38956fafd4/users/4057cff6d1544fdbb07077aaeea90dac/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:47.307722 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546feda-529b-466c-9fec-841ab94c4e1d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:47.308113 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546feda-529b-466c-9fec-841ab94c4e1d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:47.308404 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546feda-529b-466c-9fec-841ab94c4e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:47.335649 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c546feda-529b-466c-9fec-841ab94c4e1d None None] MFA Rules not processed for user `4057cff6d1544fdbb07077aaeea90dac`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:47.336858 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c546feda-529b-466c-9fec-841ab94c4e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:47.405009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1099/2214] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:47 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:47.417038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78480b08-6eb2-4c1e-8b38-22fcda117622 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:47.418801 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-78480b08-6eb2-4c1e-8b38-22fcda117622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:47.474541 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78480b08-6eb2-4c1e-8b38-22fcda117622 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:47.478221 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71aa64-e65c-4bbe-93d6-db3d9376bff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:47.478846 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71aa64-e65c-4bbe-93d6-db3d9376bff9 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:47.479131 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71aa64-e65c-4bbe-93d6-db3d9376bff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:47.479405 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71aa64-e65c-4bbe-93d6-db3d9376bff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:47.489029 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71aa64-e65c-4bbe-93d6-db3d9376bff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:47.490485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71aa64-e65c-4bbe-93d6-db3d9376bff9 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:47.500031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1116/2215] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:47 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:47.782726 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546feda-529b-466c-9fec-841ab94c4e1d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:47.791544 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546feda-529b-466c-9fec-841ab94c4e1d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:47.796164 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eee9df-074a-4716-b37b-ac7b8eb09424 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4057cff6d1544fdbb07077aaeea90dac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2642607c3c7e4882ab8c8d38956fafd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:47.796803 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eee9df-074a-4716-b37b-ac7b8eb09424 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:47.797086 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eee9df-074a-4716-b37b-ac7b8eb09424 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:47.797900 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eee9df-074a-4716-b37b-ac7b8eb09424 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:47.798667 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eee9df-074a-4716-b37b-ac7b8eb09424 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:04:47.798976 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eee9df-074a-4716-b37b-ac7b8eb09424 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:47.800563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eee9df-074a-4716-b37b-ac7b8eb09424 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:47.811874 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1100/2216] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:04:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:04:47.815782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71aa64-e65c-4bbe-93d6-db3d9376bff9 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:47.825419 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71aa64-e65c-4bbe-93d6-db3d9376bff9 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:47.829953 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8ead3-e5fb-478b-92bc-d838627f06f2 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4057cff6d1544fdbb07077aaeea90dac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2642607c3c7e4882ab8c8d38956fafd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:47.830629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8ead3-e5fb-478b-92bc-d838627f06f2 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:47.830916 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8ead3-e5fb-478b-92bc-d838627f06f2 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:47.831195 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8ead3-e5fb-478b-92bc-d838627f06f2 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:47.831973 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8ead3-e5fb-478b-92bc-d838627f06f2 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:47.833882 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8ead3-e5fb-478b-92bc-d838627f06f2 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:47.869832 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1117/2217] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:47 2021] POST /identity/v3/projects => generated 354 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:04:47.872016 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eee9df-074a-4716-b37b-ac7b8eb09424 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:47.882248 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eee9df-074a-4716-b37b-ac7b8eb09424 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:47.937594 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65326951-4134-43e5-9c1c-21b55b88dfc1 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4057cff6d1544fdbb07077aaeea90dac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2642607c3c7e4882ab8c8d38956fafd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:47.938334 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65326951-4134-43e5-9c1c-21b55b88dfc1 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:47.938619 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65326951-4134-43e5-9c1c-21b55b88dfc1 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:47.938899 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65326951-4134-43e5-9c1c-21b55b88dfc1 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:47.939694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65326951-4134-43e5-9c1c-21b55b88dfc1 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:04:47.940085 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65326951-4134-43e5-9c1c-21b55b88dfc1 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:47.941505 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65326951-4134-43e5-9c1c-21b55b88dfc1 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:47.957596 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1101/2218] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:04:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:04:47.988658 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8ead3-e5fb-478b-92bc-d838627f06f2 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:47.999213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8ead3-e5fb-478b-92bc-d838627f06f2 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:48.003758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed41bad-6cf2-4f25-a07c-eec5041805b3 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4057cff6d1544fdbb07077aaeea90dac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2642607c3c7e4882ab8c8d38956fafd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:48.004605 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed41bad-6cf2-4f25-a07c-eec5041805b3 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:48.004892 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed41bad-6cf2-4f25-a07c-eec5041805b3 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:48.005171 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed41bad-6cf2-4f25-a07c-eec5041805b3 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] PATH_INFO: `/v3/projects/bbf0b557dcf246b0a6b917c9eb4265f9` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:48.006395 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed41bad-6cf2-4f25-a07c-eec5041805b3 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bbf0b557dcf246b0a6b917c9eb4265f9)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:48.008281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed41bad-6cf2-4f25-a07c-eec5041805b3 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:48.055780 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1ed41bad-6cf2-4f25-a07c-eec5041805b3 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf0b557dcf246b0a6b917c9eb4265f9', 'request_id': 'req-1ed41bad-6cf2-4f25-a07c-eec5041805b3'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:48.063639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1ed41bad-6cf2-4f25-a07c-eec5041805b3 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf0b557dcf246b0a6b917c9eb4265f9', 'request_id': 'req-1ed41bad-6cf2-4f25-a07c-eec5041805b3'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:48.083329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1ed41bad-6cf2-4f25-a07c-eec5041805b3 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf0b557dcf246b0a6b917c9eb4265f9', 'request_id': 'req-1ed41bad-6cf2-4f25-a07c-eec5041805b3'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:48.103695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1ed41bad-6cf2-4f25-a07c-eec5041805b3 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] The token cache is being invalidate because project bbf0b557dcf246b0a6b917c9eb4265f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:48.104042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1ed41bad-6cf2-4f25-a07c-eec5041805b3 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:48.105251 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1ed41bad-6cf2-4f25-a07c-eec5041805b3 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:48.107254 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1118/2219] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:47 2021] DELETE /identity/v3/projects/bbf0b557dcf246b0a6b917c9eb4265f9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:48.338511 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65326951-4134-43e5-9c1c-21b55b88dfc1 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:48.340513 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-65326951-4134-43e5-9c1c-21b55b88dfc1 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:48.465007 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65326951-4134-43e5-9c1c-21b55b88dfc1 tempest-VolumeQuotaClassesTest-1887473915 tempest-VolumeQuotaClassesTest-1887473915-project-admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:48.529259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363876a-3f9a-4073-9e5b-a683826e2d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:48.530282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363876a-3f9a-4073-9e5b-a683826e2d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:48.530589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363876a-3f9a-4073-9e5b-a683826e2d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:48.530869 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363876a-3f9a-4073-9e5b-a683826e2d0a admin admin] PATH_INFO: `/v3/users/b722933350f64dcebfa9b6cd0381f902` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:48.532124 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363876a-3f9a-4073-9e5b-a683826e2d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b722933350f64dcebfa9b6cd0381f902)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:48.534174 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363876a-3f9a-4073-9e5b-a683826e2d0a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:48.603158 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d363876a-3f9a-4073-9e5b-a683826e2d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b722933350f64dcebfa9b6cd0381f902'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:48.623530 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d363876a-3f9a-4073-9e5b-a683826e2d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b722933350f64dcebfa9b6cd0381f902'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:48.636146 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d363876a-3f9a-4073-9e5b-a683826e2d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b722933350f64dcebfa9b6cd0381f902'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:48.645705 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d363876a-3f9a-4073-9e5b-a683826e2d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b722933350f64dcebfa9b6cd0381f902'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:48.646484 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d363876a-3f9a-4073-9e5b-a683826e2d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b722933350f64dcebfa9b6cd0381f902'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:48.655637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1102/2220] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:48 2021] DELETE /identity/v3/users/b722933350f64dcebfa9b6cd0381f902 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:04:48.657236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282080d-86aa-44cf-8e92-0160f7d859ac None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:48.657706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282080d-86aa-44cf-8e92-0160f7d859ac None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:48.657787 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282080d-86aa-44cf-8e92-0160f7d859ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:48.677648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-4282080d-86aa-44cf-8e92-0160f7d859ac None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:48.678858 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4282080d-86aa-44cf-8e92-0160f7d859ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:48.784063 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1119/2221] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:48.794267 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363876a-3f9a-4073-9e5b-a683826e2d0a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:48.796525 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d363876a-3f9a-4073-9e5b-a683826e2d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:48.883346 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363876a-3f9a-4073-9e5b-a683826e2d0a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:48.887496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5f8ed-2cd5-4ca6-a9a8-f46bc0024829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:48.888241 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5f8ed-2cd5-4ca6-a9a8-f46bc0024829 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:48.888598 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5f8ed-2cd5-4ca6-a9a8-f46bc0024829 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:48.888940 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5f8ed-2cd5-4ca6-a9a8-f46bc0024829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:48.904763 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5f8ed-2cd5-4ca6-a9a8-f46bc0024829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:48.906564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5f8ed-2cd5-4ca6-a9a8-f46bc0024829 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:48.921165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1103/2222] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:49.274107 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282080d-86aa-44cf-8e92-0160f7d859ac None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:49.275582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4282080d-86aa-44cf-8e92-0160f7d859ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:49.289332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282080d-86aa-44cf-8e92-0160f7d859ac None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:49.293923 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:49.294799 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:49.295085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:49.295364 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f admin admin] PATH_INFO: `/v3/projects/b32a4bf6e9f445798cd7925b18383645` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:49.296554 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b32a4bf6e9f445798cd7925b18383645)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:49.298541 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:49.345379 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b32a4bf6e9f445798cd7925b18383645', 'request_id': 'req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:49.352479 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b32a4bf6e9f445798cd7925b18383645', 'request_id': 'req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:49.358646 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b32a4bf6e9f445798cd7925b18383645', 'request_id': 'req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:49.368751 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f admin admin] The token cache is being invalidate because project b32a4bf6e9f445798cd7925b18383645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:49.369037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:49.369667 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:49.371199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1120/2223] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:49 2021] DELETE /identity/v3/projects/b32a4bf6e9f445798cd7925b18383645 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:49.375965 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5f8ed-2cd5-4ca6-a9a8-f46bc0024829 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:49.385248 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5f8ed-2cd5-4ca6-a9a8-f46bc0024829 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:49.445574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458cea4-645e-41e3-be71-154c20bddec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:49.446632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458cea4-645e-41e3-be71-154c20bddec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:49.446913 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458cea4-645e-41e3-be71-154c20bddec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:49.447202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458cea4-645e-41e3-be71-154c20bddec2 admin admin] PATH_INFO: `/v3/users/4057cff6d1544fdbb07077aaeea90dac` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:49.448426 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458cea4-645e-41e3-be71-154c20bddec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4057cff6d1544fdbb07077aaeea90dac)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:49.450381 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458cea4-645e-41e3-be71-154c20bddec2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:49.497810 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-c458cea4-645e-41e3-be71-154c20bddec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4057cff6d1544fdbb07077aaeea90dac'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:49.511193 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-c458cea4-645e-41e3-be71-154c20bddec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4057cff6d1544fdbb07077aaeea90dac'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:49.519832 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-c458cea4-645e-41e3-be71-154c20bddec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4057cff6d1544fdbb07077aaeea90dac'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:49.526689 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-c458cea4-645e-41e3-be71-154c20bddec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4057cff6d1544fdbb07077aaeea90dac'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:49.527355 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-c458cea4-645e-41e3-be71-154c20bddec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4057cff6d1544fdbb07077aaeea90dac'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:49.533115 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1104/2224] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:49 2021] DELETE /identity/v3/users/4057cff6d1544fdbb07077aaeea90dac => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:49.808494 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:49.809920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:49.828387 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ac0ec-bc60-4c9a-8ac6-ee2245495d2f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:49.906729 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d0161-af28-4709-bbe6-0962fed2752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:49.907789 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d0161-af28-4709-bbe6-0962fed2752b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:49.908214 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d0161-af28-4709-bbe6-0962fed2752b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:49.908490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d0161-af28-4709-bbe6-0962fed2752b admin admin] PATH_INFO: `/v3/projects/2642607c3c7e4882ab8c8d38956fafd4` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:49.909716 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d0161-af28-4709-bbe6-0962fed2752b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2642607c3c7e4882ab8c8d38956fafd4)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:49.911755 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d0161-af28-4709-bbe6-0962fed2752b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:49.971280 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-310d0161-af28-4709-bbe6-0962fed2752b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2642607c3c7e4882ab8c8d38956fafd4', 'request_id': 'req-310d0161-af28-4709-bbe6-0962fed2752b'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:49.980939 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-310d0161-af28-4709-bbe6-0962fed2752b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2642607c3c7e4882ab8c8d38956fafd4', 'request_id': 'req-310d0161-af28-4709-bbe6-0962fed2752b'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:49.989068 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-310d0161-af28-4709-bbe6-0962fed2752b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2642607c3c7e4882ab8c8d38956fafd4', 'request_id': 'req-310d0161-af28-4709-bbe6-0962fed2752b'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:49.999385 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-310d0161-af28-4709-bbe6-0962fed2752b admin admin] The token cache is being invalidate because project 2642607c3c7e4882ab8c8d38956fafd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:49.999666 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-310d0161-af28-4709-bbe6-0962fed2752b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:50.000968 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-310d0161-af28-4709-bbe6-0962fed2752b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:50.002701 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1121/2225] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:49 2021] DELETE /identity/v3/projects/2642607c3c7e4882ab8c8d38956fafd4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:50.008127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f3916-11c2-47a3-a2c8-c26ae331f2d5 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:50.008413 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f3916-11c2-47a3-a2c8-c26ae331f2d5 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:50.008685 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f3916-11c2-47a3-a2c8-c26ae331f2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:50.026372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-fe2f3916-11c2-47a3-a2c8-c26ae331f2d5 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:50.027546 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-fe2f3916-11c2-47a3-a2c8-c26ae331f2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:50.085158 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1105/2226] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:50.093804 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15348b-33b9-490a-99f4-93d075b15259 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:50.094652 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15348b-33b9-490a-99f4-93d075b15259 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:50.094951 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15348b-33b9-490a-99f4-93d075b15259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:50.113239 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-fc15348b-33b9-490a-99f4-93d075b15259 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:50.114444 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-fc15348b-33b9-490a-99f4-93d075b15259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:50.122557 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1122/2227] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:50.126780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f3916-11c2-47a3-a2c8-c26ae331f2d5 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:50.136640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f3916-11c2-47a3-a2c8-c26ae331f2d5 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:50.141243 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491d61b-8a81-4e49-9854-4ff91bb58db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:50.141883 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491d61b-8a81-4e49-9854-4ff91bb58db9 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:50.142194 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491d61b-8a81-4e49-9854-4ff91bb58db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:50.142467 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491d61b-8a81-4e49-9854-4ff91bb58db9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:50.143211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491d61b-8a81-4e49-9854-4ff91bb58db9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:04:50.143510 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491d61b-8a81-4e49-9854-4ff91bb58db9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:50.145116 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491d61b-8a81-4e49-9854-4ff91bb58db9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:50.156220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1106/2228] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:04:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 03:04:50.160924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15348b-33b9-490a-99f4-93d075b15259 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:50.169868 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15348b-33b9-490a-99f4-93d075b15259 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:50.175097 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b6d32-f6c6-4630-aa6a-12b988fdfb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:50.175727 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b6d32-f6c6-4630-aa6a-12b988fdfb8d admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:50.176005 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b6d32-f6c6-4630-aa6a-12b988fdfb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:50.176277 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b6d32-f6c6-4630-aa6a-12b988fdfb8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:50.177000 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b6d32-f6c6-4630-aa6a-12b988fdfb8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:50.178967 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b6d32-f6c6-4630-aa6a-12b988fdfb8d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:50.204772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1123/2229] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:50 2021] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:50.208892 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491d61b-8a81-4e49-9854-4ff91bb58db9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:50.219507 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491d61b-8a81-4e49-9854-4ff91bb58db9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:50.274397 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67058e-f7c5-4d48-92da-2aca7f2926d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:50.275070 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67058e-f7c5-4d48-92da-2aca7f2926d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:50.275373 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67058e-f7c5-4d48-92da-2aca7f2926d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:50.275629 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67058e-f7c5-4d48-92da-2aca7f2926d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:50.276350 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67058e-f7c5-4d48-92da-2aca7f2926d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:50.278307 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67058e-f7c5-4d48-92da-2aca7f2926d4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:50.299890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1107/2230] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:50 2021] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:50.304064 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b6d32-f6c6-4630-aa6a-12b988fdfb8d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:50.314222 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b6d32-f6c6-4630-aa6a-12b988fdfb8d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:50.318785 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa66b2b-0632-4346-afa3-9cf7b85de730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:50.319436 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa66b2b-0632-4346-afa3-9cf7b85de730 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:50.319718 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa66b2b-0632-4346-afa3-9cf7b85de730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:50.319995 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa66b2b-0632-4346-afa3-9cf7b85de730 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:50.320764 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa66b2b-0632-4346-afa3-9cf7b85de730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:50.322490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa66b2b-0632-4346-afa3-9cf7b85de730 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:50.333441 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1124/2231] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:50.337492 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67058e-f7c5-4d48-92da-2aca7f2926d4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:50.348520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67058e-f7c5-4d48-92da-2aca7f2926d4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:50.353511 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26865f-c38b-48fd-b705-d2947beff34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:50.354220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26865f-c38b-48fd-b705-d2947beff34f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:50.354503 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26865f-c38b-48fd-b705-d2947beff34f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:50.354780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26865f-c38b-48fd-b705-d2947beff34f admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:50.355523 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26865f-c38b-48fd-b705-d2947beff34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:50.357204 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26865f-c38b-48fd-b705-d2947beff34f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:50.371039 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1108/2232] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:50.372637 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa66b2b-0632-4346-afa3-9cf7b85de730 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:50.382667 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa66b2b-0632-4346-afa3-9cf7b85de730 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:50.387537 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6629b-c65c-4d0a-8ba3-89d1453209b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:50.388431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6629b-c65c-4d0a-8ba3-89d1453209b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:50.388716 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6629b-c65c-4d0a-8ba3-89d1453209b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:50.388995 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6629b-c65c-4d0a-8ba3-89d1453209b1 admin admin] PATH_INFO: `/v3/projects/bd7cd954e96a491a9e2fcbf6b9cc68d7/users/5da28e73e57e4b369af9098c9d47abf4/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:50.405015 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6629b-c65c-4d0a-8ba3-89d1453209b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7cd954e96a491a9e2fcbf6b9cc68d7, user_id=5da28e73e57e4b369af9098c9d47abf4, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:50.408362 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6629b-c65c-4d0a-8ba3-89d1453209b1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:50.422192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1125/2233] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:50 2021] PUT /identity/v3/projects/bd7cd954e96a491a9e2fcbf6b9cc68d7/users/5da28e73e57e4b369af9098c9d47abf4/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:50.432625 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8254d-e96b-40ce-b167-c25a41da35b9 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:50.433000 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8254d-e96b-40ce-b167-c25a41da35b9 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:50.433277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8254d-e96b-40ce-b167-c25a41da35b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:50.460587 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-0bb8254d-e96b-40ce-b167-c25a41da35b9 None None] MFA Rules not processed for user `5da28e73e57e4b369af9098c9d47abf4`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:50.461793 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0bb8254d-e96b-40ce-b167-c25a41da35b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:50.530042 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1109/2234] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:50 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:04:50.535326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6629b-c65c-4d0a-8ba3-89d1453209b1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:50.595284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6629b-c65c-4d0a-8ba3-89d1453209b1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:50.599767 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2fb3a-ac4a-42ec-8497-f4dd839f3f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:50.600481 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2fb3a-ac4a-42ec-8497-f4dd839f3f78 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:50.600718 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2fb3a-ac4a-42ec-8497-f4dd839f3f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:50.601009 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2fb3a-ac4a-42ec-8497-f4dd839f3f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:50.601720 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2fb3a-ac4a-42ec-8497-f4dd839f3f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:50.603674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2fb3a-ac4a-42ec-8497-f4dd839f3f78 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:50.633325 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1126/2235] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:50 2021] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:04:50.634810 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8254d-e96b-40ce-b167-c25a41da35b9 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:50.645894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8254d-e96b-40ce-b167-c25a41da35b9 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:50.704875 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32ca61-b717-4caf-83b4-910e7b827059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:50.705700 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32ca61-b717-4caf-83b4-910e7b827059 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:50.706094 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32ca61-b717-4caf-83b4-910e7b827059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:50.706373 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32ca61-b717-4caf-83b4-910e7b827059 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:50.707092 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32ca61-b717-4caf-83b4-910e7b827059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:50.708995 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32ca61-b717-4caf-83b4-910e7b827059 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:50.730833 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1110/2236] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:50 2021] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:04:50.734684 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2fb3a-ac4a-42ec-8497-f4dd839f3f78 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:50.744918 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2fb3a-ac4a-42ec-8497-f4dd839f3f78 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:50.751159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16a23d-87a1-450f-95fb-ec0ced45de88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:50.752257 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16a23d-87a1-450f-95fb-ec0ced45de88 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:50.752679 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16a23d-87a1-450f-95fb-ec0ced45de88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:50.753079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16a23d-87a1-450f-95fb-ec0ced45de88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:50.754206 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16a23d-87a1-450f-95fb-ec0ced45de88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:50.755878 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16a23d-87a1-450f-95fb-ec0ced45de88 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:50.767305 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1127/2237] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:50 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:50.771278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32ca61-b717-4caf-83b4-910e7b827059 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:50.782202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32ca61-b717-4caf-83b4-910e7b827059 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:50.787010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d8b01-acb7-486d-bc21-6e4071ce1484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:50.787886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d8b01-acb7-486d-bc21-6e4071ce1484 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:50.788168 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d8b01-acb7-486d-bc21-6e4071ce1484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:50.788442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d8b01-acb7-486d-bc21-6e4071ce1484 admin admin] PATH_INFO: `/v3/projects/83fda8a37b0941b8a4ed1ddc0f4d49e5/users/7063e161598a4004aff394b541135ff0/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:50.805475 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d8b01-acb7-486d-bc21-6e4071ce1484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83fda8a37b0941b8a4ed1ddc0f4d49e5, user_id=7063e161598a4004aff394b541135ff0, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:50.809563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d8b01-acb7-486d-bc21-6e4071ce1484 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:50.823533 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1111/2238] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:50 2021] PUT /identity/v3/projects/83fda8a37b0941b8a4ed1ddc0f4d49e5/users/7063e161598a4004aff394b541135ff0/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:04:50.828398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16a23d-87a1-450f-95fb-ec0ced45de88 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:50.838837 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16a23d-87a1-450f-95fb-ec0ced45de88 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:50.895641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03f987-6a65-4041-bf7a-a82fc9538ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:50.896227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03f987-6a65-4041-bf7a-a82fc9538ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:50.896504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03f987-6a65-4041-bf7a-a82fc9538ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:50.896775 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03f987-6a65-4041-bf7a-a82fc9538ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:50.897510 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03f987-6a65-4041-bf7a-a82fc9538ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:50.899104 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03f987-6a65-4041-bf7a-a82fc9538ce2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:50.909414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1128/2239] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:04:50 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:04:50.913752 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d8b01-acb7-486d-bc21-6e4071ce1484 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:50.924468 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d8b01-acb7-486d-bc21-6e4071ce1484 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:50.930774 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b08b47-486b-4667-9517-c096c173d1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:50.931836 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b08b47-486b-4667-9517-c096c173d1be admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:50.932440 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b08b47-486b-4667-9517-c096c173d1be admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:50.932779 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b08b47-486b-4667-9517-c096c173d1be admin admin] PATH_INFO: `/v3/projects/83fda8a37b0941b8a4ed1ddc0f4d49e5/users/7063e161598a4004aff394b541135ff0/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:50.935058 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b08b47-486b-4667-9517-c096c173d1be admin admin] RBAC: Authorizing `identity:create_grant(project_id=83fda8a37b0941b8a4ed1ddc0f4d49e5, user_id=7063e161598a4004aff394b541135ff0, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:50.937756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b08b47-486b-4667-9517-c096c173d1be admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:50.948440 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1112/2240] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:04:50 2021] PUT /identity/v3/projects/83fda8a37b0941b8a4ed1ddc0f4d49e5/users/7063e161598a4004aff394b541135ff0/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:50.959958 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed99913-5a68-423e-9cc8-84f942faaa6e None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:50.960295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed99913-5a68-423e-9cc8-84f942faaa6e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:50.960576 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed99913-5a68-423e-9cc8-84f942faaa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:50.998415 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-6ed99913-5a68-423e-9cc8-84f942faaa6e None None] MFA Rules not processed for user `7063e161598a4004aff394b541135ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:50.999954 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6ed99913-5a68-423e-9cc8-84f942faaa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:51.073644 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1129/2241] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:50 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:51.084702 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b08b47-486b-4667-9517-c096c173d1be admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:51.086553 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-48b08b47-486b-4667-9517-c096c173d1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:51.159091 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b08b47-486b-4667-9517-c096c173d1be admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:51.163087 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e103b33-0018-43d8-bcd8-d526746fab4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:51.163832 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e103b33-0018-43d8-bcd8-d526746fab4e service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:51.164004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e103b33-0018-43d8-bcd8-d526746fab4e service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:51.164278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e103b33-0018-43d8-bcd8-d526746fab4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:51.174342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e103b33-0018-43d8-bcd8-d526746fab4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:51.175771 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e103b33-0018-43d8-bcd8-d526746fab4e service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:51.184974 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1113/2242] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:51 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:51.274428 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed99913-5a68-423e-9cc8-84f942faaa6e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:51.284332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed99913-5a68-423e-9cc8-84f942faaa6e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:51.287990 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf5607-1afb-4b32-8a15-4fe072f46865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:51.288627 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf5607-1afb-4b32-8a15-4fe072f46865 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:51.288906 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf5607-1afb-4b32-8a15-4fe072f46865 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:51.289185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf5607-1afb-4b32-8a15-4fe072f46865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:51.345098 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf5607-1afb-4b32-8a15-4fe072f46865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:51.346602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf5607-1afb-4b32-8a15-4fe072f46865 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:51.356193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1130/2243] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:51 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:58.113236 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e103b33-0018-43d8-bcd8-d526746fab4e service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:58.183708 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e103b33-0018-43d8-bcd8-d526746fab4e service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:58.189781 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f27149-3103-44ac-bc62-c714f50967d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:58.190678 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f27149-3103-44ac-bc62-c714f50967d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:58.190957 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f27149-3103-44ac-bc62-c714f50967d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:58.191234 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f27149-3103-44ac-bc62-c714f50967d2 admin admin] PATH_INFO: `/v3/users/5da28e73e57e4b369af9098c9d47abf4` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:58.192442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f27149-3103-44ac-bc62-c714f50967d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da28e73e57e4b369af9098c9d47abf4)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:58.194375 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f27149-3103-44ac-bc62-c714f50967d2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:58.252347 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-67f27149-3103-44ac-bc62-c714f50967d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da28e73e57e4b369af9098c9d47abf4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:58.264832 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-67f27149-3103-44ac-bc62-c714f50967d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da28e73e57e4b369af9098c9d47abf4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:58.273872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-67f27149-3103-44ac-bc62-c714f50967d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da28e73e57e4b369af9098c9d47abf4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:58.281265 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-67f27149-3103-44ac-bc62-c714f50967d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da28e73e57e4b369af9098c9d47abf4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:58.282495 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-67f27149-3103-44ac-bc62-c714f50967d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da28e73e57e4b369af9098c9d47abf4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:58.289086 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1114/2244] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:58 2021] DELETE /identity/v3/users/5da28e73e57e4b369af9098c9d47abf4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:58.293700 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fcccf-dfcd-4874-9b45-643155b9c88e None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:58.294236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fcccf-dfcd-4874-9b45-643155b9c88e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:58.294343 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fcccf-dfcd-4874-9b45-643155b9c88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:58.311724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-977fcccf-dfcd-4874-9b45-643155b9c88e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:58.312922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-977fcccf-dfcd-4874-9b45-643155b9c88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:58.370080 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1131/2245] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:58.384828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f27149-3103-44ac-bc62-c714f50967d2 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:58.386252 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-67f27149-3103-44ac-bc62-c714f50967d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:58.442559 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f27149-3103-44ac-bc62-c714f50967d2 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:58.446602 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cd9bd-9c9e-49a7-af5c-8f8ed4a558a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:58.447014 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cd9bd-9c9e-49a7-af5c-8f8ed4a558a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:58.447096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cd9bd-9c9e-49a7-af5c-8f8ed4a558a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:58.447389 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cd9bd-9c9e-49a7-af5c-8f8ed4a558a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:58.457779 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cd9bd-9c9e-49a7-af5c-8f8ed4a558a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:58.459266 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cd9bd-9c9e-49a7-af5c-8f8ed4a558a3 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:58.469047 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1115/2246] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:04:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:04:59.036983 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fcccf-dfcd-4874-9b45-643155b9c88e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:59.038580 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-977fcccf-dfcd-4874-9b45-643155b9c88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:59.051144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fcccf-dfcd-4874-9b45-643155b9c88e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:59.055777 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10686458-e287-449a-934f-374ff1384d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:59.056657 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10686458-e287-449a-934f-374ff1384d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:59.056939 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10686458-e287-449a-934f-374ff1384d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:59.057213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10686458-e287-449a-934f-374ff1384d49 admin admin] PATH_INFO: `/v3/projects/bd7cd954e96a491a9e2fcbf6b9cc68d7` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:59.058458 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10686458-e287-449a-934f-374ff1384d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7cd954e96a491a9e2fcbf6b9cc68d7)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:59.060355 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10686458-e287-449a-934f-374ff1384d49 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:59.103976 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-10686458-e287-449a-934f-374ff1384d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7cd954e96a491a9e2fcbf6b9cc68d7', 'request_id': 'req-10686458-e287-449a-934f-374ff1384d49'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:59.110696 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-10686458-e287-449a-934f-374ff1384d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7cd954e96a491a9e2fcbf6b9cc68d7', 'request_id': 'req-10686458-e287-449a-934f-374ff1384d49'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:59.116550 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-10686458-e287-449a-934f-374ff1384d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7cd954e96a491a9e2fcbf6b9cc68d7', 'request_id': 'req-10686458-e287-449a-934f-374ff1384d49'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:59.126976 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-10686458-e287-449a-934f-374ff1384d49 admin admin] The token cache is being invalidate because project bd7cd954e96a491a9e2fcbf6b9cc68d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:59.127260 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-10686458-e287-449a-934f-374ff1384d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:59.127885 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-10686458-e287-449a-934f-374ff1384d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:59.129503 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1132/2247] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:59 2021] DELETE /identity/v3/projects/bd7cd954e96a491a9e2fcbf6b9cc68d7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:59.133418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cd9bd-9c9e-49a7-af5c-8f8ed4a558a3 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:59.143667 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cd9bd-9c9e-49a7-af5c-8f8ed4a558a3 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:59.196626 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbde31-d2e2-4418-bb15-45e7c1bda05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:59.197436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbde31-d2e2-4418-bb15-45e7c1bda05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:59.197713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbde31-d2e2-4418-bb15-45e7c1bda05b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:59.198003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbde31-d2e2-4418-bb15-45e7c1bda05b admin admin] PATH_INFO: `/v3/users/7063e161598a4004aff394b541135ff0` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:59.199238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbde31-d2e2-4418-bb15-45e7c1bda05b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7063e161598a4004aff394b541135ff0)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:59.201155 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbde31-d2e2-4418-bb15-45e7c1bda05b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:59.244238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-43cbde31-d2e2-4418-bb15-45e7c1bda05b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7063e161598a4004aff394b541135ff0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:59.256628 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-43cbde31-d2e2-4418-bb15-45e7c1bda05b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7063e161598a4004aff394b541135ff0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:59.263179 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-43cbde31-d2e2-4418-bb15-45e7c1bda05b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7063e161598a4004aff394b541135ff0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:59.270656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-43cbde31-d2e2-4418-bb15-45e7c1bda05b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7063e161598a4004aff394b541135ff0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:59.271342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-43cbde31-d2e2-4418-bb15-45e7c1bda05b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7063e161598a4004aff394b541135ff0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:59.277006 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1116/2248] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:04:59 2021] DELETE /identity/v3/users/7063e161598a4004aff394b541135ff0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:59.581823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10686458-e287-449a-934f-374ff1384d49 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:59.583298 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-10686458-e287-449a-934f-374ff1384d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:59.597160 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10686458-e287-449a-934f-374ff1384d49 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:59.652343 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6ad88-e9bc-4558-b4d0-d64911745201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:59.653185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6ad88-e9bc-4558-b4d0-d64911745201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:59.653462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6ad88-e9bc-4558-b4d0-d64911745201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:59.653732 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6ad88-e9bc-4558-b4d0-d64911745201 admin admin] PATH_INFO: `/v3/projects/83fda8a37b0941b8a4ed1ddc0f4d49e5` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:59.654931 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6ad88-e9bc-4558-b4d0-d64911745201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83fda8a37b0941b8a4ed1ddc0f4d49e5)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:59.656847 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6ad88-e9bc-4558-b4d0-d64911745201 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:59.701306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-fcb6ad88-e9bc-4558-b4d0-d64911745201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83fda8a37b0941b8a4ed1ddc0f4d49e5', 'request_id': 'req-fcb6ad88-e9bc-4558-b4d0-d64911745201'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:59.709857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-fcb6ad88-e9bc-4558-b4d0-d64911745201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83fda8a37b0941b8a4ed1ddc0f4d49e5', 'request_id': 'req-fcb6ad88-e9bc-4558-b4d0-d64911745201'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:59.716094 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-fcb6ad88-e9bc-4558-b4d0-d64911745201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83fda8a37b0941b8a4ed1ddc0f4d49e5', 'request_id': 'req-fcb6ad88-e9bc-4558-b4d0-d64911745201'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:59.726504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-fcb6ad88-e9bc-4558-b4d0-d64911745201 admin admin] The token cache is being invalidate because project 83fda8a37b0941b8a4ed1ddc0f4d49e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:04:59.726798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-fcb6ad88-e9bc-4558-b4d0-d64911745201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:59.727447 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-fcb6ad88-e9bc-4558-b4d0-d64911745201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:04:59.728964 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1133/2249] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:04:59 2021] DELETE /identity/v3/projects/83fda8a37b0941b8a4ed1ddc0f4d49e5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:04:59.734691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef77b9-dda0-4ed8-a3fd-3762c750c3b0 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:59.735470 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef77b9-dda0-4ed8-a3fd-3762c750c3b0 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:59.735754 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef77b9-dda0-4ed8-a3fd-3762c750c3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:59.754107 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-daef77b9-dda0-4ed8-a3fd-3762c750c3b0 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:59.755290 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-daef77b9-dda0-4ed8-a3fd-3762c750c3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:59.813198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1117/2250] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:59.821010 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ffb51-bad7-4403-8b2a-34db620703ea None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:59.821300 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ffb51-bad7-4403-8b2a-34db620703ea None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:59.821581 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ffb51-bad7-4403-8b2a-34db620703ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:59.842508 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-216ffb51-bad7-4403-8b2a-34db620703ea None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:04:59.843727 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-216ffb51-bad7-4403-8b2a-34db620703ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:04:59.852153 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1134/2251] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:04:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:04:59.856453 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef77b9-dda0-4ed8-a3fd-3762c750c3b0 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:59.866660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef77b9-dda0-4ed8-a3fd-3762c750c3b0 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:59.871656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c349cf-b787-4d04-808f-9a6e6298e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:59.872418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c349cf-b787-4d04-808f-9a6e6298e7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:59.872704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c349cf-b787-4d04-808f-9a6e6298e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:59.872980 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c349cf-b787-4d04-808f-9a6e6298e7b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:59.873795 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c349cf-b787-4d04-808f-9a6e6298e7b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:04:59.874154 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c349cf-b787-4d04-808f-9a6e6298e7b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:59.875806 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c349cf-b787-4d04-808f-9a6e6298e7b2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:59.891287 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1118/2252] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:04:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:04:59.892493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ffb51-bad7-4403-8b2a-34db620703ea None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:59.901843 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ffb51-bad7-4403-8b2a-34db620703ea None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:04:59.907279 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdfe17-b75c-411f-ba50-4c83080309dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:04:59.907991 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdfe17-b75c-411f-ba50-4c83080309dc admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:04:59.908356 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdfe17-b75c-411f-ba50-4c83080309dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:04:59.908647 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdfe17-b75c-411f-ba50-4c83080309dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:04:59.909346 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdfe17-b75c-411f-ba50-4c83080309dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:04:59.911247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdfe17-b75c-411f-ba50-4c83080309dc admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:04:59.940186 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1135/2253] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:04:59 2021] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:04:59.941365 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c349cf-b787-4d04-808f-9a6e6298e7b2 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:04:59.951212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c349cf-b787-4d04-808f-9a6e6298e7b2 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:00.005552 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b35631-264c-41a5-a514-6342368be821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:00.006231 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b35631-264c-41a5-a514-6342368be821 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:00.006507 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b35631-264c-41a5-a514-6342368be821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:00.006774 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b35631-264c-41a5-a514-6342368be821 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:00.007455 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b35631-264c-41a5-a514-6342368be821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:00.009325 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b35631-264c-41a5-a514-6342368be821 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:00.027785 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1119/2254] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:04:59 2021] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:05:00.032361 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdfe17-b75c-411f-ba50-4c83080309dc admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:00.042255 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdfe17-b75c-411f-ba50-4c83080309dc admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:00.046849 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a4754-fdab-4851-9e4a-70859618fac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:00.048155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a4754-fdab-4851-9e4a-70859618fac7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:00.048439 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a4754-fdab-4851-9e4a-70859618fac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:00.048714 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a4754-fdab-4851-9e4a-70859618fac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:00.049447 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a4754-fdab-4851-9e4a-70859618fac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:00.051072 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a4754-fdab-4851-9e4a-70859618fac7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:00.061373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1136/2255] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:05:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:05:00.065271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b35631-264c-41a5-a514-6342368be821 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:00.076200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b35631-264c-41a5-a514-6342368be821 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:00.080995 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66476d-8557-4b2b-b660-02f3b950a866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:00.081763 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66476d-8557-4b2b-b660-02f3b950a866 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:00.082026 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66476d-8557-4b2b-b660-02f3b950a866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:00.082286 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66476d-8557-4b2b-b660-02f3b950a866 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:00.083032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66476d-8557-4b2b-b660-02f3b950a866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:00.084631 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66476d-8557-4b2b-b660-02f3b950a866 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:00.095119 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1120/2256] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:05:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:05:00.099409 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a4754-fdab-4851-9e4a-70859618fac7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:00.110502 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a4754-fdab-4851-9e4a-70859618fac7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:00.115326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49a522-f436-4d91-95d3-049fefc51a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:00.116285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49a522-f436-4d91-95d3-049fefc51a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:00.116636 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49a522-f436-4d91-95d3-049fefc51a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:00.116984 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49a522-f436-4d91-95d3-049fefc51a9e admin admin] PATH_INFO: `/v3/projects/75008941571f4bfbb572005b0859c13f/users/02ddfd8a3fb74ae7b62ddeef81592b78/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:00.131751 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49a522-f436-4d91-95d3-049fefc51a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=75008941571f4bfbb572005b0859c13f, user_id=02ddfd8a3fb74ae7b62ddeef81592b78, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:00.134551 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49a522-f436-4d91-95d3-049fefc51a9e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:00.147827 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1137/2257] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:05:00 2021] PUT /identity/v3/projects/75008941571f4bfbb572005b0859c13f/users/02ddfd8a3fb74ae7b62ddeef81592b78/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:00.158130 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c850af0-b914-4581-834f-9d569387e0c8 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:00.158611 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c850af0-b914-4581-834f-9d569387e0c8 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:00.158918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c850af0-b914-4581-834f-9d569387e0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:00.185393 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-7c850af0-b914-4581-834f-9d569387e0c8 None None] MFA Rules not processed for user `02ddfd8a3fb74ae7b62ddeef81592b78`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:00.186751 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-7c850af0-b914-4581-834f-9d569387e0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:00.253397 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1121/2258] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:00 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:00.257726 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49a522-f436-4d91-95d3-049fefc51a9e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:00.317010 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49a522-f436-4d91-95d3-049fefc51a9e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:00.321645 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c338f6-8a87-4f8b-819c-500462c95178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:00.322338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c338f6-8a87-4f8b-819c-500462c95178 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:00.322621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c338f6-8a87-4f8b-819c-500462c95178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:00.322895 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c338f6-8a87-4f8b-819c-500462c95178 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:00.323603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c338f6-8a87-4f8b-819c-500462c95178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:00.325477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c338f6-8a87-4f8b-819c-500462c95178 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:00.349072 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1138/2259] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:05:00 2021] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:05:00.352999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c850af0-b914-4581-834f-9d569387e0c8 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:00.363686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c850af0-b914-4581-834f-9d569387e0c8 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:00.416921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d7713-270b-4fa9-96e2-53741e56d5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:00.417567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d7713-270b-4fa9-96e2-53741e56d5fa admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:00.417844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d7713-270b-4fa9-96e2-53741e56d5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:00.418150 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d7713-270b-4fa9-96e2-53741e56d5fa admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:00.418842 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d7713-270b-4fa9-96e2-53741e56d5fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:00.420723 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d7713-270b-4fa9-96e2-53741e56d5fa admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:00.441168 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1122/2260] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:05:00 2021] POST /identity/v3/users => generated 298 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:05:00.445186 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c338f6-8a87-4f8b-819c-500462c95178 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:00.455736 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c338f6-8a87-4f8b-819c-500462c95178 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:00.460323 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e667c1f-7799-4942-9507-4dc2ebfe0f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:00.460989 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e667c1f-7799-4942-9507-4dc2ebfe0f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:00.461283 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e667c1f-7799-4942-9507-4dc2ebfe0f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:00.461544 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e667c1f-7799-4942-9507-4dc2ebfe0f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:00.462317 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e667c1f-7799-4942-9507-4dc2ebfe0f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:00.463925 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e667c1f-7799-4942-9507-4dc2ebfe0f27 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:00.474672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1139/2261] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:05:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:05:00.478871 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d7713-270b-4fa9-96e2-53741e56d5fa admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:00.489061 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d7713-270b-4fa9-96e2-53741e56d5fa admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:00.494360 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f453f0-5728-4421-b804-7c86465be18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:00.495228 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f453f0-5728-4421-b804-7c86465be18e admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:00.495500 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f453f0-5728-4421-b804-7c86465be18e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:00.495770 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f453f0-5728-4421-b804-7c86465be18e admin admin] PATH_INFO: `/v3/projects/35fa7187190b4f50823784bcd81e427d/users/e694cca1592c4197a64f06a33a120e12/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:00.512148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f453f0-5728-4421-b804-7c86465be18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=35fa7187190b4f50823784bcd81e427d, user_id=e694cca1592c4197a64f06a33a120e12, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:00.514806 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f453f0-5728-4421-b804-7c86465be18e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:00.528466 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1123/2262] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:05:00 2021] PUT /identity/v3/projects/35fa7187190b4f50823784bcd81e427d/users/e694cca1592c4197a64f06a33a120e12/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:00.532445 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e667c1f-7799-4942-9507-4dc2ebfe0f27 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:00.542463 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e667c1f-7799-4942-9507-4dc2ebfe0f27 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:00.608726 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad629d48-1071-4f56-8372-8477dcd63da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:00.609426 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad629d48-1071-4f56-8372-8477dcd63da3 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:00.609661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad629d48-1071-4f56-8372-8477dcd63da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:00.609973 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad629d48-1071-4f56-8372-8477dcd63da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:00.610736 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad629d48-1071-4f56-8372-8477dcd63da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:00.612437 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad629d48-1071-4f56-8372-8477dcd63da3 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:00.630355 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1140/2263] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:05:00 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:05:00.634621 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f453f0-5728-4421-b804-7c86465be18e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:00.646279 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f453f0-5728-4421-b804-7c86465be18e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:00.655574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e7276-820c-4ed2-b1f1-ad45ba822f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:00.655574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e7276-820c-4ed2-b1f1-ad45ba822f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:00.655574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e7276-820c-4ed2-b1f1-ad45ba822f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:00.655574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e7276-820c-4ed2-b1f1-ad45ba822f9b admin admin] PATH_INFO: `/v3/projects/35fa7187190b4f50823784bcd81e427d/users/e694cca1592c4197a64f06a33a120e12/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:00.656037 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e7276-820c-4ed2-b1f1-ad45ba822f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=35fa7187190b4f50823784bcd81e427d, user_id=e694cca1592c4197a64f06a33a120e12, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:00.657488 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e7276-820c-4ed2-b1f1-ad45ba822f9b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:00.669621 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1124/2264] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:05:00 2021] PUT /identity/v3/projects/35fa7187190b4f50823784bcd81e427d/users/e694cca1592c4197a64f06a33a120e12/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:00.680743 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f6696-8864-4670-8579-43da8d38f058 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:00.681155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f6696-8864-4670-8579-43da8d38f058 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:00.681565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f6696-8864-4670-8579-43da8d38f058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:00.714259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-af7f6696-8864-4670-8579-43da8d38f058 None None] MFA Rules not processed for user `e694cca1592c4197a64f06a33a120e12`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:00.715639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-af7f6696-8864-4670-8579-43da8d38f058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:00.812135 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1141/2265] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:00 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:00.822744 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e7276-820c-4ed2-b1f1-ad45ba822f9b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:00.824433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8a7e7276-820c-4ed2-b1f1-ad45ba822f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:00.884360 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e7276-820c-4ed2-b1f1-ad45ba822f9b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:00.888172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf39a7-f6c4-4f48-96a3-fe7efa2b8d35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:00.888825 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf39a7-f6c4-4f48-96a3-fe7efa2b8d35 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:00.889081 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf39a7-f6c4-4f48-96a3-fe7efa2b8d35 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:00.889354 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf39a7-f6c4-4f48-96a3-fe7efa2b8d35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:00.945436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf39a7-f6c4-4f48-96a3-fe7efa2b8d35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:00.947271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf39a7-f6c4-4f48-96a3-fe7efa2b8d35 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:00.957292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1125/2266] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:05:00 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:05:08.409038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f6696-8864-4670-8579-43da8d38f058 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:08.420708 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f6696-8864-4670-8579-43da8d38f058 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:08.425412 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9d7f4-bcfc-4151-a2ed-387da078e419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:08.426138 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9d7f4-bcfc-4151-a2ed-387da078e419 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:08.426418 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9d7f4-bcfc-4151-a2ed-387da078e419 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:08.426691 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9d7f4-bcfc-4151-a2ed-387da078e419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:08.437207 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9d7f4-bcfc-4151-a2ed-387da078e419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:08.439672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9d7f4-bcfc-4151-a2ed-387da078e419 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:08.449947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1142/2267] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:05:08 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:05:08.685110 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf39a7-f6c4-4f48-96a3-fe7efa2b8d35 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:08.687419 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-95cf39a7-f6c4-4f48-96a3-fe7efa2b8d35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:08.785963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf39a7-f6c4-4f48-96a3-fe7efa2b8d35 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:08.790941 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2db4ef-6481-433d-b846-0727824b266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:08.791921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2db4ef-6481-433d-b846-0727824b266b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:08.792327 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2db4ef-6481-433d-b846-0727824b266b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:08.792861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2db4ef-6481-433d-b846-0727824b266b admin admin] PATH_INFO: `/v3/users/7abeef348d064ed88c8a01d93120968d` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:08.794196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2db4ef-6481-433d-b846-0727824b266b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abeef348d064ed88c8a01d93120968d)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:08.796277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2db4ef-6481-433d-b846-0727824b266b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:08.869896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cb2db4ef-6481-433d-b846-0727824b266b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abeef348d064ed88c8a01d93120968d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:08.885747 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cb2db4ef-6481-433d-b846-0727824b266b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abeef348d064ed88c8a01d93120968d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:08.900662 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cb2db4ef-6481-433d-b846-0727824b266b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abeef348d064ed88c8a01d93120968d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:08.909663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cb2db4ef-6481-433d-b846-0727824b266b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abeef348d064ed88c8a01d93120968d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:08.910662 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cb2db4ef-6481-433d-b846-0727824b266b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abeef348d064ed88c8a01d93120968d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:08.918115 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1126/2268] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:05:08 2021] DELETE /identity/v3/users/7abeef348d064ed88c8a01d93120968d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:08.922980 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a1bc0-f148-4e3c-95fd-db5fcaeb9019 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:08.923425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a1bc0-f148-4e3c-95fd-db5fcaeb9019 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:08.923706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a1bc0-f148-4e3c-95fd-db5fcaeb9019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:08.946614 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-fe7a1bc0-f148-4e3c-95fd-db5fcaeb9019 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:08.947984 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-fe7a1bc0-f148-4e3c-95fd-db5fcaeb9019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:09.013745 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1143/2269] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:05:09.035300 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2db4ef-6481-433d-b846-0727824b266b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:09.037010 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-cb2db4ef-6481-433d-b846-0727824b266b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:09.103373 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2db4ef-6481-433d-b846-0727824b266b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:09.107193 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716593c3-cdf8-4c16-a994-f98e877bba7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:09.107829 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716593c3-cdf8-4c16-a994-f98e877bba7e service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:09.108107 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716593c3-cdf8-4c16-a994-f98e877bba7e service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:09.108380 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716593c3-cdf8-4c16-a994-f98e877bba7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:09.119628 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716593c3-cdf8-4c16-a994-f98e877bba7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:09.121333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716593c3-cdf8-4c16-a994-f98e877bba7e service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:09.133441 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1127/2270] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:05:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:05:09.450596 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a1bc0-f148-4e3c-95fd-db5fcaeb9019 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:09.452174 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-fe7a1bc0-f148-4e3c-95fd-db5fcaeb9019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:09.468342 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a1bc0-f148-4e3c-95fd-db5fcaeb9019 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:09.475370 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2620d5-145c-402b-b466-ff48634e59ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:09.477956 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2620d5-145c-402b-b466-ff48634e59ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:09.478596 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2620d5-145c-402b-b466-ff48634e59ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:09.479223 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2620d5-145c-402b-b466-ff48634e59ce admin admin] PATH_INFO: `/v3/projects/fd3a5613e65f48c6b759d17750797b33` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:09.480770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2620d5-145c-402b-b466-ff48634e59ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd3a5613e65f48c6b759d17750797b33)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:09.484112 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2620d5-145c-402b-b466-ff48634e59ce admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:09.567380 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-eb2620d5-145c-402b-b466-ff48634e59ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd3a5613e65f48c6b759d17750797b33', 'request_id': 'req-eb2620d5-145c-402b-b466-ff48634e59ce'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:09.581097 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-eb2620d5-145c-402b-b466-ff48634e59ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd3a5613e65f48c6b759d17750797b33', 'request_id': 'req-eb2620d5-145c-402b-b466-ff48634e59ce'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:09.589059 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-eb2620d5-145c-402b-b466-ff48634e59ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd3a5613e65f48c6b759d17750797b33', 'request_id': 'req-eb2620d5-145c-402b-b466-ff48634e59ce'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:09.611939 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-eb2620d5-145c-402b-b466-ff48634e59ce admin admin] The token cache is being invalidate because project fd3a5613e65f48c6b759d17750797b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:05:09.611939 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-eb2620d5-145c-402b-b466-ff48634e59ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:09.611939 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-eb2620d5-145c-402b-b466-ff48634e59ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:09.613420 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1144/2271] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:05:09 2021] DELETE /identity/v3/projects/fd3a5613e65f48c6b759d17750797b33 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:05:11.890202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be3ec7-bc8c-4517-80ce-c4fb152f0bd7 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:11.891652 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be3ec7-bc8c-4517-80ce-c4fb152f0bd7 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:11.891932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be3ec7-bc8c-4517-80ce-c4fb152f0bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:11.911456 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-04be3ec7-bc8c-4517-80ce-c4fb152f0bd7 None None] MFA Rules not processed for user `35d37a3d8e504b8186182468b77dd114`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:11.912690 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-04be3ec7-bc8c-4517-80ce-c4fb152f0bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:11.971036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1128/2272] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:11 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:12.092933 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2620d5-145c-402b-b466-ff48634e59ce admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:12.095020 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-eb2620d5-145c-402b-b466-ff48634e59ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:12.166812 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2620d5-145c-402b-b466-ff48634e59ce admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:12.171374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4711c2d-8c2c-4b1b-b081-0e305b3173fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:12.172757 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4711c2d-8c2c-4b1b-b081-0e305b3173fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:12.173035 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4711c2d-8c2c-4b1b-b081-0e305b3173fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:12.173307 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4711c2d-8c2c-4b1b-b081-0e305b3173fb admin admin] PATH_INFO: `/v3/users/1652c5cc8fc047f0b66521291bac424c` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:12.174505 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4711c2d-8c2c-4b1b-b081-0e305b3173fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1652c5cc8fc047f0b66521291bac424c)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:12.176411 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4711c2d-8c2c-4b1b-b081-0e305b3173fb admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:12.237092 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e4711c2d-8c2c-4b1b-b081-0e305b3173fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1652c5cc8fc047f0b66521291bac424c'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:12.252697 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e4711c2d-8c2c-4b1b-b081-0e305b3173fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1652c5cc8fc047f0b66521291bac424c'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:12.263120 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e4711c2d-8c2c-4b1b-b081-0e305b3173fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1652c5cc8fc047f0b66521291bac424c'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:12.263120 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e4711c2d-8c2c-4b1b-b081-0e305b3173fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1652c5cc8fc047f0b66521291bac424c'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:12.263983 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e4711c2d-8c2c-4b1b-b081-0e305b3173fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1652c5cc8fc047f0b66521291bac424c'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:12.282980 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea63df0-c465-4998-8120-db7e28132c21 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:12.283372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea63df0-c465-4998-8120-db7e28132c21 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:12.283551 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1145/2273] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:05:12 2021] DELETE /identity/v3/users/1652c5cc8fc047f0b66521291bac424c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:12.283760 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea63df0-c465-4998-8120-db7e28132c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:12.316102 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-fea63df0-c465-4998-8120-db7e28132c21 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:12.316102 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-fea63df0-c465-4998-8120-db7e28132c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:12.401418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1129/2274] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:12.416329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4711c2d-8c2c-4b1b-b081-0e305b3173fb admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:12.418275 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e4711c2d-8c2c-4b1b-b081-0e305b3173fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:12.488381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4711c2d-8c2c-4b1b-b081-0e305b3173fb admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:12.492142 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd200f33-8096-4aad-8cee-29acb8e32881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:12.492782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd200f33-8096-4aad-8cee-29acb8e32881 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:12.493062 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd200f33-8096-4aad-8cee-29acb8e32881 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:12.493334 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd200f33-8096-4aad-8cee-29acb8e32881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:12.503966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd200f33-8096-4aad-8cee-29acb8e32881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:12.505492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd200f33-8096-4aad-8cee-29acb8e32881 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:12.518018 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1146/2275] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:05:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:05:12.852321 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fbc11-d429-4a98-8b2c-1e0400f6cf9f None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:12.852643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fbc11-d429-4a98-8b2c-1e0400f6cf9f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:12.852882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fbc11-d429-4a98-8b2c-1e0400f6cf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:12.874464 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-dd3fbc11-d429-4a98-8b2c-1e0400f6cf9f None None] MFA Rules not processed for user `0e440754469c4407840a651d560ce08a`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:12.875697 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-dd3fbc11-d429-4a98-8b2c-1e0400f6cf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:12.882842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd200f33-8096-4aad-8cee-29acb8e32881 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:12.884225 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-cd200f33-8096-4aad-8cee-29acb8e32881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:12.903921 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd200f33-8096-4aad-8cee-29acb8e32881 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:12.913321 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95e5c0-fd5a-4c86-b282-c917d7f73a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:12.914362 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e5c0-fd5a-4c86-b282-c917d7f73a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:12.915088 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e5c0-fd5a-4c86-b282-c917d7f73a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:12.915386 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e5c0-fd5a-4c86-b282-c917d7f73a5a admin admin] PATH_INFO: `/v3/projects/13a97edaa5c64af993a167be7d499771` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:12.917458 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95e5c0-fd5a-4c86-b282-c917d7f73a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a97edaa5c64af993a167be7d499771)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:12.919725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95e5c0-fd5a-4c86-b282-c917d7f73a5a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:12.956677 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1130/2276] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:12 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:12.981122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4f95e5c0-fd5a-4c86-b282-c917d7f73a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a97edaa5c64af993a167be7d499771', 'request_id': 'req-4f95e5c0-fd5a-4c86-b282-c917d7f73a5a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:12.994077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4f95e5c0-fd5a-4c86-b282-c917d7f73a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a97edaa5c64af993a167be7d499771', 'request_id': 'req-4f95e5c0-fd5a-4c86-b282-c917d7f73a5a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:13.001794 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4f95e5c0-fd5a-4c86-b282-c917d7f73a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a97edaa5c64af993a167be7d499771', 'request_id': 'req-4f95e5c0-fd5a-4c86-b282-c917d7f73a5a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:13.014337 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4f95e5c0-fd5a-4c86-b282-c917d7f73a5a admin admin] The token cache is being invalidate because project 13a97edaa5c64af993a167be7d499771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:05:13.016528 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4f95e5c0-fd5a-4c86-b282-c917d7f73a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:13.017316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4f95e5c0-fd5a-4c86-b282-c917d7f73a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:13.019247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1147/2277] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:05:12 2021] DELETE /identity/v3/projects/13a97edaa5c64af993a167be7d499771 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:13.024747 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705f5ec-c896-493d-92bd-2c4e1425220b None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:13.025030 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705f5ec-c896-493d-92bd-2c4e1425220b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:13.025363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705f5ec-c896-493d-92bd-2c4e1425220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:13.044565 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-6705f5ec-c896-493d-92bd-2c4e1425220b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:13.045761 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6705f5ec-c896-493d-92bd-2c4e1425220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:13.118035 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1131/2278] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:05:13.127406 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d816eb5-09b3-4674-9f69-9baf68630b2d None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:13.127993 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d816eb5-09b3-4674-9f69-9baf68630b2d None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:13.127993 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d816eb5-09b3-4674-9f69-9baf68630b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:13.151878 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-4d816eb5-09b3-4674-9f69-9baf68630b2d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:13.153252 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4d816eb5-09b3-4674-9f69-9baf68630b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:13.163570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1148/2279] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:05:13.168040 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705f5ec-c896-493d-92bd-2c4e1425220b None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:13.178819 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705f5ec-c896-493d-92bd-2c4e1425220b None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:13.183811 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b53e7e-5f91-4ba4-8c6f-fe2b5c172603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:13.184466 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b53e7e-5f91-4ba4-8c6f-fe2b5c172603 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:13.184744 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b53e7e-5f91-4ba4-8c6f-fe2b5c172603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:13.185016 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b53e7e-5f91-4ba4-8c6f-fe2b5c172603 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:13.185849 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b53e7e-5f91-4ba4-8c6f-fe2b5c172603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:05:13.186213 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b53e7e-5f91-4ba4-8c6f-fe2b5c172603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:13.191548 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b53e7e-5f91-4ba4-8c6f-fe2b5c172603 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:13.205233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1132/2280] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:05:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 03:05:13.209928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d816eb5-09b3-4674-9f69-9baf68630b2d None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:13.219469 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d816eb5-09b3-4674-9f69-9baf68630b2d None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:13.225150 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a42ac-ece3-4581-9304-6b0ba4396a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:13.225844 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a42ac-ece3-4581-9304-6b0ba4396a7f admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:13.226178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a42ac-ece3-4581-9304-6b0ba4396a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:13.226442 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a42ac-ece3-4581-9304-6b0ba4396a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:13.227155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a42ac-ece3-4581-9304-6b0ba4396a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:13.229054 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a42ac-ece3-4581-9304-6b0ba4396a7f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:13.257628 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1149/2281] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:05:13 2021] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:05:13.261325 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b53e7e-5f91-4ba4-8c6f-fe2b5c172603 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:13.273191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b53e7e-5f91-4ba4-8c6f-fe2b5c172603 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:13.350273 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12edba0-d47f-4025-b27d-8c0170651788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:13.351173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12edba0-d47f-4025-b27d-8c0170651788 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:13.351464 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12edba0-d47f-4025-b27d-8c0170651788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:13.351902 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12edba0-d47f-4025-b27d-8c0170651788 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:13.352666 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12edba0-d47f-4025-b27d-8c0170651788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:13.354901 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12edba0-d47f-4025-b27d-8c0170651788 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:13.379104 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1133/2282] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:05:13 2021] POST /identity/v3/users => generated 283 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:05:13.382891 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a42ac-ece3-4581-9304-6b0ba4396a7f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:13.397147 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a42ac-ece3-4581-9304-6b0ba4396a7f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:13.402282 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e87c84-376f-475f-8427-24816c00da5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:13.403163 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e87c84-376f-475f-8427-24816c00da5b admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:13.403597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e87c84-376f-475f-8427-24816c00da5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:13.404133 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e87c84-376f-475f-8427-24816c00da5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:13.405327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e87c84-376f-475f-8427-24816c00da5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:13.407007 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e87c84-376f-475f-8427-24816c00da5b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:13.424810 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1150/2283] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:05:13 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:05:13.426187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12edba0-d47f-4025-b27d-8c0170651788 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:13.442254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12edba0-d47f-4025-b27d-8c0170651788 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:13.448478 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cdfe2-ccbb-4c64-bf49-345c56b2b59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:13.449263 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cdfe2-ccbb-4c64-bf49-345c56b2b59b admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:13.449474 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cdfe2-ccbb-4c64-bf49-345c56b2b59b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:13.449768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cdfe2-ccbb-4c64-bf49-345c56b2b59b admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:13.450897 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cdfe2-ccbb-4c64-bf49-345c56b2b59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:13.452119 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cdfe2-ccbb-4c64-bf49-345c56b2b59b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:13.464353 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1134/2284] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:05:13 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:05:13.468277 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e87c84-376f-475f-8427-24816c00da5b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:13.479270 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e87c84-376f-475f-8427-24816c00da5b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:13.487133 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b2d6b-afdb-46dc-988b-c20646e4c862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:13.488306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b2d6b-afdb-46dc-988b-c20646e4c862 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:13.488589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b2d6b-afdb-46dc-988b-c20646e4c862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:13.488860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b2d6b-afdb-46dc-988b-c20646e4c862 admin admin] PATH_INFO: `/v3/projects/4abb5d3d3a7b4a4a90b71be7ef587768/users/84e48a2888d34940baecd302fe59f9f8/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:13.516283 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b2d6b-afdb-46dc-988b-c20646e4c862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4abb5d3d3a7b4a4a90b71be7ef587768, user_id=84e48a2888d34940baecd302fe59f9f8, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:13.519129 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b2d6b-afdb-46dc-988b-c20646e4c862 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:13.534406 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1151/2285] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:05:13 2021] PUT /identity/v3/projects/4abb5d3d3a7b4a4a90b71be7ef587768/users/84e48a2888d34940baecd302fe59f9f8/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:13.545103 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63c332-4041-4ff2-b2bd-44099820c11f None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:13.545388 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63c332-4041-4ff2-b2bd-44099820c11f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:13.545720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63c332-4041-4ff2-b2bd-44099820c11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:13.592781 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-cd63c332-4041-4ff2-b2bd-44099820c11f None None] MFA Rules not processed for user `84e48a2888d34940baecd302fe59f9f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:13.594232 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-cd63c332-4041-4ff2-b2bd-44099820c11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:13.677341 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1135/2286] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:13 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:13.689165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b2d6b-afdb-46dc-988b-c20646e4c862 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:13.690957 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c29b2d6b-afdb-46dc-988b-c20646e4c862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:13.771137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b2d6b-afdb-46dc-988b-c20646e4c862 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:13.775221 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965515f-1117-41e3-a9c1-acd9d47e2024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:13.775866 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965515f-1117-41e3-a9c1-acd9d47e2024 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:13.776192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965515f-1117-41e3-a9c1-acd9d47e2024 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:13.776470 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965515f-1117-41e3-a9c1-acd9d47e2024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:13.789028 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965515f-1117-41e3-a9c1-acd9d47e2024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:13.791165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965515f-1117-41e3-a9c1-acd9d47e2024 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:13.804701 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1152/2287] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:05:13 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:05:14.547031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63c332-4041-4ff2-b2bd-44099820c11f None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:14.548544 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-cd63c332-4041-4ff2-b2bd-44099820c11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:14.620946 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63c332-4041-4ff2-b2bd-44099820c11f None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:14.625810 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878d761-ec7e-4e1d-aeab-2a9a1ef1d4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:14.626714 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878d761-ec7e-4e1d-aeab-2a9a1ef1d4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:14.626992 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878d761-ec7e-4e1d-aeab-2a9a1ef1d4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:14.627263 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878d761-ec7e-4e1d-aeab-2a9a1ef1d4a0 admin admin] PATH_INFO: `/v3/users/02ddfd8a3fb74ae7b62ddeef81592b78` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:14.628608 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878d761-ec7e-4e1d-aeab-2a9a1ef1d4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ddfd8a3fb74ae7b62ddeef81592b78)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:14.630602 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878d761-ec7e-4e1d-aeab-2a9a1ef1d4a0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:14.686928 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4878d761-ec7e-4e1d-aeab-2a9a1ef1d4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ddfd8a3fb74ae7b62ddeef81592b78'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:14.702358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4878d761-ec7e-4e1d-aeab-2a9a1ef1d4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ddfd8a3fb74ae7b62ddeef81592b78'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:14.733037 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4878d761-ec7e-4e1d-aeab-2a9a1ef1d4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ddfd8a3fb74ae7b62ddeef81592b78'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:14.747984 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4878d761-ec7e-4e1d-aeab-2a9a1ef1d4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ddfd8a3fb74ae7b62ddeef81592b78'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:14.749452 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4878d761-ec7e-4e1d-aeab-2a9a1ef1d4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ddfd8a3fb74ae7b62ddeef81592b78'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:14.763836 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1136/2288] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:05:14 2021] DELETE /identity/v3/users/02ddfd8a3fb74ae7b62ddeef81592b78 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:14.765571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab436b-921c-4e48-9a4b-39277d4349fb None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:14.766135 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab436b-921c-4e48-9a4b-39277d4349fb None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:14.766217 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab436b-921c-4e48-9a4b-39277d4349fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:14.787323 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-18ab436b-921c-4e48-9a4b-39277d4349fb None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:14.788534 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-18ab436b-921c-4e48-9a4b-39277d4349fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:14.898661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1153/2289] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:14.910239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878d761-ec7e-4e1d-aeab-2a9a1ef1d4a0 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:14.912243 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-4878d761-ec7e-4e1d-aeab-2a9a1ef1d4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:15.046556 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878d761-ec7e-4e1d-aeab-2a9a1ef1d4a0 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:15.051772 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156c202-90a3-475c-901d-ea0b20ccd85e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:15.052601 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156c202-90a3-475c-901d-ea0b20ccd85e service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:15.053436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156c202-90a3-475c-901d-ea0b20ccd85e service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:15.053436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156c202-90a3-475c-901d-ea0b20ccd85e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:15.071920 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156c202-90a3-475c-901d-ea0b20ccd85e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:15.073000 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156c202-90a3-475c-901d-ea0b20ccd85e service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:15.085941 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1137/2290] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:05:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:05:16.199856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab436b-921c-4e48-9a4b-39277d4349fb None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:16.207227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-18ab436b-921c-4e48-9a4b-39277d4349fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:16.222996 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab436b-921c-4e48-9a4b-39277d4349fb None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:16.228490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623eef6e-f717-4387-b2a3-32dc89a7d663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:16.229372 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623eef6e-f717-4387-b2a3-32dc89a7d663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:16.229657 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623eef6e-f717-4387-b2a3-32dc89a7d663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:16.229956 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623eef6e-f717-4387-b2a3-32dc89a7d663 admin admin] PATH_INFO: `/v3/projects/75008941571f4bfbb572005b0859c13f` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:16.231461 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623eef6e-f717-4387-b2a3-32dc89a7d663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75008941571f4bfbb572005b0859c13f)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:16.233533 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623eef6e-f717-4387-b2a3-32dc89a7d663 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:16.296246 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-623eef6e-f717-4387-b2a3-32dc89a7d663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75008941571f4bfbb572005b0859c13f', 'request_id': 'req-623eef6e-f717-4387-b2a3-32dc89a7d663'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:16.309102 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-623eef6e-f717-4387-b2a3-32dc89a7d663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75008941571f4bfbb572005b0859c13f', 'request_id': 'req-623eef6e-f717-4387-b2a3-32dc89a7d663'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:16.319872 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-623eef6e-f717-4387-b2a3-32dc89a7d663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75008941571f4bfbb572005b0859c13f', 'request_id': 'req-623eef6e-f717-4387-b2a3-32dc89a7d663'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:16.332898 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-623eef6e-f717-4387-b2a3-32dc89a7d663 admin admin] The token cache is being invalidate because project 75008941571f4bfbb572005b0859c13f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:05:16.333189 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-623eef6e-f717-4387-b2a3-32dc89a7d663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:16.334092 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-623eef6e-f717-4387-b2a3-32dc89a7d663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:16.335634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1154/2291] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:05:16 2021] DELETE /identity/v3/projects/75008941571f4bfbb572005b0859c13f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:16.339870 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156c202-90a3-475c-901d-ea0b20ccd85e service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:16.351403 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156c202-90a3-475c-901d-ea0b20ccd85e service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:16.454485 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32ffc3-5594-4de6-9131-719126f1ffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:16.455372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32ffc3-5594-4de6-9131-719126f1ffb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:16.455658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32ffc3-5594-4de6-9131-719126f1ffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:16.456728 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32ffc3-5594-4de6-9131-719126f1ffb1 admin admin] PATH_INFO: `/v3/users/e694cca1592c4197a64f06a33a120e12` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:16.461746 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32ffc3-5594-4de6-9131-719126f1ffb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e694cca1592c4197a64f06a33a120e12)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:16.463006 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32ffc3-5594-4de6-9131-719126f1ffb1 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:16.550520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ff32ffc3-5594-4de6-9131-719126f1ffb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e694cca1592c4197a64f06a33a120e12'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:16.590899 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ff32ffc3-5594-4de6-9131-719126f1ffb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e694cca1592c4197a64f06a33a120e12'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:16.601314 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ff32ffc3-5594-4de6-9131-719126f1ffb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e694cca1592c4197a64f06a33a120e12'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:16.613300 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ff32ffc3-5594-4de6-9131-719126f1ffb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e694cca1592c4197a64f06a33a120e12'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:16.614314 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ff32ffc3-5594-4de6-9131-719126f1ffb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e694cca1592c4197a64f06a33a120e12'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:16.622890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1138/2292] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:05:16 2021] DELETE /identity/v3/users/e694cca1592c4197a64f06a33a120e12 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:17.389818 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623eef6e-f717-4387-b2a3-32dc89a7d663 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:17.392066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-623eef6e-f717-4387-b2a3-32dc89a7d663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:17.413584 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623eef6e-f717-4387-b2a3-32dc89a7d663 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:17.523584 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f30cc6-c50c-4de5-89c8-a4cab34aef97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:17.524339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f30cc6-c50c-4de5-89c8-a4cab34aef97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:17.524646 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f30cc6-c50c-4de5-89c8-a4cab34aef97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:17.524904 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f30cc6-c50c-4de5-89c8-a4cab34aef97 admin admin] PATH_INFO: `/v3/projects/35fa7187190b4f50823784bcd81e427d` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:17.526201 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f30cc6-c50c-4de5-89c8-a4cab34aef97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35fa7187190b4f50823784bcd81e427d)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:17.528293 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f30cc6-c50c-4de5-89c8-a4cab34aef97 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:17.582544 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d9f30cc6-c50c-4de5-89c8-a4cab34aef97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35fa7187190b4f50823784bcd81e427d', 'request_id': 'req-d9f30cc6-c50c-4de5-89c8-a4cab34aef97'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:17.594085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d9f30cc6-c50c-4de5-89c8-a4cab34aef97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35fa7187190b4f50823784bcd81e427d', 'request_id': 'req-d9f30cc6-c50c-4de5-89c8-a4cab34aef97'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:17.608718 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d9f30cc6-c50c-4de5-89c8-a4cab34aef97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35fa7187190b4f50823784bcd81e427d', 'request_id': 'req-d9f30cc6-c50c-4de5-89c8-a4cab34aef97'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:17.624886 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d9f30cc6-c50c-4de5-89c8-a4cab34aef97 admin admin] The token cache is being invalidate because project 35fa7187190b4f50823784bcd81e427d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:05:17.625872 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d9f30cc6-c50c-4de5-89c8-a4cab34aef97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:17.626939 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d9f30cc6-c50c-4de5-89c8-a4cab34aef97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:17.631590 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1155/2293] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:05:17 2021] DELETE /identity/v3/projects/35fa7187190b4f50823784bcd81e427d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:17.638182 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4d723-437b-47e7-a34d-2eb1923c7b4d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:17.639070 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4d723-437b-47e7-a34d-2eb1923c7b4d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:17.639350 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4d723-437b-47e7-a34d-2eb1923c7b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:17.661630 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-79a4d723-437b-47e7-a34d-2eb1923c7b4d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:17.663406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-79a4d723-437b-47e7-a34d-2eb1923c7b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:17.756112 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1139/2294] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:17.765413 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472691f-adf9-4705-b28c-141b13d2ec3e None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:17.765802 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472691f-adf9-4705-b28c-141b13d2ec3e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:17.766177 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472691f-adf9-4705-b28c-141b13d2ec3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:17.785617 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a472691f-adf9-4705-b28c-141b13d2ec3e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:17.786875 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a472691f-adf9-4705-b28c-141b13d2ec3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:17.794728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1156/2295] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:17.800581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4d723-437b-47e7-a34d-2eb1923c7b4d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:17.810304 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4d723-437b-47e7-a34d-2eb1923c7b4d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:17.815001 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af84ed7-e88a-4503-bd49-8ad4208bff15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:17.815683 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af84ed7-e88a-4503-bd49-8ad4208bff15 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:17.815963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af84ed7-e88a-4503-bd49-8ad4208bff15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:17.816235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af84ed7-e88a-4503-bd49-8ad4208bff15 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:17.817123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af84ed7-e88a-4503-bd49-8ad4208bff15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:05:17.817335 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af84ed7-e88a-4503-bd49-8ad4208bff15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:17.819144 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af84ed7-e88a-4503-bd49-8ad4208bff15 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:17.838023 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1140/2296] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:05:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:05:17.839454 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472691f-adf9-4705-b28c-141b13d2ec3e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:17.850859 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472691f-adf9-4705-b28c-141b13d2ec3e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:17.859090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe0e90-d4c2-4697-a174-709527229624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:17.860341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe0e90-d4c2-4697-a174-709527229624 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:17.860623 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe0e90-d4c2-4697-a174-709527229624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:17.860903 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe0e90-d4c2-4697-a174-709527229624 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:17.861775 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe0e90-d4c2-4697-a174-709527229624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:17.864315 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe0e90-d4c2-4697-a174-709527229624 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:17.893896 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1157/2297] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:05:17 2021] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:05:17.897675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af84ed7-e88a-4503-bd49-8ad4208bff15 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:17.908751 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af84ed7-e88a-4503-bd49-8ad4208bff15 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:17.976804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ea58d-a1ad-4776-89c9-89e54c019e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:17.977544 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ea58d-a1ad-4776-89c9-89e54c019e2a admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:17.977882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ea58d-a1ad-4776-89c9-89e54c019e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:17.978190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ea58d-a1ad-4776-89c9-89e54c019e2a admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:17.978822 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ea58d-a1ad-4776-89c9-89e54c019e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:17.980796 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ea58d-a1ad-4776-89c9-89e54c019e2a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:18.002017 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1141/2298] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:05:17 2021] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:05:18.006379 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe0e90-d4c2-4697-a174-709527229624 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:18.016577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe0e90-d4c2-4697-a174-709527229624 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:18.021563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09531-4dbb-45dc-b529-2d54280df3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:18.022308 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09531-4dbb-45dc-b529-2d54280df3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:18.022902 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09531-4dbb-45dc-b529-2d54280df3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:18.022902 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09531-4dbb-45dc-b529-2d54280df3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:18.023718 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f09531-4dbb-45dc-b529-2d54280df3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:18.025518 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f09531-4dbb-45dc-b529-2d54280df3f8 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:18.045552 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1158/2299] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:05:18 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:05:18.054366 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ea58d-a1ad-4776-89c9-89e54c019e2a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:18.068390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ea58d-a1ad-4776-89c9-89e54c019e2a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:18.074355 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409026b9-fd77-4d05-b736-6ce1a4e32449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:18.075220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409026b9-fd77-4d05-b736-6ce1a4e32449 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:18.075503 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409026b9-fd77-4d05-b736-6ce1a4e32449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:18.075910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409026b9-fd77-4d05-b736-6ce1a4e32449 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:18.076653 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409026b9-fd77-4d05-b736-6ce1a4e32449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:18.078316 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409026b9-fd77-4d05-b736-6ce1a4e32449 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:18.090438 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1142/2300] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:05:18 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:05:18.092841 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09531-4dbb-45dc-b529-2d54280df3f8 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:18.102986 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09531-4dbb-45dc-b529-2d54280df3f8 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:18.107565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f00926-f90c-450d-965c-f95211a232c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:18.108428 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f00926-f90c-450d-965c-f95211a232c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:18.108708 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f00926-f90c-450d-965c-f95211a232c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:18.108981 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f00926-f90c-450d-965c-f95211a232c7 admin admin] PATH_INFO: `/v3/projects/f2f67b02beab475d8bdcc0adcf8a98ca/users/7b3dfed383024b5daaf3a356b47619f0/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:18.134586 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f00926-f90c-450d-965c-f95211a232c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f67b02beab475d8bdcc0adcf8a98ca, user_id=7b3dfed383024b5daaf3a356b47619f0, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:18.137352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f00926-f90c-450d-965c-f95211a232c7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:18.150938 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1159/2301] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:05:18 2021] PUT /identity/v3/projects/f2f67b02beab475d8bdcc0adcf8a98ca/users/7b3dfed383024b5daaf3a356b47619f0/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:05:18.162603 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253f1dd-d0fb-4e6d-b4d4-78efeba34c58 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:18.162889 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253f1dd-d0fb-4e6d-b4d4-78efeba34c58 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:18.163193 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253f1dd-d0fb-4e6d-b4d4-78efeba34c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:18.192792 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-9253f1dd-d0fb-4e6d-b4d4-78efeba34c58 None None] MFA Rules not processed for user `7b3dfed383024b5daaf3a356b47619f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:18.194006 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9253f1dd-d0fb-4e6d-b4d4-78efeba34c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:18.256670 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1143/2302] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:18 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:18.267484 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f00926-f90c-450d-965c-f95211a232c7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:18.269180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-56f00926-f90c-450d-965c-f95211a232c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:18.324800 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f00926-f90c-450d-965c-f95211a232c7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:18.328952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9132f-0584-46e9-b0a0-76e70eed9e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:18.329582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9132f-0584-46e9-b0a0-76e70eed9e7a service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:18.329860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9132f-0584-46e9-b0a0-76e70eed9e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:18.330166 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9132f-0584-46e9-b0a0-76e70eed9e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:18.338639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9132f-0584-46e9-b0a0-76e70eed9e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:18.340127 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9132f-0584-46e9-b0a0-76e70eed9e7a service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:18.349540 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1160/2303] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:05:18 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:05:29.986872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253f1dd-d0fb-4e6d-b4d4-78efeba34c58 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:30.048675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253f1dd-d0fb-4e6d-b4d4-78efeba34c58 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:30.053709 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561af4a-5529-4a1c-a589-77d5ae300703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:30.063155 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561af4a-5529-4a1c-a589-77d5ae300703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:30.063155 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561af4a-5529-4a1c-a589-77d5ae300703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:30.063155 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561af4a-5529-4a1c-a589-77d5ae300703 admin admin] PATH_INFO: `/v3/users/7b3dfed383024b5daaf3a356b47619f0` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:30.063155 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561af4a-5529-4a1c-a589-77d5ae300703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b3dfed383024b5daaf3a356b47619f0)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:30.063155 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561af4a-5529-4a1c-a589-77d5ae300703 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:30.108650 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-0561af4a-5529-4a1c-a589-77d5ae300703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b3dfed383024b5daaf3a356b47619f0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:30.114761 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-0561af4a-5529-4a1c-a589-77d5ae300703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b3dfed383024b5daaf3a356b47619f0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:30.122219 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-0561af4a-5529-4a1c-a589-77d5ae300703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b3dfed383024b5daaf3a356b47619f0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:30.129038 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-0561af4a-5529-4a1c-a589-77d5ae300703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b3dfed383024b5daaf3a356b47619f0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:30.129675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-0561af4a-5529-4a1c-a589-77d5ae300703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b3dfed383024b5daaf3a356b47619f0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:30.135715 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1144/2304] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:05:29 2021] DELETE /identity/v3/users/7b3dfed383024b5daaf3a356b47619f0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:30.141261 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af89b50-2b4a-4141-b9d5-e3ca7a080558 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:30.141727 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af89b50-2b4a-4141-b9d5-e3ca7a080558 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:30.142147 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af89b50-2b4a-4141-b9d5-e3ca7a080558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:30.160834 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-2af89b50-2b4a-4141-b9d5-e3ca7a080558 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:30.161967 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-2af89b50-2b4a-4141-b9d5-e3ca7a080558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:30.225009 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1161/2305] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:30.235614 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561af4a-5529-4a1c-a589-77d5ae300703 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:30.236994 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0561af4a-5529-4a1c-a589-77d5ae300703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:30.296746 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561af4a-5529-4a1c-a589-77d5ae300703 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:30.301445 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b3947-ca2d-4d74-800b-b628582fada8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:30.302439 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b3947-ca2d-4d74-800b-b628582fada8 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:30.303147 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b3947-ca2d-4d74-800b-b628582fada8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:30.303492 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b3947-ca2d-4d74-800b-b628582fada8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:30.315238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b3947-ca2d-4d74-800b-b628582fada8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:30.316708 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b3947-ca2d-4d74-800b-b628582fada8 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:30.335979 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1145/2306] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:05:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:05:30.621725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af89b50-2b4a-4141-b9d5-e3ca7a080558 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:30.623283 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-2af89b50-2b4a-4141-b9d5-e3ca7a080558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:30.639163 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af89b50-2b4a-4141-b9d5-e3ca7a080558 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:30.645158 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae68d2-dac6-4dec-9ed2-0e9482aa3b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:30.646055 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae68d2-dac6-4dec-9ed2-0e9482aa3b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:30.646339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae68d2-dac6-4dec-9ed2-0e9482aa3b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:30.646614 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae68d2-dac6-4dec-9ed2-0e9482aa3b5d admin admin] PATH_INFO: `/v3/projects/f2f67b02beab475d8bdcc0adcf8a98ca` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:30.647859 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae68d2-dac6-4dec-9ed2-0e9482aa3b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f67b02beab475d8bdcc0adcf8a98ca)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:30.649780 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae68d2-dac6-4dec-9ed2-0e9482aa3b5d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:30.701464 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2fae68d2-dac6-4dec-9ed2-0e9482aa3b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f67b02beab475d8bdcc0adcf8a98ca', 'request_id': 'req-2fae68d2-dac6-4dec-9ed2-0e9482aa3b5d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:30.710495 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2fae68d2-dac6-4dec-9ed2-0e9482aa3b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f67b02beab475d8bdcc0adcf8a98ca', 'request_id': 'req-2fae68d2-dac6-4dec-9ed2-0e9482aa3b5d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:30.720165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2fae68d2-dac6-4dec-9ed2-0e9482aa3b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f67b02beab475d8bdcc0adcf8a98ca', 'request_id': 'req-2fae68d2-dac6-4dec-9ed2-0e9482aa3b5d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:30.740682 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2fae68d2-dac6-4dec-9ed2-0e9482aa3b5d admin admin] The token cache is being invalidate because project f2f67b02beab475d8bdcc0adcf8a98ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:05:30.741180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2fae68d2-dac6-4dec-9ed2-0e9482aa3b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:30.741864 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-2fae68d2-dac6-4dec-9ed2-0e9482aa3b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:30.745081 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1162/2307] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:05:30 2021] DELETE /identity/v3/projects/f2f67b02beab475d8bdcc0adcf8a98ca => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:30.751609 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c71a09-737f-44be-9523-d59a0ede9772 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:30.751861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c71a09-737f-44be-9523-d59a0ede9772 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:30.752127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c71a09-737f-44be-9523-d59a0ede9772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:30.794920 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-00c71a09-737f-44be-9523-d59a0ede9772 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:30.799723 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-00c71a09-737f-44be-9523-d59a0ede9772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:30.931398 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1146/2308] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:30.942635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c2772-2e8e-46e6-b08b-3f75eb67c3fc None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:30.943575 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c2772-2e8e-46e6-b08b-3f75eb67c3fc None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:30.943970 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c2772-2e8e-46e6-b08b-3f75eb67c3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:30.989533 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-632c2772-2e8e-46e6-b08b-3f75eb67c3fc None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:30.991159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-632c2772-2e8e-46e6-b08b-3f75eb67c3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:31.001476 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1163/2309] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:31.006183 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c71a09-737f-44be-9523-d59a0ede9772 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:31.026141 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c71a09-737f-44be-9523-d59a0ede9772 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:31.033008 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cfc14-cf6b-4ef7-93b2-ea6de9609783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:31.033672 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cfc14-cf6b-4ef7-93b2-ea6de9609783 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:31.034008 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cfc14-cf6b-4ef7-93b2-ea6de9609783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:31.034252 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cfc14-cf6b-4ef7-93b2-ea6de9609783 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:31.034991 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cfc14-cf6b-4ef7-93b2-ea6de9609783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:05:31.035349 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cfc14-cf6b-4ef7-93b2-ea6de9609783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:31.037000 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cfc14-cf6b-4ef7-93b2-ea6de9609783 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:31.052253 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1147/2310] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:05:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:05:31.057076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c2772-2e8e-46e6-b08b-3f75eb67c3fc None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:31.086261 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c2772-2e8e-46e6-b08b-3f75eb67c3fc None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:31.095805 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c867119-d2d1-4268-8cfa-d6e649d31f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:31.096606 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c867119-d2d1-4268-8cfa-d6e649d31f80 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:31.096959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c867119-d2d1-4268-8cfa-d6e649d31f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:31.097719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c867119-d2d1-4268-8cfa-d6e649d31f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:31.098661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c867119-d2d1-4268-8cfa-d6e649d31f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:31.102194 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c867119-d2d1-4268-8cfa-d6e649d31f80 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:31.149049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1164/2311] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:05:31 2021] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:05:31.150336 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cfc14-cf6b-4ef7-93b2-ea6de9609783 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:31.164224 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cfc14-cf6b-4ef7-93b2-ea6de9609783 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:31.230669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a3aec-5cda-4026-9b93-6045bcc14df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:31.231553 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a3aec-5cda-4026-9b93-6045bcc14df2 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:31.231859 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a3aec-5cda-4026-9b93-6045bcc14df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:31.232193 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a3aec-5cda-4026-9b93-6045bcc14df2 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:31.232891 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a3aec-5cda-4026-9b93-6045bcc14df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:31.234853 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a3aec-5cda-4026-9b93-6045bcc14df2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:31.258998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1148/2312] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:05:31 2021] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:05:31.260220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c867119-d2d1-4268-8cfa-d6e649d31f80 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:31.270874 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c867119-d2d1-4268-8cfa-d6e649d31f80 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:31.275707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b0aa6-01a1-4927-8524-b17fe2668733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:31.276628 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b0aa6-01a1-4927-8524-b17fe2668733 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:31.276915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b0aa6-01a1-4927-8524-b17fe2668733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:31.277205 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b0aa6-01a1-4927-8524-b17fe2668733 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:31.277950 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b0aa6-01a1-4927-8524-b17fe2668733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:31.279765 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b0aa6-01a1-4927-8524-b17fe2668733 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:31.290966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1165/2313] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:05:31 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:05:31.294890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a3aec-5cda-4026-9b93-6045bcc14df2 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:31.305516 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a3aec-5cda-4026-9b93-6045bcc14df2 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:31.310042 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad9ae3-3a32-4d8f-b733-0b0a22e58805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:31.310676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad9ae3-3a32-4d8f-b733-0b0a22e58805 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:31.310953 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad9ae3-3a32-4d8f-b733-0b0a22e58805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:31.311223 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad9ae3-3a32-4d8f-b733-0b0a22e58805 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:31.311977 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad9ae3-3a32-4d8f-b733-0b0a22e58805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:31.313549 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad9ae3-3a32-4d8f-b733-0b0a22e58805 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:31.322968 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1149/2314] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:05:31 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:05:31.326693 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b0aa6-01a1-4927-8524-b17fe2668733 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:31.336222 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b0aa6-01a1-4927-8524-b17fe2668733 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:31.340829 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19da84-f791-41ce-966c-4bb2b4b36b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:31.341808 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19da84-f791-41ce-966c-4bb2b4b36b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:31.342123 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19da84-f791-41ce-966c-4bb2b4b36b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:31.342414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19da84-f791-41ce-966c-4bb2b4b36b10 admin admin] PATH_INFO: `/v3/projects/b28917c863104bbe9abc5f7e87803f9e/users/2249449813ef41928c52b2d66314b89d/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:31.356488 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19da84-f791-41ce-966c-4bb2b4b36b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28917c863104bbe9abc5f7e87803f9e, user_id=2249449813ef41928c52b2d66314b89d, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:31.359787 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19da84-f791-41ce-966c-4bb2b4b36b10 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:31.372156 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1166/2315] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:05:31 2021] PUT /identity/v3/projects/b28917c863104bbe9abc5f7e87803f9e/users/2249449813ef41928c52b2d66314b89d/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:31.382284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ca1dc-e150-413f-94d1-06f19309f022 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:31.382650 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ca1dc-e150-413f-94d1-06f19309f022 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:31.383003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ca1dc-e150-413f-94d1-06f19309f022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:31.414448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-319ca1dc-e150-413f-94d1-06f19309f022 None None] MFA Rules not processed for user `2249449813ef41928c52b2d66314b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:31.414448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-319ca1dc-e150-413f-94d1-06f19309f022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:31.477301 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1150/2316] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:31 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:05:31.487763 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19da84-f791-41ce-966c-4bb2b4b36b10 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:31.489487 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-8e19da84-f791-41ce-966c-4bb2b4b36b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:31.546144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19da84-f791-41ce-966c-4bb2b4b36b10 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:31.550359 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21231e-b16c-4a46-b566-79942a312c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:31.551003 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21231e-b16c-4a46-b566-79942a312c73 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:31.551283 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21231e-b16c-4a46-b566-79942a312c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:31.551560 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21231e-b16c-4a46-b566-79942a312c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:31.559797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21231e-b16c-4a46-b566-79942a312c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:31.561215 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21231e-b16c-4a46-b566-79942a312c73 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:31.569932 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1167/2317] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:05:31 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:05:34.984259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d95b88-f495-4aaf-b85a-1cb171fdd59f None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:34.984788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d95b88-f495-4aaf-b85a-1cb171fdd59f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:34.984788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d95b88-f495-4aaf-b85a-1cb171fdd59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:35.002344 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-60d95b88-f495-4aaf-b85a-1cb171fdd59f None None] MFA Rules not processed for user `2249449813ef41928c52b2d66314b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:35.003509 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-60d95b88-f495-4aaf-b85a-1cb171fdd59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:35.010836 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1151/2318] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:34 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:40.112024 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21231e-b16c-4a46-b566-79942a312c73 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:40.113592 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6a21231e-b16c-4a46-b566-79942a312c73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:40.193822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21231e-b16c-4a46-b566-79942a312c73 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:40.203411 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3341673-8121-42ce-ad55-93e709683e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:40.203411 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3341673-8121-42ce-ad55-93e709683e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:40.203411 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3341673-8121-42ce-ad55-93e709683e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:40.203411 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3341673-8121-42ce-ad55-93e709683e32 admin admin] PATH_INFO: `/v3/users/80a001f228c34890aa035be19168be8d` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:40.205257 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3341673-8121-42ce-ad55-93e709683e32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a001f228c34890aa035be19168be8d)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:40.207260 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3341673-8121-42ce-ad55-93e709683e32 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:40.269097 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e3341673-8121-42ce-ad55-93e709683e32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a001f228c34890aa035be19168be8d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:40.285437 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e3341673-8121-42ce-ad55-93e709683e32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a001f228c34890aa035be19168be8d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:40.298353 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e3341673-8121-42ce-ad55-93e709683e32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a001f228c34890aa035be19168be8d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:40.299250 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e3341673-8121-42ce-ad55-93e709683e32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a001f228c34890aa035be19168be8d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:40.299955 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e3341673-8121-42ce-ad55-93e709683e32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a001f228c34890aa035be19168be8d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:40.316809 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1168/2319] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:05:40 2021] DELETE /identity/v3/users/80a001f228c34890aa035be19168be8d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:40.321530 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47b9f9-05d9-4f9c-aa99-151a46246ec5 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:40.322078 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47b9f9-05d9-4f9c-aa99-151a46246ec5 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:40.322179 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47b9f9-05d9-4f9c-aa99-151a46246ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:40.342724 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-8a47b9f9-05d9-4f9c-aa99-151a46246ec5 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:40.343926 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8a47b9f9-05d9-4f9c-aa99-151a46246ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:40.407141 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1152/2320] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:05:40.420997 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3341673-8121-42ce-ad55-93e709683e32 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:40.422695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e3341673-8121-42ce-ad55-93e709683e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:40.484934 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3341673-8121-42ce-ad55-93e709683e32 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:40.489242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef13cb-3953-42d9-906a-e0a0d7e8b9eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:40.489885 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef13cb-3953-42d9-906a-e0a0d7e8b9eb service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:40.490196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef13cb-3953-42d9-906a-e0a0d7e8b9eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:40.490474 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef13cb-3953-42d9-906a-e0a0d7e8b9eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:40.502250 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef13cb-3953-42d9-906a-e0a0d7e8b9eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:40.503883 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef13cb-3953-42d9-906a-e0a0d7e8b9eb service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:40.514854 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1169/2321] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:05:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:05:40.862728 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47b9f9-05d9-4f9c-aa99-151a46246ec5 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:40.864216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8a47b9f9-05d9-4f9c-aa99-151a46246ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:40.876726 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47b9f9-05d9-4f9c-aa99-151a46246ec5 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:40.881238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b412538-a18e-4e56-a8f7-a77c8c6b4076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:40.882114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b412538-a18e-4e56-a8f7-a77c8c6b4076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:40.882393 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b412538-a18e-4e56-a8f7-a77c8c6b4076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:40.882666 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b412538-a18e-4e56-a8f7-a77c8c6b4076 admin admin] PATH_INFO: `/v3/projects/25f71da95f0b450b8b2b067de5568b9a` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:40.883848 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b412538-a18e-4e56-a8f7-a77c8c6b4076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f71da95f0b450b8b2b067de5568b9a)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:40.885740 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b412538-a18e-4e56-a8f7-a77c8c6b4076 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:40.935927 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2b412538-a18e-4e56-a8f7-a77c8c6b4076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f71da95f0b450b8b2b067de5568b9a', 'request_id': 'req-2b412538-a18e-4e56-a8f7-a77c8c6b4076'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:40.943077 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2b412538-a18e-4e56-a8f7-a77c8c6b4076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f71da95f0b450b8b2b067de5568b9a', 'request_id': 'req-2b412538-a18e-4e56-a8f7-a77c8c6b4076'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:40.949232 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2b412538-a18e-4e56-a8f7-a77c8c6b4076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f71da95f0b450b8b2b067de5568b9a', 'request_id': 'req-2b412538-a18e-4e56-a8f7-a77c8c6b4076'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:40.961409 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2b412538-a18e-4e56-a8f7-a77c8c6b4076 admin admin] The token cache is being invalidate because project 25f71da95f0b450b8b2b067de5568b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:05:40.961825 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2b412538-a18e-4e56-a8f7-a77c8c6b4076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:40.962518 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2b412538-a18e-4e56-a8f7-a77c8c6b4076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:05:40.968983 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1153/2322] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:05:40 2021] DELETE /identity/v3/projects/25f71da95f0b450b8b2b067de5568b9a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:40.971133 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc071f04-4143-461a-91d5-6df7a88facac None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:40.971424 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc071f04-4143-461a-91d5-6df7a88facac None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:40.971704 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc071f04-4143-461a-91d5-6df7a88facac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:40.990059 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-dc071f04-4143-461a-91d5-6df7a88facac None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:40.991253 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-dc071f04-4143-461a-91d5-6df7a88facac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:41.052601 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1170/2323] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:41.060667 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1196ad-0516-413f-ada2-ae7195191014 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:41.060957 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1196ad-0516-413f-ada2-ae7195191014 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:41.061238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1196ad-0516-413f-ada2-ae7195191014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:41.079340 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-ce1196ad-0516-413f-ada2-ae7195191014 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:41.080520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-ce1196ad-0516-413f-ada2-ae7195191014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:41.088498 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1154/2324] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:41.093501 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc071f04-4143-461a-91d5-6df7a88facac None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:41.103905 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc071f04-4143-461a-91d5-6df7a88facac None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:41.117340 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c651a-815a-453a-89fe-abd8ad0f94f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:41.118103 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c651a-815a-453a-89fe-abd8ad0f94f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:41.118304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c651a-815a-453a-89fe-abd8ad0f94f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:41.118580 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c651a-815a-453a-89fe-abd8ad0f94f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:41.119316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c651a-815a-453a-89fe-abd8ad0f94f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:05:41.119788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c651a-815a-453a-89fe-abd8ad0f94f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:41.121691 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c651a-815a-453a-89fe-abd8ad0f94f3 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:41.137478 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1171/2325] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:05:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:05:41.138384 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1196ad-0516-413f-ada2-ae7195191014 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:41.149432 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1196ad-0516-413f-ada2-ae7195191014 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:41.158686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1f8a4-57bb-49dc-8dab-7b5e5c8e4550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:41.159448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1f8a4-57bb-49dc-8dab-7b5e5c8e4550 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:41.159832 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1f8a4-57bb-49dc-8dab-7b5e5c8e4550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:41.160776 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1f8a4-57bb-49dc-8dab-7b5e5c8e4550 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:41.161777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1f8a4-57bb-49dc-8dab-7b5e5c8e4550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:41.163963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1f8a4-57bb-49dc-8dab-7b5e5c8e4550 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:41.193493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1155/2326] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:05:41 2021] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:05:41.197737 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c651a-815a-453a-89fe-abd8ad0f94f3 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:41.210874 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c651a-815a-453a-89fe-abd8ad0f94f3 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:41.276381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f24d8-178c-47f3-b04e-4d68c5dc868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:41.277051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f24d8-178c-47f3-b04e-4d68c5dc868f admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:41.277329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f24d8-178c-47f3-b04e-4d68c5dc868f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:41.277602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f24d8-178c-47f3-b04e-4d68c5dc868f admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:41.279205 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f24d8-178c-47f3-b04e-4d68c5dc868f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:41.280339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f24d8-178c-47f3-b04e-4d68c5dc868f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:41.305156 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1172/2327] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:05:41 2021] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:05:41.306332 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1f8a4-57bb-49dc-8dab-7b5e5c8e4550 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:41.317549 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1f8a4-57bb-49dc-8dab-7b5e5c8e4550 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:41.322274 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc714a-dacd-4966-a660-ed0c97c8f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:41.322923 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc714a-dacd-4966-a660-ed0c97c8f0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:41.323199 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc714a-dacd-4966-a660-ed0c97c8f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:41.323728 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc714a-dacd-4966-a660-ed0c97c8f0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:41.325308 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc714a-dacd-4966-a660-ed0c97c8f0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:41.326230 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc714a-dacd-4966-a660-ed0c97c8f0b9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:41.337369 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1156/2328] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:05:41 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:05:41.341430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f24d8-178c-47f3-b04e-4d68c5dc868f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:41.356510 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f24d8-178c-47f3-b04e-4d68c5dc868f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:41.367241 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e414bee-9aaa-43ae-9b73-20767db5f4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:41.367913 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e414bee-9aaa-43ae-9b73-20767db5f4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:41.368237 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e414bee-9aaa-43ae-9b73-20767db5f4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:41.368678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e414bee-9aaa-43ae-9b73-20767db5f4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:41.369409 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e414bee-9aaa-43ae-9b73-20767db5f4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:41.371295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e414bee-9aaa-43ae-9b73-20767db5f4b6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:41.383008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1173/2329] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:05:41 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:05:41.387060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc714a-dacd-4966-a660-ed0c97c8f0b9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:41.397465 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc714a-dacd-4966-a660-ed0c97c8f0b9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:41.402335 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d20342-38d1-4c91-841d-ff4548f4cac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:41.403322 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d20342-38d1-4c91-841d-ff4548f4cac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:41.403677 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d20342-38d1-4c91-841d-ff4548f4cac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:41.404584 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d20342-38d1-4c91-841d-ff4548f4cac0 admin admin] PATH_INFO: `/v3/projects/5a093d0bf43046aaa845f3cc115f3f5f/users/6c4c0c82448e40ba801c0b52ec44e74a/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:41.423582 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d20342-38d1-4c91-841d-ff4548f4cac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a093d0bf43046aaa845f3cc115f3f5f, user_id=6c4c0c82448e40ba801c0b52ec44e74a, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:41.426981 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d20342-38d1-4c91-841d-ff4548f4cac0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:41.455973 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1157/2330] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:05:41 2021] PUT /identity/v3/projects/5a093d0bf43046aaa845f3cc115f3f5f/users/6c4c0c82448e40ba801c0b52ec44e74a/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:41.460927 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960242bb-0cb5-4831-8c40-5ce21e80afcf None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:41.461211 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960242bb-0cb5-4831-8c40-5ce21e80afcf None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:41.461495 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960242bb-0cb5-4831-8c40-5ce21e80afcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:41.491686 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-960242bb-0cb5-4831-8c40-5ce21e80afcf None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:41.493095 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-960242bb-0cb5-4831-8c40-5ce21e80afcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:41.557596 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1174/2331] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:41.568148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d20342-38d1-4c91-841d-ff4548f4cac0 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:41.570294 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-25d20342-38d1-4c91-841d-ff4548f4cac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:41.651353 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d20342-38d1-4c91-841d-ff4548f4cac0 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:41.656455 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b992c95-45fd-42b8-9c59-dae593dbadea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:41.657897 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b992c95-45fd-42b8-9c59-dae593dbadea service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:41.658296 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b992c95-45fd-42b8-9c59-dae593dbadea service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:41.658661 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b992c95-45fd-42b8-9c59-dae593dbadea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:41.669495 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b992c95-45fd-42b8-9c59-dae593dbadea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:41.671171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b992c95-45fd-42b8-9c59-dae593dbadea service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:41.683833 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1158/2332] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:05:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:05:46.079291 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5f182-65ec-4896-b035-e962e311fd5f None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:46.079759 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5f182-65ec-4896-b035-e962e311fd5f None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:46.079837 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5f182-65ec-4896-b035-e962e311fd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:46.120086 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-c5b5f182-65ec-4896-b035-e962e311fd5f None None] MFA Rules not processed for user `6c4c0c82448e40ba801c0b52ec44e74a`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:46.121616 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c5b5f182-65ec-4896-b035-e962e311fd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:46.203990 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1175/2333] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:46 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:46.211972 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b992c95-45fd-42b8-9c59-dae593dbadea service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:46.223806 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b992c95-45fd-42b8-9c59-dae593dbadea service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:46.229903 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719507de-f4d6-4275-8c2c-aca125bcb4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:46.230701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719507de-f4d6-4275-8c2c-aca125bcb4fe admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:46.231042 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719507de-f4d6-4275-8c2c-aca125bcb4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:46.231385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719507de-f4d6-4275-8c2c-aca125bcb4fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:46.232845 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719507de-f4d6-4275-8c2c-aca125bcb4fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:46.235517 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719507de-f4d6-4275-8c2c-aca125bcb4fe admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:46.267022 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1159/2334] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:05:46 2021] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:05:46.271657 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5f182-65ec-4896-b035-e962e311fd5f None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:46.282961 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5f182-65ec-4896-b035-e962e311fd5f None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:46.339948 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769c7b4-03fa-4455-91e1-72fc9e97908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:46.340648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769c7b4-03fa-4455-91e1-72fc9e97908c admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:46.340932 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769c7b4-03fa-4455-91e1-72fc9e97908c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:46.341211 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769c7b4-03fa-4455-91e1-72fc9e97908c admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:46.341923 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769c7b4-03fa-4455-91e1-72fc9e97908c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:46.343872 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769c7b4-03fa-4455-91e1-72fc9e97908c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:46.371248 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1176/2335] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:05:46 2021] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:05:46.377065 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719507de-f4d6-4275-8c2c-aca125bcb4fe admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:46.393600 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719507de-f4d6-4275-8c2c-aca125bcb4fe admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:46.399205 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc359a-26d2-4d47-b027-3555d6acfcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:46.400093 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc359a-26d2-4d47-b027-3555d6acfcda admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:46.400372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc359a-26d2-4d47-b027-3555d6acfcda admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:46.400701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc359a-26d2-4d47-b027-3555d6acfcda admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:46.401372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc359a-26d2-4d47-b027-3555d6acfcda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:46.403017 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc359a-26d2-4d47-b027-3555d6acfcda admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:46.416214 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1160/2336] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:05:46 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:05:46.420591 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769c7b4-03fa-4455-91e1-72fc9e97908c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:46.430483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37022ab0-16e5-48e5-a6e5-a9bbb3ba276d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:46.430995 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37022ab0-16e5-48e5-a6e5-a9bbb3ba276d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:46.431272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37022ab0-16e5-48e5-a6e5-a9bbb3ba276d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:46.432041 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769c7b4-03fa-4455-91e1-72fc9e97908c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:46.437571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3508f-f26e-4dc7-b0a9-d609a704beb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:46.439494 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3508f-f26e-4dc7-b0a9-d609a704beb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:46.439854 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3508f-f26e-4dc7-b0a9-d609a704beb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:46.440216 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3508f-f26e-4dc7-b0a9-d609a704beb9 admin admin] PATH_INFO: `/v3/projects/4b6b61eaf5634e0c85cb4c3a5bf524e4/users/353d8feb930d4eb8a9fd8efe3d5b2e21/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:46.456886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-37022ab0-16e5-48e5-a6e5-a9bbb3ba276d None None] MFA Rules not processed for user `39cddc4e2ea943cd882b6a1addd98e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:46.462444 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-37022ab0-16e5-48e5-a6e5-a9bbb3ba276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:46.463588 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3508f-f26e-4dc7-b0a9-d609a704beb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6b61eaf5634e0c85cb4c3a5bf524e4, user_id=353d8feb930d4eb8a9fd8efe3d5b2e21, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:46.466254 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3508f-f26e-4dc7-b0a9-d609a704beb9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:46.486013 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1177/2337] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:05:46 2021] PUT /identity/v3/projects/4b6b61eaf5634e0c85cb4c3a5bf524e4/users/353d8feb930d4eb8a9fd8efe3d5b2e21/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:46.490366 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3508f-f26e-4dc7-b0a9-d609a704beb9 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:46.535254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1161/2338] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Dec 15 03:05:46 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:46.574749 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3508f-f26e-4dc7-b0a9-d609a704beb9 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:46.585125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37022ab0-16e5-48e5-a6e5-a9bbb3ba276d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:46.586582 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-37022ab0-16e5-48e5-a6e5-a9bbb3ba276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:46.586703 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392e514-d670-4e3f-9d22-7c19f7c2defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:46.587485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392e514-d670-4e3f-9d22-7c19f7c2defc admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:46.587862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392e514-d670-4e3f-9d22-7c19f7c2defc admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:46.588342 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392e514-d670-4e3f-9d22-7c19f7c2defc admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:46.589194 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392e514-d670-4e3f-9d22-7c19f7c2defc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:46.591001 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392e514-d670-4e3f-9d22-7c19f7c2defc admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:46.604980 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1178/2339] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:05:46 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:05:46.606192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392e514-d670-4e3f-9d22-7c19f7c2defc admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:46.617748 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392e514-d670-4e3f-9d22-7c19f7c2defc admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:46.623611 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f5084-4851-44f3-853f-1e16a3574093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:46.625209 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f5084-4851-44f3-853f-1e16a3574093 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:46.630478 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f5084-4851-44f3-853f-1e16a3574093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:46.630694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f5084-4851-44f3-853f-1e16a3574093 admin admin] PATH_INFO: `/v3/projects/4b6b61eaf5634e0c85cb4c3a5bf524e4/users/353d8feb930d4eb8a9fd8efe3d5b2e21/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:46.635677 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f5084-4851-44f3-853f-1e16a3574093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6b61eaf5634e0c85cb4c3a5bf524e4, user_id=353d8feb930d4eb8a9fd8efe3d5b2e21, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:46.638368 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f5084-4851-44f3-853f-1e16a3574093 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:46.651688 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1179/2340] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:05:46 2021] PUT /identity/v3/projects/4b6b61eaf5634e0c85cb4c3a5bf524e4/users/353d8feb930d4eb8a9fd8efe3d5b2e21/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:05:46.669855 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37022ab0-16e5-48e5-a6e5-a9bbb3ba276d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:46.750202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b58ad8-a8af-4b61-a812-2c14c8fab892 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb0af7ac70d48989852c022c9f83848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:46.753778 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b58ad8-a8af-4b61-a812-2c14c8fab892 service swift] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:46.754111 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b58ad8-a8af-4b61-a812-2c14c8fab892 service swift] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:46.754401 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b58ad8-a8af-4b61-a812-2c14c8fab892 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:46.876628 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b58ad8-a8af-4b61-a812-2c14c8fab892 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:46.878284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b58ad8-a8af-4b61-a812-2c14c8fab892 service swift] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:46.886865 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1162/2341] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Dec 15 03:05:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 03:05:49.542777 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235084-cb84-42bf-bbaf-c22d436ca610 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:49.544134 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235084-cb84-42bf-bbaf-c22d436ca610 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:49.544703 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235084-cb84-42bf-bbaf-c22d436ca610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:49.590843 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-fe235084-cb84-42bf-bbaf-c22d436ca610 None None] MFA Rules not processed for user `35d37a3d8e504b8186182468b77dd114`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:49.592561 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-fe235084-cb84-42bf-bbaf-c22d436ca610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:49.669326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1180/2342] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:49 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:55.315830 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46dd97-b139-4359-870d-d35891865087 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:55.316351 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46dd97-b139-4359-870d-d35891865087 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:55.316351 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46dd97-b139-4359-870d-d35891865087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:55.392867 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-cc46dd97-b139-4359-870d-d35891865087 None None] MFA Rules not processed for user `353d8feb930d4eb8a9fd8efe3d5b2e21`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:55.394115 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-cc46dd97-b139-4359-870d-d35891865087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:55.547954 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1163/2343] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:55 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:55.560752 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe235084-cb84-42bf-bbaf-c22d436ca610 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:55.563380 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-fe235084-cb84-42bf-bbaf-c22d436ca610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:55.675017 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe235084-cb84-42bf-bbaf-c22d436ca610 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:55.684442 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482da69-a9f9-4296-a2ea-490a04c118b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:55.685181 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482da69-a9f9-4296-a2ea-490a04c118b9 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:55.685597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482da69-a9f9-4296-a2ea-490a04c118b9 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:55.685885 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482da69-a9f9-4296-a2ea-490a04c118b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:55.849242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482da69-a9f9-4296-a2ea-490a04c118b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:55.854905 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482da69-a9f9-4296-a2ea-490a04c118b9 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:55.878873 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1181/2344] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:05:55 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:05:57.602260 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f6572-b94f-47d0-803a-8676713a0383 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:57.602805 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f6572-b94f-47d0-803a-8676713a0383 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:57.602805 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f6572-b94f-47d0-803a-8676713a0383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:57.639545 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-7b4f6572-b94f-47d0-803a-8676713a0383 None None] MFA Rules not processed for user `39cddc4e2ea943cd882b6a1addd98e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:57.643164 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-7b4f6572-b94f-47d0-803a-8676713a0383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:57.673149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1164/2345] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Dec 15 03:05:57 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:05:57.701872 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482da69-a9f9-4296-a2ea-490a04c118b9 service nova] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:57.726902 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482da69-a9f9-4296-a2ea-490a04c118b9 service nova] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:57.755620 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daa851-05de-4a5d-82bf-03fc812cb2f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb0af7ac70d48989852c022c9f83848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:57.757994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daa851-05de-4a5d-82bf-03fc812cb2f5 service swift] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:57.759803 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daa851-05de-4a5d-82bf-03fc812cb2f5 service swift] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:57.763041 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daa851-05de-4a5d-82bf-03fc812cb2f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:57.801594 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4daa851-05de-4a5d-82bf-03fc812cb2f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:57.809211 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4daa851-05de-4a5d-82bf-03fc812cb2f5 service swift] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:57.824750 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1182/2346] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Dec 15 03:05:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 03:05:58.877335 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c5d93-b461-4c0e-a8af-5f5e33ee4195 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:58.877803 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c5d93-b461-4c0e-a8af-5f5e33ee4195 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:58.877896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c5d93-b461-4c0e-a8af-5f5e33ee4195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:58.912280 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-0b5c5d93-b461-4c0e-a8af-5f5e33ee4195 None None] MFA Rules not processed for user `6c4c0c82448e40ba801c0b52ec44e74a`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:58.913520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0b5c5d93-b461-4c0e-a8af-5f5e33ee4195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:58.929041 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1165/2347] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:05:58 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:59.556835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf4f9f-92be-4d60-a63e-adc8893a4262 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:59.557380 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf4f9f-92be-4d60-a63e-adc8893a4262 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:59.557380 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf4f9f-92be-4d60-a63e-adc8893a4262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:59.591272 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-abcf4f9f-92be-4d60-a63e-adc8893a4262 None None] MFA Rules not processed for user `39cddc4e2ea943cd882b6a1addd98e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:05:59.592512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-abcf4f9f-92be-4d60-a63e-adc8893a4262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:05:59.648183 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1183/2348] 10.222.0.18 () {58 vars in 967 bytes} [Wed Dec 15 03:05:59 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:05:59.726442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c5d93-b461-4c0e-a8af-5f5e33ee4195 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:05:59.745684 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c5d93-b461-4c0e-a8af-5f5e33ee4195 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:05:59.756481 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d971c6-403e-4012-b6bb-060ea107f437 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb0af7ac70d48989852c022c9f83848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:05:59.757431 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d971c6-403e-4012-b6bb-060ea107f437 service swift] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:05:59.757871 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d971c6-403e-4012-b6bb-060ea107f437 service swift] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:05:59.758462 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d971c6-403e-4012-b6bb-060ea107f437 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:05:59.780085 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d971c6-403e-4012-b6bb-060ea107f437 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:05:59.785363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d971c6-403e-4012-b6bb-060ea107f437 service swift] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:05:59.802876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1166/2349] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Dec 15 03:05:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 03:06:00.250505 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30578350-5aed-4b09-ad4e-a8eff59be7fc None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:00.250851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30578350-5aed-4b09-ad4e-a8eff59be7fc None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:00.251136 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30578350-5aed-4b09-ad4e-a8eff59be7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:00.293837 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-30578350-5aed-4b09-ad4e-a8eff59be7fc None None] MFA Rules not processed for user `39cddc4e2ea943cd882b6a1addd98e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:00.300783 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-30578350-5aed-4b09-ad4e-a8eff59be7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:00.323862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1184/2350] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Dec 15 03:06:00 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:00.342401 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d971c6-403e-4012-b6bb-060ea107f437 service swift] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:00.369734 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d971c6-403e-4012-b6bb-060ea107f437 service swift] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:00.379774 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e093abd-f842-4278-8995-74c9341afcc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb0af7ac70d48989852c022c9f83848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:00.383068 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e093abd-f842-4278-8995-74c9341afcc5 service swift] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:00.383752 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e093abd-f842-4278-8995-74c9341afcc5 service swift] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:00.384793 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e093abd-f842-4278-8995-74c9341afcc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:00.453132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e093abd-f842-4278-8995-74c9341afcc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:00.455602 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e093abd-f842-4278-8995-74c9341afcc5 service swift] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:00.498275 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1167/2351] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Dec 15 03:06:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 03:06:01.264773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67bbb8-faca-49d8-bd3f-c8470001c2d9 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:01.265325 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67bbb8-faca-49d8-bd3f-c8470001c2d9 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:01.266588 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67bbb8-faca-49d8-bd3f-c8470001c2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:01.317800 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-df67bbb8-faca-49d8-bd3f-c8470001c2d9 None None] MFA Rules not processed for user `39cddc4e2ea943cd882b6a1addd98e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:01.319236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-df67bbb8-faca-49d8-bd3f-c8470001c2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:01.384149 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1185/2352] 10.222.0.18 () {58 vars in 967 bytes} [Wed Dec 15 03:06:01 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:01.394665 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e093abd-f842-4278-8995-74c9341afcc5 service swift] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:01.472947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e093abd-f842-4278-8995-74c9341afcc5 service swift] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:01.491871 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3054bc-7975-477a-9598-82fbbde54635 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb0af7ac70d48989852c022c9f83848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:01.492699 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3054bc-7975-477a-9598-82fbbde54635 service swift] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:01.493191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3054bc-7975-477a-9598-82fbbde54635 service swift] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:01.493689 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3054bc-7975-477a-9598-82fbbde54635 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:01.505145 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3054bc-7975-477a-9598-82fbbde54635 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:01.508292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3054bc-7975-477a-9598-82fbbde54635 service swift] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:01.520437 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1168/2353] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Dec 15 03:06:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 03:06:03.976814 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67bbb8-faca-49d8-bd3f-c8470001c2d9 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:03.979304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-df67bbb8-faca-49d8-bd3f-c8470001c2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:04.082111 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67bbb8-faca-49d8-bd3f-c8470001c2d9 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:04.087449 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c6d6d-1cd0-41e1-aba8-f16527aa079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:04.088321 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c6d6d-1cd0-41e1-aba8-f16527aa079a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:04.088610 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c6d6d-1cd0-41e1-aba8-f16527aa079a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:04.088886 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c6d6d-1cd0-41e1-aba8-f16527aa079a admin admin] PATH_INFO: `/v3/users/2249449813ef41928c52b2d66314b89d` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:04.090156 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c6d6d-1cd0-41e1-aba8-f16527aa079a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2249449813ef41928c52b2d66314b89d)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:04.092082 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c6d6d-1cd0-41e1-aba8-f16527aa079a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:04.149070 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-167c6d6d-1cd0-41e1-aba8-f16527aa079a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2249449813ef41928c52b2d66314b89d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:04.163172 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-167c6d6d-1cd0-41e1-aba8-f16527aa079a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2249449813ef41928c52b2d66314b89d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:04.173069 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-167c6d6d-1cd0-41e1-aba8-f16527aa079a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2249449813ef41928c52b2d66314b89d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:04.173863 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-167c6d6d-1cd0-41e1-aba8-f16527aa079a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2249449813ef41928c52b2d66314b89d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:04.178460 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-167c6d6d-1cd0-41e1-aba8-f16527aa079a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2249449813ef41928c52b2d66314b89d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:04.193413 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1186/2354] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:06:03 2021] DELETE /identity/v3/users/2249449813ef41928c52b2d66314b89d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:04.197871 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac23b45-1feb-4713-b0fa-8f745b91bae0 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:04.198394 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac23b45-1feb-4713-b0fa-8f745b91bae0 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:04.198487 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac23b45-1feb-4713-b0fa-8f745b91bae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:04.228886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-6ac23b45-1feb-4713-b0fa-8f745b91bae0 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:04.230008 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6ac23b45-1feb-4713-b0fa-8f745b91bae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:04.297480 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1169/2355] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:04.307534 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c6d6d-1cd0-41e1-aba8-f16527aa079a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:04.309062 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-167c6d6d-1cd0-41e1-aba8-f16527aa079a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:04.391269 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c6d6d-1cd0-41e1-aba8-f16527aa079a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:04.395019 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b2b5f-cb5b-49b5-a1b3-6a2e7292a1bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:04.395686 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b2b5f-cb5b-49b5-a1b3-6a2e7292a1bf service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:04.395966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b2b5f-cb5b-49b5-a1b3-6a2e7292a1bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:04.396241 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b2b5f-cb5b-49b5-a1b3-6a2e7292a1bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:04.405287 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b2b5f-cb5b-49b5-a1b3-6a2e7292a1bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:04.407326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b2b5f-cb5b-49b5-a1b3-6a2e7292a1bf service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:04.425132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1187/2356] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:06:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:06:04.735603 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac23b45-1feb-4713-b0fa-8f745b91bae0 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:04.737213 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6ac23b45-1feb-4713-b0fa-8f745b91bae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:04.753694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac23b45-1feb-4713-b0fa-8f745b91bae0 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:04.771320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25052ba-44ea-4463-b515-052c86f76462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:04.774855 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25052ba-44ea-4463-b515-052c86f76462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:04.777388 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25052ba-44ea-4463-b515-052c86f76462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:04.778510 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25052ba-44ea-4463-b515-052c86f76462 admin admin] PATH_INFO: `/v3/projects/b28917c863104bbe9abc5f7e87803f9e` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:04.784195 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25052ba-44ea-4463-b515-052c86f76462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28917c863104bbe9abc5f7e87803f9e)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:04.787693 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25052ba-44ea-4463-b515-052c86f76462 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:04.879240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-a25052ba-44ea-4463-b515-052c86f76462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28917c863104bbe9abc5f7e87803f9e', 'request_id': 'req-a25052ba-44ea-4463-b515-052c86f76462'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:04.894725 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-a25052ba-44ea-4463-b515-052c86f76462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28917c863104bbe9abc5f7e87803f9e', 'request_id': 'req-a25052ba-44ea-4463-b515-052c86f76462'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:04.905454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-a25052ba-44ea-4463-b515-052c86f76462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28917c863104bbe9abc5f7e87803f9e', 'request_id': 'req-a25052ba-44ea-4463-b515-052c86f76462'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:04.920513 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-a25052ba-44ea-4463-b515-052c86f76462 admin admin] The token cache is being invalidate because project b28917c863104bbe9abc5f7e87803f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:06:04.920811 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-a25052ba-44ea-4463-b515-052c86f76462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:04.921516 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-a25052ba-44ea-4463-b515-052c86f76462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:04.923904 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1170/2357] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:06:04 2021] DELETE /identity/v3/projects/b28917c863104bbe9abc5f7e87803f9e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:07.010478 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b2b5f-cb5b-49b5-a1b3-6a2e7292a1bf service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:07.012309 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-980b2b5f-cb5b-49b5-a1b3-6a2e7292a1bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:07.031421 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b2b5f-cb5b-49b5-a1b3-6a2e7292a1bf service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:07.162590 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61967d78-8ad8-4455-82cc-1f57f7d28720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:07.172281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61967d78-8ad8-4455-82cc-1f57f7d28720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:07.172281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61967d78-8ad8-4455-82cc-1f57f7d28720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:07.172281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61967d78-8ad8-4455-82cc-1f57f7d28720 admin admin] PATH_INFO: `/v3/users/84e48a2888d34940baecd302fe59f9f8` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:07.172281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61967d78-8ad8-4455-82cc-1f57f7d28720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e48a2888d34940baecd302fe59f9f8)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:07.172281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61967d78-8ad8-4455-82cc-1f57f7d28720 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:07.243014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-61967d78-8ad8-4455-82cc-1f57f7d28720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e48a2888d34940baecd302fe59f9f8'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:07.262356 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-61967d78-8ad8-4455-82cc-1f57f7d28720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e48a2888d34940baecd302fe59f9f8'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:07.272910 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-61967d78-8ad8-4455-82cc-1f57f7d28720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e48a2888d34940baecd302fe59f9f8'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:07.274623 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-61967d78-8ad8-4455-82cc-1f57f7d28720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e48a2888d34940baecd302fe59f9f8'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:07.275356 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-61967d78-8ad8-4455-82cc-1f57f7d28720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e48a2888d34940baecd302fe59f9f8'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:07.293732 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1188/2358] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:06:07 2021] DELETE /identity/v3/users/84e48a2888d34940baecd302fe59f9f8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:07.299376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e171f04-ed09-4e7b-b4b7-d0ba2b7c41db None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:07.300416 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e171f04-ed09-4e7b-b4b7-d0ba2b7c41db None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:07.300945 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e171f04-ed09-4e7b-b4b7-d0ba2b7c41db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:07.333385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-0e171f04-ed09-4e7b-b4b7-d0ba2b7c41db None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:07.335407 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0e171f04-ed09-4e7b-b4b7-d0ba2b7c41db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:07.480146 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1171/2359] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:07.495667 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61967d78-8ad8-4455-82cc-1f57f7d28720 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:07.498158 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-61967d78-8ad8-4455-82cc-1f57f7d28720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:07.621463 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61967d78-8ad8-4455-82cc-1f57f7d28720 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:07.631704 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3855c06-4451-44f3-a62b-aaad230bb50a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:07.633505 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855c06-4451-44f3-a62b-aaad230bb50a service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:07.633805 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855c06-4451-44f3-a62b-aaad230bb50a service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:07.634107 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855c06-4451-44f3-a62b-aaad230bb50a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:07.661881 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3855c06-4451-44f3-a62b-aaad230bb50a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:07.663359 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3855c06-4451-44f3-a62b-aaad230bb50a service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:07.676013 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1189/2360] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:06:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:06:08.184235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e171f04-ed09-4e7b-b4b7-d0ba2b7c41db None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:08.186019 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0e171f04-ed09-4e7b-b4b7-d0ba2b7c41db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:08.208542 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e171f04-ed09-4e7b-b4b7-d0ba2b7c41db None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:08.215215 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5540e6-bd28-415e-894f-20a7a20ae240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:08.216467 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5540e6-bd28-415e-894f-20a7a20ae240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:08.216750 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5540e6-bd28-415e-894f-20a7a20ae240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:08.217023 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5540e6-bd28-415e-894f-20a7a20ae240 admin admin] PATH_INFO: `/v3/projects/4abb5d3d3a7b4a4a90b71be7ef587768` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:08.218287 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5540e6-bd28-415e-894f-20a7a20ae240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4abb5d3d3a7b4a4a90b71be7ef587768)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:08.221654 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5540e6-bd28-415e-894f-20a7a20ae240 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:08.288149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4b5540e6-bd28-415e-894f-20a7a20ae240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4abb5d3d3a7b4a4a90b71be7ef587768', 'request_id': 'req-4b5540e6-bd28-415e-894f-20a7a20ae240'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:08.296792 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4b5540e6-bd28-415e-894f-20a7a20ae240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4abb5d3d3a7b4a4a90b71be7ef587768', 'request_id': 'req-4b5540e6-bd28-415e-894f-20a7a20ae240'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:08.305294 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4b5540e6-bd28-415e-894f-20a7a20ae240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4abb5d3d3a7b4a4a90b71be7ef587768', 'request_id': 'req-4b5540e6-bd28-415e-894f-20a7a20ae240'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:08.321908 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4b5540e6-bd28-415e-894f-20a7a20ae240 admin admin] The token cache is being invalidate because project 4abb5d3d3a7b4a4a90b71be7ef587768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:06:08.322272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4b5540e6-bd28-415e-894f-20a7a20ae240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:08.323130 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4b5540e6-bd28-415e-894f-20a7a20ae240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:08.324925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1172/2361] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:06:08 2021] DELETE /identity/v3/projects/4abb5d3d3a7b4a4a90b71be7ef587768 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:08.332612 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478eeec-4fda-4f50-8ceb-1135b6627b41 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:08.333642 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478eeec-4fda-4f50-8ceb-1135b6627b41 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:08.334532 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478eeec-4fda-4f50-8ceb-1135b6627b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:08.373577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-b478eeec-4fda-4f50-8ceb-1135b6627b41 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:08.374822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b478eeec-4fda-4f50-8ceb-1135b6627b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:08.450024 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1190/2362] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:06:08.460159 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f04e7-fd5f-48d3-b0d4-beb5c438a2d0 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:08.460506 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f04e7-fd5f-48d3-b0d4-beb5c438a2d0 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:08.460720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f04e7-fd5f-48d3-b0d4-beb5c438a2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:08.483575 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-6c6f04e7-fd5f-48d3-b0d4-beb5c438a2d0 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:08.484840 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6c6f04e7-fd5f-48d3-b0d4-beb5c438a2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:08.495747 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1173/2363] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:08.500134 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478eeec-4fda-4f50-8ceb-1135b6627b41 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:08.510904 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478eeec-4fda-4f50-8ceb-1135b6627b41 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:08.520506 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af091b6e-83b3-4a5f-9725-46cdfa38d245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:08.521249 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af091b6e-83b3-4a5f-9725-46cdfa38d245 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:08.521533 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af091b6e-83b3-4a5f-9725-46cdfa38d245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:08.521811 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af091b6e-83b3-4a5f-9725-46cdfa38d245 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:08.522614 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af091b6e-83b3-4a5f-9725-46cdfa38d245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:06:08.522925 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af091b6e-83b3-4a5f-9725-46cdfa38d245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:08.524772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af091b6e-83b3-4a5f-9725-46cdfa38d245 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:08.547719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1191/2364] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:06:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:06:08.547966 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f04e7-fd5f-48d3-b0d4-beb5c438a2d0 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:08.555442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f04e7-fd5f-48d3-b0d4-beb5c438a2d0 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:08.560409 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce35fa-4a73-472c-9d79-0e19ab603ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:08.561157 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce35fa-4a73-472c-9d79-0e19ab603ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:08.561351 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce35fa-4a73-472c-9d79-0e19ab603ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:08.561626 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce35fa-4a73-472c-9d79-0e19ab603ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:08.562416 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce35fa-4a73-472c-9d79-0e19ab603ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:08.564865 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce35fa-4a73-472c-9d79-0e19ab603ce8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:08.599883 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1174/2365] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:06:08 2021] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:06:08.610176 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af091b6e-83b3-4a5f-9725-46cdfa38d245 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:08.621236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af091b6e-83b3-4a5f-9725-46cdfa38d245 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:08.714223 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb31de-e9ed-47e4-b026-6a162773dcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:08.714830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb31de-e9ed-47e4-b026-6a162773dcf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:08.715133 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb31de-e9ed-47e4-b026-6a162773dcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:08.715413 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb31de-e9ed-47e4-b026-6a162773dcf0 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:08.716134 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb31de-e9ed-47e4-b026-6a162773dcf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:08.718169 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb31de-e9ed-47e4-b026-6a162773dcf0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:08.751043 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1192/2366] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:06:08 2021] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:06:08.755555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce35fa-4a73-472c-9d79-0e19ab603ce8 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:08.771673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce35fa-4a73-472c-9d79-0e19ab603ce8 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:08.782385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff7b2b-bf58-4aba-a921-76f2e544cd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:08.783224 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7b2b-bf58-4aba-a921-76f2e544cd74 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:08.783603 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7b2b-bf58-4aba-a921-76f2e544cd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:08.783996 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7b2b-bf58-4aba-a921-76f2e544cd74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:08.784844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff7b2b-bf58-4aba-a921-76f2e544cd74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:08.787200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff7b2b-bf58-4aba-a921-76f2e544cd74 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:08.806666 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1175/2367] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:06:08 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:06:08.810690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb31de-e9ed-47e4-b026-6a162773dcf0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:08.832020 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb31de-e9ed-47e4-b026-6a162773dcf0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:08.839048 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f7d2f-cee6-483a-9fc8-a859ab6309b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:08.841404 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f7d2f-cee6-483a-9fc8-a859ab6309b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:08.842221 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f7d2f-cee6-483a-9fc8-a859ab6309b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:08.844952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f7d2f-cee6-483a-9fc8-a859ab6309b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:08.847939 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f7d2f-cee6-483a-9fc8-a859ab6309b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:08.854997 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f7d2f-cee6-483a-9fc8-a859ab6309b8 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:08.875462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1193/2368] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:06:08 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:06:08.880368 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff7b2b-bf58-4aba-a921-76f2e544cd74 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:08.902623 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff7b2b-bf58-4aba-a921-76f2e544cd74 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:08.908872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e8374-bd80-4533-8b72-c429e63332e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:08.909897 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e8374-bd80-4533-8b72-c429e63332e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:08.910219 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e8374-bd80-4533-8b72-c429e63332e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:08.910529 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e8374-bd80-4533-8b72-c429e63332e4 admin admin] PATH_INFO: `/v3/projects/af1f1649d01b47e69a6dbb158fe2102c/users/42341b27deab4fa58f44771252a0b4c8/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:08.930786 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e8374-bd80-4533-8b72-c429e63332e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1f1649d01b47e69a6dbb158fe2102c, user_id=42341b27deab4fa58f44771252a0b4c8, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:08.934797 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e8374-bd80-4533-8b72-c429e63332e4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:08.953334 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1176/2369] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:06:08 2021] PUT /identity/v3/projects/af1f1649d01b47e69a6dbb158fe2102c/users/42341b27deab4fa58f44771252a0b4c8/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:08.964163 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0907fc-4cc9-416b-bc12-9e1893042374 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:08.964527 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0907fc-4cc9-416b-bc12-9e1893042374 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:08.964766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0907fc-4cc9-416b-bc12-9e1893042374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:09.003032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-4f0907fc-4cc9-416b-bc12-9e1893042374 None None] MFA Rules not processed for user `42341b27deab4fa58f44771252a0b4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:09.004580 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4f0907fc-4cc9-416b-bc12-9e1893042374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:09.087170 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1194/2370] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:08 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:09.099419 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e8374-bd80-4533-8b72-c429e63332e4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:09.101575 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c72e8374-bd80-4533-8b72-c429e63332e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:09.196460 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e8374-bd80-4533-8b72-c429e63332e4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:09.204364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c3839-6ae7-4943-b4d5-0d734c735c1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:09.205145 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c3839-6ae7-4943-b4d5-0d734c735c1e service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:09.205472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c3839-6ae7-4943-b4d5-0d734c735c1e service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:09.205753 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c3839-6ae7-4943-b4d5-0d734c735c1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:09.222116 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c3839-6ae7-4943-b4d5-0d734c735c1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:09.223508 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c3839-6ae7-4943-b4d5-0d734c735c1e service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:09.233069 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1177/2371] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:06:09 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:06:09.264620 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0907fc-4cc9-416b-bc12-9e1893042374 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:09.348297 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0907fc-4cc9-416b-bc12-9e1893042374 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:09.353690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c08ff-4701-419d-a646-a2df6ce1fd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:09.354582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c08ff-4701-419d-a646-a2df6ce1fd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:09.354869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c08ff-4701-419d-a646-a2df6ce1fd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:09.355146 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c08ff-4701-419d-a646-a2df6ce1fd85 admin admin] PATH_INFO: `/v3/users/42341b27deab4fa58f44771252a0b4c8` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:09.356365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c08ff-4701-419d-a646-a2df6ce1fd85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42341b27deab4fa58f44771252a0b4c8)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:09.358357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c08ff-4701-419d-a646-a2df6ce1fd85 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:09.412181 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-771c08ff-4701-419d-a646-a2df6ce1fd85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42341b27deab4fa58f44771252a0b4c8'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:09.430963 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-771c08ff-4701-419d-a646-a2df6ce1fd85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42341b27deab4fa58f44771252a0b4c8'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:09.443329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-771c08ff-4701-419d-a646-a2df6ce1fd85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42341b27deab4fa58f44771252a0b4c8'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:09.444105 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-771c08ff-4701-419d-a646-a2df6ce1fd85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42341b27deab4fa58f44771252a0b4c8'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:09.444930 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-771c08ff-4701-419d-a646-a2df6ce1fd85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42341b27deab4fa58f44771252a0b4c8'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:09.462072 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1195/2372] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:06:09 2021] DELETE /identity/v3/users/42341b27deab4fa58f44771252a0b4c8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:09.464346 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf83ae-d547-471e-9f18-96a0a665e9d2 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:09.464882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf83ae-d547-471e-9f18-96a0a665e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:09.464882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf83ae-d547-471e-9f18-96a0a665e9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:09.485288 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-9cbf83ae-d547-471e-9f18-96a0a665e9d2 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:09.486664 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9cbf83ae-d547-471e-9f18-96a0a665e9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:09.571049 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1178/2373] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:06:09.583474 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c08ff-4701-419d-a646-a2df6ce1fd85 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:09.585673 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-771c08ff-4701-419d-a646-a2df6ce1fd85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:09.682412 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c08ff-4701-419d-a646-a2df6ce1fd85 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:09.688199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c0a8e-f30c-4a79-bc34-746aeb3a805c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:09.689224 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c0a8e-f30c-4a79-bc34-746aeb3a805c service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:09.689823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c0a8e-f30c-4a79-bc34-746aeb3a805c service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:09.690155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c0a8e-f30c-4a79-bc34-746aeb3a805c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:09.703026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c0a8e-f30c-4a79-bc34-746aeb3a805c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:09.704465 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c0a8e-f30c-4a79-bc34-746aeb3a805c service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:09.727811 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1196/2374] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:06:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:06:10.076188 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf83ae-d547-471e-9f18-96a0a665e9d2 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:10.077677 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9cbf83ae-d547-471e-9f18-96a0a665e9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:10.098521 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf83ae-d547-471e-9f18-96a0a665e9d2 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:10.107169 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed3901-6797-4e59-8eb9-0ef9464f3128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:10.109012 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed3901-6797-4e59-8eb9-0ef9464f3128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:10.110093 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed3901-6797-4e59-8eb9-0ef9464f3128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:10.111080 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed3901-6797-4e59-8eb9-0ef9464f3128 admin admin] PATH_INFO: `/v3/projects/af1f1649d01b47e69a6dbb158fe2102c` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:10.116039 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed3901-6797-4e59-8eb9-0ef9464f3128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af1f1649d01b47e69a6dbb158fe2102c)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:10.118886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed3901-6797-4e59-8eb9-0ef9464f3128 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:10.230788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-caed3901-6797-4e59-8eb9-0ef9464f3128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af1f1649d01b47e69a6dbb158fe2102c', 'request_id': 'req-caed3901-6797-4e59-8eb9-0ef9464f3128'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:10.240320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-caed3901-6797-4e59-8eb9-0ef9464f3128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af1f1649d01b47e69a6dbb158fe2102c', 'request_id': 'req-caed3901-6797-4e59-8eb9-0ef9464f3128'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:10.247479 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-caed3901-6797-4e59-8eb9-0ef9464f3128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af1f1649d01b47e69a6dbb158fe2102c', 'request_id': 'req-caed3901-6797-4e59-8eb9-0ef9464f3128'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:10.259218 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-caed3901-6797-4e59-8eb9-0ef9464f3128 admin admin] The token cache is being invalidate because project af1f1649d01b47e69a6dbb158fe2102c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:06:10.259511 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-caed3901-6797-4e59-8eb9-0ef9464f3128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:10.260166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-caed3901-6797-4e59-8eb9-0ef9464f3128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:10.261712 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1179/2375] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:06:10 2021] DELETE /identity/v3/projects/af1f1649d01b47e69a6dbb158fe2102c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:10.268530 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd996e-f46e-4e47-bbfe-91498219a93b None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:10.268856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd996e-f46e-4e47-bbfe-91498219a93b None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:10.269162 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd996e-f46e-4e47-bbfe-91498219a93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:10.292362 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-d4cd996e-f46e-4e47-bbfe-91498219a93b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:10.293679 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d4cd996e-f46e-4e47-bbfe-91498219a93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:10.372318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1197/2376] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:10.380884 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423825d9-d3aa-47ae-9596-4abb347ff888 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:10.381229 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423825d9-d3aa-47ae-9596-4abb347ff888 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:10.381502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423825d9-d3aa-47ae-9596-4abb347ff888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:10.420849 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-423825d9-d3aa-47ae-9596-4abb347ff888 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:10.424479 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-423825d9-d3aa-47ae-9596-4abb347ff888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:10.439392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1180/2377] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:10.444145 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd996e-f46e-4e47-bbfe-91498219a93b None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:10.460532 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd996e-f46e-4e47-bbfe-91498219a93b None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:10.468185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3675eb-fd93-43b9-9dda-207a1e645fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:10.468846 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3675eb-fd93-43b9-9dda-207a1e645fed admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:10.469626 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3675eb-fd93-43b9-9dda-207a1e645fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:10.469926 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3675eb-fd93-43b9-9dda-207a1e645fed admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:10.471782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3675eb-fd93-43b9-9dda-207a1e645fed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:06:10.472102 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3675eb-fd93-43b9-9dda-207a1e645fed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:10.473694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3675eb-fd93-43b9-9dda-207a1e645fed admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:10.486506 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1198/2378] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:06:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 03:06:10.491215 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423825d9-d3aa-47ae-9596-4abb347ff888 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:10.501386 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423825d9-d3aa-47ae-9596-4abb347ff888 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:10.506099 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7baa68-671f-43f2-8259-03e739ebf687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:10.506902 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7baa68-671f-43f2-8259-03e739ebf687 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:10.507240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7baa68-671f-43f2-8259-03e739ebf687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:10.507515 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7baa68-671f-43f2-8259-03e739ebf687 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:10.508229 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7baa68-671f-43f2-8259-03e739ebf687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:10.510207 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7baa68-671f-43f2-8259-03e739ebf687 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:10.538999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1181/2379] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:06:10 2021] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:06:10.543602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3675eb-fd93-43b9-9dda-207a1e645fed admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:10.553706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3675eb-fd93-43b9-9dda-207a1e645fed admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:10.608130 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9eab8-28c9-4ecf-8c28-c8b1f75df2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:10.608742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9eab8-28c9-4ecf-8c28-c8b1f75df2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:10.609144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9eab8-28c9-4ecf-8c28-c8b1f75df2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:10.609358 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9eab8-28c9-4ecf-8c28-c8b1f75df2d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:10.610168 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9eab8-28c9-4ecf-8c28-c8b1f75df2d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:10.612220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9eab8-28c9-4ecf-8c28-c8b1f75df2d1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:10.633755 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1199/2380] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:06:10 2021] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:06:10.638172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7baa68-671f-43f2-8259-03e739ebf687 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:10.648876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7baa68-671f-43f2-8259-03e739ebf687 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:10.653533 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd206f58-2415-4175-b1e0-9dbce62047bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:10.654250 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd206f58-2415-4175-b1e0-9dbce62047bd admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:10.654538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd206f58-2415-4175-b1e0-9dbce62047bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:10.654811 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd206f58-2415-4175-b1e0-9dbce62047bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:10.655544 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd206f58-2415-4175-b1e0-9dbce62047bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:10.657139 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd206f58-2415-4175-b1e0-9dbce62047bd admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:10.667273 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1182/2381] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:06:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:06:10.671224 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9eab8-28c9-4ecf-8c28-c8b1f75df2d1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:10.680876 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9eab8-28c9-4ecf-8c28-c8b1f75df2d1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:10.685329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a5769-526b-430f-8abf-8e774dc7b1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:10.685964 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a5769-526b-430f-8abf-8e774dc7b1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:10.686274 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a5769-526b-430f-8abf-8e774dc7b1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:10.686546 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a5769-526b-430f-8abf-8e774dc7b1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:10.687270 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a5769-526b-430f-8abf-8e774dc7b1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:10.688864 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a5769-526b-430f-8abf-8e774dc7b1e6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:10.698920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1200/2382] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:06:10 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:06:10.702676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd206f58-2415-4175-b1e0-9dbce62047bd admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:10.712946 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd206f58-2415-4175-b1e0-9dbce62047bd admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:10.717487 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c14ec-210d-4604-8fda-45d030bf3445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:10.718374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c14ec-210d-4604-8fda-45d030bf3445 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:10.718658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c14ec-210d-4604-8fda-45d030bf3445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:10.718934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c14ec-210d-4604-8fda-45d030bf3445 admin admin] PATH_INFO: `/v3/projects/494b56bf5eae4d56a5591546f85bc32b/users/97bdf19af9e34fc3886ff451cb9d7a27/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:10.733225 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c14ec-210d-4604-8fda-45d030bf3445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=494b56bf5eae4d56a5591546f85bc32b, user_id=97bdf19af9e34fc3886ff451cb9d7a27, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:10.736171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c14ec-210d-4604-8fda-45d030bf3445 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:10.749655 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1183/2383] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:06:10 2021] PUT /identity/v3/projects/494b56bf5eae4d56a5591546f85bc32b/users/97bdf19af9e34fc3886ff451cb9d7a27/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:10.755358 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475861dc-f83a-459d-91f3-bd2cff481704 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:10.755648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475861dc-f83a-459d-91f3-bd2cff481704 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:10.755928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475861dc-f83a-459d-91f3-bd2cff481704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:10.774265 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-475861dc-f83a-459d-91f3-bd2cff481704 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:10.775443 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-475861dc-f83a-459d-91f3-bd2cff481704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:10.858098 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1201/2384] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:10.868001 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c14ec-210d-4604-8fda-45d030bf3445 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:10.869859 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f90c14ec-210d-4604-8fda-45d030bf3445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:10.929268 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c14ec-210d-4604-8fda-45d030bf3445 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:10.932970 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef69832-80ed-4ee6-8ff4-333195fac8ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:10.933624 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef69832-80ed-4ee6-8ff4-333195fac8ca service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:10.933900 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef69832-80ed-4ee6-8ff4-333195fac8ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:10.934225 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef69832-80ed-4ee6-8ff4-333195fac8ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:10.946879 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef69832-80ed-4ee6-8ff4-333195fac8ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:10.948305 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef69832-80ed-4ee6-8ff4-333195fac8ca service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:10.958382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1184/2385] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:06:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:06:16.959154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee191aa2-b3f5-479c-a987-81dce7071143 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:16.959653 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee191aa2-b3f5-479c-a987-81dce7071143 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:16.959758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee191aa2-b3f5-479c-a987-81dce7071143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:17.006708 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-ee191aa2-b3f5-479c-a987-81dce7071143 None None] MFA Rules not processed for user `97bdf19af9e34fc3886ff451cb9d7a27`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:17.008036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-ee191aa2-b3f5-479c-a987-81dce7071143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:17.122352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1202/2386] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:16 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:17.123609 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef69832-80ed-4ee6-8ff4-333195fac8ca service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:17.159902 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef69832-80ed-4ee6-8ff4-333195fac8ca service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:17.178490 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fde1a-ed5e-4431-99cb-f7cbc1836b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:17.179445 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fde1a-ed5e-4431-99cb-f7cbc1836b2b admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:17.180475 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fde1a-ed5e-4431-99cb-f7cbc1836b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:17.180922 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fde1a-ed5e-4431-99cb-f7cbc1836b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:17.181809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fde1a-ed5e-4431-99cb-f7cbc1836b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:17.184148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fde1a-ed5e-4431-99cb-f7cbc1836b2b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:17.229199 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1185/2387] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:06:17 2021] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:06:17.233231 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee191aa2-b3f5-479c-a987-81dce7071143 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:17.247359 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee191aa2-b3f5-479c-a987-81dce7071143 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:17.327711 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a93fc3-7e75-4de4-a5ba-e9e17fc4d15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:17.328751 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a93fc3-7e75-4de4-a5ba-e9e17fc4d15d admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:17.328751 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a93fc3-7e75-4de4-a5ba-e9e17fc4d15d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:17.328927 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a93fc3-7e75-4de4-a5ba-e9e17fc4d15d admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:17.330075 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a93fc3-7e75-4de4-a5ba-e9e17fc4d15d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:17.332134 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a93fc3-7e75-4de4-a5ba-e9e17fc4d15d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:17.378524 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1203/2388] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:06:17 2021] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:06:17.380654 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fde1a-ed5e-4431-99cb-f7cbc1836b2b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:17.398428 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fde1a-ed5e-4431-99cb-f7cbc1836b2b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:17.415165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feeeff5-82d6-41e1-b0fe-df9681e30432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:17.416186 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeeff5-82d6-41e1-b0fe-df9681e30432 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:17.416856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeeff5-82d6-41e1-b0fe-df9681e30432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:17.417390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeeff5-82d6-41e1-b0fe-df9681e30432 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:17.418395 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feeeff5-82d6-41e1-b0fe-df9681e30432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:17.420919 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feeeff5-82d6-41e1-b0fe-df9681e30432 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:17.464123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1186/2389] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:06:17 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:06:17.469661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a93fc3-7e75-4de4-a5ba-e9e17fc4d15d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:17.488571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a93fc3-7e75-4de4-a5ba-e9e17fc4d15d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:17.512452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f831470-b047-4b88-9b12-e25fec0ca4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:17.524439 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f831470-b047-4b88-9b12-e25fec0ca4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:17.525140 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f831470-b047-4b88-9b12-e25fec0ca4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:17.525606 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f831470-b047-4b88-9b12-e25fec0ca4f2 admin admin] PATH_INFO: `/v3/projects/0fe33ee304da4434be871865c6619a09/users/a8dc1ac9ae974c5a963602603d51b784/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:17.546566 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f831470-b047-4b88-9b12-e25fec0ca4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe33ee304da4434be871865c6619a09, user_id=a8dc1ac9ae974c5a963602603d51b784, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:17.550915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f831470-b047-4b88-9b12-e25fec0ca4f2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:17.584364 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1204/2390] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:06:17 2021] PUT /identity/v3/projects/0fe33ee304da4434be871865c6619a09/users/a8dc1ac9ae974c5a963602603d51b784/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:17.588314 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feeeff5-82d6-41e1-b0fe-df9681e30432 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:17.599590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feeeff5-82d6-41e1-b0fe-df9681e30432 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:17.697872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41bd7b-6a24-4072-a77b-add9abc6c8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:17.698596 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41bd7b-6a24-4072-a77b-add9abc6c8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:17.698886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41bd7b-6a24-4072-a77b-add9abc6c8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:17.699425 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41bd7b-6a24-4072-a77b-add9abc6c8a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:17.699911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41bd7b-6a24-4072-a77b-add9abc6c8a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:17.701619 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41bd7b-6a24-4072-a77b-add9abc6c8a3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:17.714036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1187/2391] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:06:17 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:06:17.717066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f831470-b047-4b88-9b12-e25fec0ca4f2 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:17.731263 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f831470-b047-4b88-9b12-e25fec0ca4f2 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:17.748334 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca805e19-ce56-49e1-a6f2-3a22f2ac1db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:17.749400 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca805e19-ce56-49e1-a6f2-3a22f2ac1db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:17.749842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca805e19-ce56-49e1-a6f2-3a22f2ac1db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:17.749997 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca805e19-ce56-49e1-a6f2-3a22f2ac1db4 admin admin] PATH_INFO: `/v3/projects/0fe33ee304da4434be871865c6619a09/users/a8dc1ac9ae974c5a963602603d51b784/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:17.755000 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca805e19-ce56-49e1-a6f2-3a22f2ac1db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe33ee304da4434be871865c6619a09, user_id=a8dc1ac9ae974c5a963602603d51b784, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:17.758234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca805e19-ce56-49e1-a6f2-3a22f2ac1db4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:17.775034 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1205/2392] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:06:17 2021] PUT /identity/v3/projects/0fe33ee304da4434be871865c6619a09/users/a8dc1ac9ae974c5a963602603d51b784/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:25.907703 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f678d7-8b4c-4625-9b2f-bacf9cddb7e3 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:25.908412 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f678d7-8b4c-4625-9b2f-bacf9cddb7e3 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:25.908412 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f678d7-8b4c-4625-9b2f-bacf9cddb7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:25.939363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-85f678d7-8b4c-4625-9b2f-bacf9cddb7e3 None None] MFA Rules not processed for user `39cddc4e2ea943cd882b6a1addd98e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:25.940543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-85f678d7-8b4c-4625-9b2f-bacf9cddb7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:25.995408 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1188/2393] 10.222.0.18 () {58 vars in 967 bytes} [Wed Dec 15 03:06:25 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:26.009323 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca805e19-ce56-49e1-a6f2-3a22f2ac1db4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:26.011336 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-ca805e19-ce56-49e1-a6f2-3a22f2ac1db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:26.024222 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fa68f-4cbb-4f08-9fd8-e3340b265b94 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:26.024557 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fa68f-4cbb-4f08-9fd8-e3340b265b94 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:26.024844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fa68f-4cbb-4f08-9fd8-e3340b265b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:26.066727 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-061fa68f-4cbb-4f08-9fd8-e3340b265b94 None None] MFA Rules not processed for user `a8dc1ac9ae974c5a963602603d51b784`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:26.068214 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-061fa68f-4cbb-4f08-9fd8-e3340b265b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:26.115521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca805e19-ce56-49e1-a6f2-3a22f2ac1db4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:26.121268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3d76c-bcd3-4249-a838-92cf6b16058d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb0af7ac70d48989852c022c9f83848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:26.122073 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d76c-bcd3-4249-a838-92cf6b16058d service swift] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:26.122358 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d76c-bcd3-4249-a838-92cf6b16058d service swift] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:26.122633 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d76c-bcd3-4249-a838-92cf6b16058d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:26.133270 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3d76c-bcd3-4249-a838-92cf6b16058d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:26.135759 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3d76c-bcd3-4249-a838-92cf6b16058d service swift] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:26.145119 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1206/2394] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Dec 15 03:06:26 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 03:06:26.178127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1189/2395] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:26 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:26.190324 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3d76c-bcd3-4249-a838-92cf6b16058d service swift] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:26.191759 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-daf3d76c-bcd3-4249-a838-92cf6b16058d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:26.341318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3d76c-bcd3-4249-a838-92cf6b16058d service swift] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:26.348731 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414324c-4073-41b1-a654-deda51d0cd11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:26.351579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414324c-4073-41b1-a654-deda51d0cd11 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:26.352011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414324c-4073-41b1-a654-deda51d0cd11 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:26.352011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414324c-4073-41b1-a654-deda51d0cd11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:26.454492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414324c-4073-41b1-a654-deda51d0cd11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:26.456477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414324c-4073-41b1-a654-deda51d0cd11 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:26.466706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1207/2396] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:06:26 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:06:27.533204 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fa68f-4cbb-4f08-9fd8-e3340b265b94 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:27.544860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-061fa68f-4cbb-4f08-9fd8-e3340b265b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:27.684164 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fa68f-4cbb-4f08-9fd8-e3340b265b94 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:27.690377 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363426b-be56-4736-a7b3-2e1947313778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:27.691350 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363426b-be56-4736-a7b3-2e1947313778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:27.691622 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363426b-be56-4736-a7b3-2e1947313778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:27.692261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363426b-be56-4736-a7b3-2e1947313778 admin admin] PATH_INFO: `/v3/users/6ea02b6e8f1548a1bd78952cb7337403` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:27.695360 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363426b-be56-4736-a7b3-2e1947313778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea02b6e8f1548a1bd78952cb7337403)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:27.697411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363426b-be56-4736-a7b3-2e1947313778 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:27.792812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4363426b-be56-4736-a7b3-2e1947313778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea02b6e8f1548a1bd78952cb7337403'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:27.817741 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4363426b-be56-4736-a7b3-2e1947313778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea02b6e8f1548a1bd78952cb7337403'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:27.835890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4363426b-be56-4736-a7b3-2e1947313778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea02b6e8f1548a1bd78952cb7337403'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:27.863939 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4363426b-be56-4736-a7b3-2e1947313778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea02b6e8f1548a1bd78952cb7337403'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:27.867793 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-4363426b-be56-4736-a7b3-2e1947313778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea02b6e8f1548a1bd78952cb7337403'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:27.893353 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1190/2397] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:06:27 2021] DELETE /identity/v3/users/6ea02b6e8f1548a1bd78952cb7337403 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:28.297788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414324c-4073-41b1-a654-deda51d0cd11 service nova] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:28.300858 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b414324c-4073-41b1-a654-deda51d0cd11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:28.546876 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414324c-4073-41b1-a654-deda51d0cd11 service nova] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:28.688599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643866a-dd10-4541-92a9-92c8b61bf265 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93762c21f03d44d5bf3881d17e14ef90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:28.689533 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643866a-dd10-4541-92a9-92c8b61bf265 service placement] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:28.689791 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643866a-dd10-4541-92a9-92c8b61bf265 service placement] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:28.690096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643866a-dd10-4541-92a9-92c8b61bf265 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:28.692992 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363426b-be56-4736-a7b3-2e1947313778 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:28.693462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7643866a-dd10-4541-92a9-92c8b61bf265 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:28.695235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-4363426b-be56-4736-a7b3-2e1947313778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:28.705867 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643866a-dd10-4541-92a9-92c8b61bf265 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:28.708160 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643866a-dd10-4541-92a9-92c8b61bf265 service placement] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:28.720895 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1208/2398] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:06:28 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:06:28.787347 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363426b-be56-4736-a7b3-2e1947313778 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:28.804494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19702be-6fc6-4ec1-987e-6e13e06bdcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:28.805372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19702be-6fc6-4ec1-987e-6e13e06bdcf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:28.805655 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19702be-6fc6-4ec1-987e-6e13e06bdcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:28.805933 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19702be-6fc6-4ec1-987e-6e13e06bdcf0 admin admin] PATH_INFO: `/v3/projects/f5e8a958d4bf43868502b13728b9583b` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:28.807406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19702be-6fc6-4ec1-987e-6e13e06bdcf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e8a958d4bf43868502b13728b9583b)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:28.809604 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19702be-6fc6-4ec1-987e-6e13e06bdcf0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:28.936223 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d19702be-6fc6-4ec1-987e-6e13e06bdcf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e8a958d4bf43868502b13728b9583b', 'request_id': 'req-d19702be-6fc6-4ec1-987e-6e13e06bdcf0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:28.948138 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d19702be-6fc6-4ec1-987e-6e13e06bdcf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e8a958d4bf43868502b13728b9583b', 'request_id': 'req-d19702be-6fc6-4ec1-987e-6e13e06bdcf0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:28.961866 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643866a-dd10-4541-92a9-92c8b61bf265 service placement] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:28.964454 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7643866a-dd10-4541-92a9-92c8b61bf265 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:28.967561 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d19702be-6fc6-4ec1-987e-6e13e06bdcf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e8a958d4bf43868502b13728b9583b', 'request_id': 'req-d19702be-6fc6-4ec1-987e-6e13e06bdcf0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:28.983483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d19702be-6fc6-4ec1-987e-6e13e06bdcf0 admin admin] The token cache is being invalidate because project f5e8a958d4bf43868502b13728b9583b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:06:28.984140 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d19702be-6fc6-4ec1-987e-6e13e06bdcf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:28.984805 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d19702be-6fc6-4ec1-987e-6e13e06bdcf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:28.987537 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1191/2399] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:06:28 2021] DELETE /identity/v3/projects/f5e8a958d4bf43868502b13728b9583b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:06:28.993310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23b9ad-71db-4c6d-9f09-b65795e9e0a5 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:28.993703 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23b9ad-71db-4c6d-9f09-b65795e9e0a5 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:28.994232 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23b9ad-71db-4c6d-9f09-b65795e9e0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:29.001621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643866a-dd10-4541-92a9-92c8b61bf265 service placement] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:29.066255 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-9e23b9ad-71db-4c6d-9f09-b65795e9e0a5 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:29.067479 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9e23b9ad-71db-4c6d-9f09-b65795e9e0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:29.132621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ababa25-63e1-468c-a2ac-56b18940bd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:29.133572 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ababa25-63e1-468c-a2ac-56b18940bd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:29.133915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ababa25-63e1-468c-a2ac-56b18940bd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:29.134433 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ababa25-63e1-468c-a2ac-56b18940bd46 admin admin] PATH_INFO: `/v3/users/0e440754469c4407840a651d560ce08a` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:29.135753 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ababa25-63e1-468c-a2ac-56b18940bd46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e440754469c4407840a651d560ce08a)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:29.139952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ababa25-63e1-468c-a2ac-56b18940bd46 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:29.220296 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1192/2400] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:29.224899 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b39ff-53d0-4ac9-83a7-ec8e823c5e81 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:29.225177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b39ff-53d0-4ac9-83a7-ec8e823c5e81 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:29.225476 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b39ff-53d0-4ac9-83a7-ec8e823c5e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:29.258148 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-8ababa25-63e1-468c-a2ac-56b18940bd46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e440754469c4407840a651d560ce08a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:29.266020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-5f8b39ff-53d0-4ac9-83a7-ec8e823c5e81 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:29.267267 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-5f8b39ff-53d0-4ac9-83a7-ec8e823c5e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:29.273306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-8ababa25-63e1-468c-a2ac-56b18940bd46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e440754469c4407840a651d560ce08a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:29.286694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1193/2401] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:29.289109 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-8ababa25-63e1-468c-a2ac-56b18940bd46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e440754469c4407840a651d560ce08a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:29.289846 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-8ababa25-63e1-468c-a2ac-56b18940bd46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e440754469c4407840a651d560ce08a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:29.290556 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-8ababa25-63e1-468c-a2ac-56b18940bd46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e440754469c4407840a651d560ce08a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:29.290791 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b39ff-53d0-4ac9-83a7-ec8e823c5e81 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:29.311496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b39ff-53d0-4ac9-83a7-ec8e823c5e81 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:29.315148 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1209/2402] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:06:28 2021] DELETE /identity/v3/users/0e440754469c4407840a651d560ce08a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:29.507231 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa43c1-8e8a-45ae-9660-c545c78b4fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:29.508139 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa43c1-8e8a-45ae-9660-c545c78b4fee admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:29.508630 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa43c1-8e8a-45ae-9660-c545c78b4fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:29.509127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa43c1-8e8a-45ae-9660-c545c78b4fee admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:29.510054 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa43c1-8e8a-45ae-9660-c545c78b4fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:06:29.510513 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa43c1-8e8a-45ae-9660-c545c78b4fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:29.512281 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa43c1-8e8a-45ae-9660-c545c78b4fee admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:29.536405 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1194/2403] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:06:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:06:29.540771 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ababa25-63e1-468c-a2ac-56b18940bd46 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:29.542679 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-8ababa25-63e1-468c-a2ac-56b18940bd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:29.584880 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ababa25-63e1-468c-a2ac-56b18940bd46 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:29.599140 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4c9b0-e003-4e79-a3fc-20bde75e369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:29.606464 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4c9b0-e003-4e79-a3fc-20bde75e369d admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:29.606746 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4c9b0-e003-4e79-a3fc-20bde75e369d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:29.607222 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4c9b0-e003-4e79-a3fc-20bde75e369d admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:29.608133 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4c9b0-e003-4e79-a3fc-20bde75e369d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:29.610242 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4c9b0-e003-4e79-a3fc-20bde75e369d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:29.665209 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1210/2404] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:06:29 2021] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:06:29.669445 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa43c1-8e8a-45ae-9660-c545c78b4fee admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:29.681597 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa43c1-8e8a-45ae-9660-c545c78b4fee admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:29.743588 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4c9b0-e003-4e79-a3fc-20bde75e369d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:29.746797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-68e4c9b0-e003-4e79-a3fc-20bde75e369d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:29.775213 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b28f5-6a9c-436e-9e28-824fbe3428bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:29.776493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b28f5-6a9c-436e-9e28-824fbe3428bb admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:29.776782 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b28f5-6a9c-436e-9e28-824fbe3428bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:29.777055 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b28f5-6a9c-436e-9e28-824fbe3428bb admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:29.777946 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b28f5-6a9c-436e-9e28-824fbe3428bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:29.801997 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b28f5-6a9c-436e-9e28-824fbe3428bb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:29.854083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1195/2405] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:06:29 2021] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:06:29.857260 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b28f5-6a9c-436e-9e28-824fbe3428bb admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:29.909162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b28f5-6a9c-436e-9e28-824fbe3428bb admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:29.914935 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5fde8-269a-4769-a947-490149485b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:29.915824 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5fde8-269a-4769-a947-490149485b8e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:29.916101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5fde8-269a-4769-a947-490149485b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:29.916373 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5fde8-269a-4769-a947-490149485b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:29.917313 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5fde8-269a-4769-a947-490149485b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:29.918947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5fde8-269a-4769-a947-490149485b8e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:29.928570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4c9b0-e003-4e79-a3fc-20bde75e369d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:29.932956 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1196/2406] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:06:29 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:06:29.934101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5fde8-269a-4769-a947-490149485b8e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:29.945199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8e050-b73f-453a-96c6-4ad94a3bd308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:29.945363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5fde8-269a-4769-a947-490149485b8e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:29.946109 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8e050-b73f-453a-96c6-4ad94a3bd308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:29.946422 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8e050-b73f-453a-96c6-4ad94a3bd308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:29.946825 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8e050-b73f-453a-96c6-4ad94a3bd308 admin admin] PATH_INFO: `/v3/projects/b6eaf458d3c84ba59b078dc0a3bf1763` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:29.950957 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163bb80-ee6a-4075-b105-eee73215de24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:29.951625 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163bb80-ee6a-4075-b105-eee73215de24 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:29.951923 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163bb80-ee6a-4075-b105-eee73215de24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:29.952222 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163bb80-ee6a-4075-b105-eee73215de24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:29.952883 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163bb80-ee6a-4075-b105-eee73215de24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:29.954614 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163bb80-ee6a-4075-b105-eee73215de24 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:29.956498 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8e050-b73f-453a-96c6-4ad94a3bd308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6eaf458d3c84ba59b078dc0a3bf1763)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:29.962887 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8e050-b73f-453a-96c6-4ad94a3bd308 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:29.968570 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1197/2407] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:06:29 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:06:29.972579 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163bb80-ee6a-4075-b105-eee73215de24 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:29.985777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163bb80-ee6a-4075-b105-eee73215de24 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:29.994092 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99379d-70aa-498a-9bf7-004bd2e2211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:29.995343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99379d-70aa-498a-9bf7-004bd2e2211c admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:29.995785 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99379d-70aa-498a-9bf7-004bd2e2211c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:29.996291 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99379d-70aa-498a-9bf7-004bd2e2211c admin admin] PATH_INFO: `/v3/projects/00e76c2a092544e1a51928f1d84879b2/users/a5fb31c3d4874e13ba22e0242d4aaa58/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:30.015544 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99379d-70aa-498a-9bf7-004bd2e2211c admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e76c2a092544e1a51928f1d84879b2, user_id=a5fb31c3d4874e13ba22e0242d4aaa58, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:30.018791 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99379d-70aa-498a-9bf7-004bd2e2211c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:30.042347 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1198/2408] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:06:29 2021] PUT /identity/v3/projects/00e76c2a092544e1a51928f1d84879b2/users/a5fb31c3d4874e13ba22e0242d4aaa58/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:30.044095 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143221e-5e68-49f4-b43a-c675ccc3b50b None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:30.044462 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143221e-5e68-49f4-b43a-c675ccc3b50b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:30.044758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143221e-5e68-49f4-b43a-c675ccc3b50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:30.075950 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-02a8e050-b73f-453a-96c6-4ad94a3bd308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'request_id': 'req-02a8e050-b73f-453a-96c6-4ad94a3bd308'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:30.076543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-1143221e-5e68-49f4-b43a-c675ccc3b50b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:30.079199 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1143221e-5e68-49f4-b43a-c675ccc3b50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:30.087474 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-02a8e050-b73f-453a-96c6-4ad94a3bd308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'request_id': 'req-02a8e050-b73f-453a-96c6-4ad94a3bd308'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:30.097033 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-02a8e050-b73f-453a-96c6-4ad94a3bd308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'request_id': 'req-02a8e050-b73f-453a-96c6-4ad94a3bd308'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:30.136459 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-02a8e050-b73f-453a-96c6-4ad94a3bd308 admin admin] The token cache is being invalidate because project b6eaf458d3c84ba59b078dc0a3bf1763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:06:30.136862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-02a8e050-b73f-453a-96c6-4ad94a3bd308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:30.137766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-02a8e050-b73f-453a-96c6-4ad94a3bd308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:30.144352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1211/2409] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:06:29 2021] DELETE /identity/v3/projects/b6eaf458d3c84ba59b078dc0a3bf1763 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:30.146304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f3c03-0b3d-49c3-933a-8b51d9de60a7 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:30.146681 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f3c03-0b3d-49c3-933a-8b51d9de60a7 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:30.147980 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f3c03-0b3d-49c3-933a-8b51d9de60a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:30.194984 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-024f3c03-0b3d-49c3-933a-8b51d9de60a7 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:30.202563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1199/2410] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:30.205919 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-024f3c03-0b3d-49c3-933a-8b51d9de60a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:30.216858 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143221e-5e68-49f4-b43a-c675ccc3b50b None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:30.218427 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1143221e-5e68-49f4-b43a-c675ccc3b50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:30.223644 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1212/2411] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:30.245430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4cb0c-b2c8-4e64-865b-de31c0d01fd9 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:30.245639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4cb0c-b2c8-4e64-865b-de31c0d01fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:30.245909 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4cb0c-b2c8-4e64-865b-de31c0d01fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:30.271095 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-e2f4cb0c-b2c8-4e64-865b-de31c0d01fd9 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:30.272442 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e2f4cb0c-b2c8-4e64-865b-de31c0d01fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:30.282635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1213/2412] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:30.287085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4cb0c-b2c8-4e64-865b-de31c0d01fd9 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:30.299149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143221e-5e68-49f4-b43a-c675ccc3b50b None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:30.307352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4cb0c-b2c8-4e64-865b-de31c0d01fd9 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:30.310286 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77e091-0d57-4238-84f5-4a8e6912d6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:30.312141 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77e091-0d57-4238-84f5-4a8e6912d6af service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:30.312317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77e091-0d57-4238-84f5-4a8e6912d6af service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:30.312515 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77e091-0d57-4238-84f5-4a8e6912d6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:30.331886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77e091-0d57-4238-84f5-4a8e6912d6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:30.333681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77e091-0d57-4238-84f5-4a8e6912d6af service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:30.347000 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac7248-6567-476c-91e5-abd535f28a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:30.351180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac7248-6567-476c-91e5-abd535f28a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:30.351661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac7248-6567-476c-91e5-abd535f28a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:30.352095 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac7248-6567-476c-91e5-abd535f28a73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:30.353458 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac7248-6567-476c-91e5-abd535f28a73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:06:30.353933 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac7248-6567-476c-91e5-abd535f28a73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:30.355567 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac7248-6567-476c-91e5-abd535f28a73 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:30.360211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1200/2413] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:06:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:06:30.387601 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1214/2414] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:06:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:06:30.388808 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77e091-0d57-4238-84f5-4a8e6912d6af service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:30.400062 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77e091-0d57-4238-84f5-4a8e6912d6af service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:30.404917 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ba7d0-6fd6-4cd5-951b-1af3c9aa539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:30.405626 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ba7d0-6fd6-4cd5-951b-1af3c9aa539a admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:30.405916 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ba7d0-6fd6-4cd5-951b-1af3c9aa539a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:30.406224 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ba7d0-6fd6-4cd5-951b-1af3c9aa539a admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:30.406931 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ba7d0-6fd6-4cd5-951b-1af3c9aa539a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:30.408881 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ba7d0-6fd6-4cd5-951b-1af3c9aa539a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:30.443074 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1201/2415] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:06:30 2021] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:06:30.447204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac7248-6567-476c-91e5-abd535f28a73 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:30.463386 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac7248-6567-476c-91e5-abd535f28a73 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:30.539303 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697bba5-6fcd-42dc-9e1b-5ec1c2d80933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:30.540204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697bba5-6fcd-42dc-9e1b-5ec1c2d80933 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:30.540732 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697bba5-6fcd-42dc-9e1b-5ec1c2d80933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:30.541281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697bba5-6fcd-42dc-9e1b-5ec1c2d80933 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:30.542768 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697bba5-6fcd-42dc-9e1b-5ec1c2d80933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:30.545404 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697bba5-6fcd-42dc-9e1b-5ec1c2d80933 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:30.577690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1215/2416] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:06:30 2021] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:06:30.582748 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ba7d0-6fd6-4cd5-951b-1af3c9aa539a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:30.598713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ba7d0-6fd6-4cd5-951b-1af3c9aa539a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:30.604003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441aaa9-4d9f-4626-bf16-5398df30f685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:30.605006 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441aaa9-4d9f-4626-bf16-5398df30f685 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:30.605250 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441aaa9-4d9f-4626-bf16-5398df30f685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:30.605631 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441aaa9-4d9f-4626-bf16-5398df30f685 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:30.606707 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441aaa9-4d9f-4626-bf16-5398df30f685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:30.608676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441aaa9-4d9f-4626-bf16-5398df30f685 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:30.627268 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1202/2417] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:06:30 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:06:30.628784 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697bba5-6fcd-42dc-9e1b-5ec1c2d80933 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:30.647823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697bba5-6fcd-42dc-9e1b-5ec1c2d80933 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:30.662435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0a721-37c1-4cef-b110-a2d01c8002a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:30.664139 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0a721-37c1-4cef-b110-a2d01c8002a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:30.664891 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0a721-37c1-4cef-b110-a2d01c8002a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:30.666140 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0a721-37c1-4cef-b110-a2d01c8002a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:30.667782 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0a721-37c1-4cef-b110-a2d01c8002a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:30.672529 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0a721-37c1-4cef-b110-a2d01c8002a6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:30.687821 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1216/2418] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:06:30 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:06:30.692351 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441aaa9-4d9f-4626-bf16-5398df30f685 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:30.705659 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441aaa9-4d9f-4626-bf16-5398df30f685 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:30.715156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d323c3-e72a-4c97-b331-803483a4d265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:30.716771 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d323c3-e72a-4c97-b331-803483a4d265 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:30.717166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d323c3-e72a-4c97-b331-803483a4d265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:30.717536 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d323c3-e72a-4c97-b331-803483a4d265 admin admin] PATH_INFO: `/v3/projects/a41cd2b55c6f4af19342b871bcbeeb83/users/293eb38a7ce0489a9573f600d6fea499/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:30.746971 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d323c3-e72a-4c97-b331-803483a4d265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41cd2b55c6f4af19342b871bcbeeb83, user_id=293eb38a7ce0489a9573f600d6fea499, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:30.749928 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d323c3-e72a-4c97-b331-803483a4d265 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:30.775297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1203/2419] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:06:30 2021] PUT /identity/v3/projects/a41cd2b55c6f4af19342b871bcbeeb83/users/293eb38a7ce0489a9573f600d6fea499/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:30.786350 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d93d6-b1e6-43b5-abdc-63b77f6426b9 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:30.786872 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d93d6-b1e6-43b5-abdc-63b77f6426b9 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:30.787204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d93d6-b1e6-43b5-abdc-63b77f6426b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:30.847193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-3c1d93d6-b1e6-43b5-abdc-63b77f6426b9 None None] MFA Rules not processed for user `293eb38a7ce0489a9573f600d6fea499`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:30.848735 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3c1d93d6-b1e6-43b5-abdc-63b77f6426b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:30.933191 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1217/2420] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:30 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:30.944217 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d323c3-e72a-4c97-b331-803483a4d265 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:30.945964 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d5d323c3-e72a-4c97-b331-803483a4d265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:31.020860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d323c3-e72a-4c97-b331-803483a4d265 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:31.025406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87325c0-5461-49f3-82c6-fa822f192583 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:31.026298 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87325c0-5461-49f3-82c6-fa822f192583 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:31.026799 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87325c0-5461-49f3-82c6-fa822f192583 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:31.027905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87325c0-5461-49f3-82c6-fa822f192583 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:31.037199 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87325c0-5461-49f3-82c6-fa822f192583 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:31.038818 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87325c0-5461-49f3-82c6-fa822f192583 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:31.049106 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1204/2421] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:06:30 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:06:33.835222 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d93d6-b1e6-43b5-abdc-63b77f6426b9 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:33.956754 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d93d6-b1e6-43b5-abdc-63b77f6426b9 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:33.961848 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0da9a-ea75-47af-9fb4-b9e80a646671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:33.962765 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0da9a-ea75-47af-9fb4-b9e80a646671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:33.963590 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0da9a-ea75-47af-9fb4-b9e80a646671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:33.963895 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0da9a-ea75-47af-9fb4-b9e80a646671 admin admin] PATH_INFO: `/v3/users/293eb38a7ce0489a9573f600d6fea499` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:33.965304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0da9a-ea75-47af-9fb4-b9e80a646671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=293eb38a7ce0489a9573f600d6fea499)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:33.967526 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0da9a-ea75-47af-9fb4-b9e80a646671 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:34.076731 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e9c0da9a-ea75-47af-9fb4-b9e80a646671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '293eb38a7ce0489a9573f600d6fea499'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:34.097539 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e9c0da9a-ea75-47af-9fb4-b9e80a646671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '293eb38a7ce0489a9573f600d6fea499'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:34.107503 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e9c0da9a-ea75-47af-9fb4-b9e80a646671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '293eb38a7ce0489a9573f600d6fea499'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:34.108387 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e9c0da9a-ea75-47af-9fb4-b9e80a646671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '293eb38a7ce0489a9573f600d6fea499'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:34.109310 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e9c0da9a-ea75-47af-9fb4-b9e80a646671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '293eb38a7ce0489a9573f600d6fea499'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:34.124786 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1218/2422] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:06:33 2021] DELETE /identity/v3/users/293eb38a7ce0489a9573f600d6fea499 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:34.129126 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b747ef-04a7-4151-86fd-0af03d75a710 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:34.129595 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b747ef-04a7-4151-86fd-0af03d75a710 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:34.129676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b747ef-04a7-4151-86fd-0af03d75a710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:34.156639 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c6b747ef-04a7-4151-86fd-0af03d75a710 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:34.158441 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c6b747ef-04a7-4151-86fd-0af03d75a710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:34.341946 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1205/2423] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:34.423329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0da9a-ea75-47af-9fb4-b9e80a646671 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:34.424918 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e9c0da9a-ea75-47af-9fb4-b9e80a646671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:34.542042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0da9a-ea75-47af-9fb4-b9e80a646671 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:34.548385 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7466b-a8e2-45a8-a3a0-f623bbe6b895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:34.549068 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7466b-a8e2-45a8-a3a0-f623bbe6b895 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:34.549351 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7466b-a8e2-45a8-a3a0-f623bbe6b895 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:34.549626 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7466b-a8e2-45a8-a3a0-f623bbe6b895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:34.566398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7466b-a8e2-45a8-a3a0-f623bbe6b895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:34.568132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7466b-a8e2-45a8-a3a0-f623bbe6b895 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:34.589001 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1219/2424] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:06:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:06:35.448235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b747ef-04a7-4151-86fd-0af03d75a710 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:35.449761 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c6b747ef-04a7-4151-86fd-0af03d75a710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:35.463080 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b747ef-04a7-4151-86fd-0af03d75a710 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:35.469187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcbd91-9b67-4415-ba6c-0309c8efcc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:35.470778 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcbd91-9b67-4415-ba6c-0309c8efcc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:35.471034 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcbd91-9b67-4415-ba6c-0309c8efcc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:35.471472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcbd91-9b67-4415-ba6c-0309c8efcc78 admin admin] PATH_INFO: `/v3/projects/a41cd2b55c6f4af19342b871bcbeeb83` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:35.472922 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcbd91-9b67-4415-ba6c-0309c8efcc78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41cd2b55c6f4af19342b871bcbeeb83)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:35.474878 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcbd91-9b67-4415-ba6c-0309c8efcc78 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:35.562968 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97dcbd91-9b67-4415-ba6c-0309c8efcc78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41cd2b55c6f4af19342b871bcbeeb83', 'request_id': 'req-97dcbd91-9b67-4415-ba6c-0309c8efcc78'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:35.581445 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97dcbd91-9b67-4415-ba6c-0309c8efcc78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41cd2b55c6f4af19342b871bcbeeb83', 'request_id': 'req-97dcbd91-9b67-4415-ba6c-0309c8efcc78'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:35.589488 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97dcbd91-9b67-4415-ba6c-0309c8efcc78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41cd2b55c6f4af19342b871bcbeeb83', 'request_id': 'req-97dcbd91-9b67-4415-ba6c-0309c8efcc78'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:35.604626 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97dcbd91-9b67-4415-ba6c-0309c8efcc78 admin admin] The token cache is being invalidate because project a41cd2b55c6f4af19342b871bcbeeb83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:06:35.604908 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97dcbd91-9b67-4415-ba6c-0309c8efcc78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:35.605595 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97dcbd91-9b67-4415-ba6c-0309c8efcc78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:35.607374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1206/2425] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:06:35 2021] DELETE /identity/v3/projects/a41cd2b55c6f4af19342b871bcbeeb83 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:36.553103 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8471-9459-4da7-b1f4-fd3e226fc3c1 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:36.553578 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8471-9459-4da7-b1f4-fd3e226fc3c1 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:36.553661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8471-9459-4da7-b1f4-fd3e226fc3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:36.579211 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-8adb8471-9459-4da7-b1f4-fd3e226fc3c1 None None] MFA Rules not processed for user `39cddc4e2ea943cd882b6a1addd98e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:36.580409 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-8adb8471-9459-4da7-b1f4-fd3e226fc3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:36.681845 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1220/2426] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Dec 15 03:06:36 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:36.704052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcbd91-9b67-4415-ba6c-0309c8efcc78 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:36.705506 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-97dcbd91-9b67-4415-ba6c-0309c8efcc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:36.783191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcbd91-9b67-4415-ba6c-0309c8efcc78 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:36.789003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175cac1-6f24-45ac-b442-c9003387dd8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb0af7ac70d48989852c022c9f83848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:36.789676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175cac1-6f24-45ac-b442-c9003387dd8f service swift] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:36.790069 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175cac1-6f24-45ac-b442-c9003387dd8f service swift] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:36.790402 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175cac1-6f24-45ac-b442-c9003387dd8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:36.799935 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175cac1-6f24-45ac-b442-c9003387dd8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:36.801619 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175cac1-6f24-45ac-b442-c9003387dd8f service swift] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:36.810800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1207/2427] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Dec 15 03:06:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 03:06:37.653752 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ae470-acab-42f8-a244-65f1d5201fe0 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:37.654367 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ae470-acab-42f8-a244-65f1d5201fe0 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:37.654668 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ae470-acab-42f8-a244-65f1d5201fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:37.725118 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-c90ae470-acab-42f8-a244-65f1d5201fe0 None None] MFA Rules not processed for user `a5fb31c3d4874e13ba22e0242d4aaa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:37.727321 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c90ae470-acab-42f8-a244-65f1d5201fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:37.935870 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1221/2428] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:37 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:37.957942 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175cac1-6f24-45ac-b442-c9003387dd8f service swift] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:37.959994 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6175cac1-6f24-45ac-b442-c9003387dd8f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:38.240263 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175cac1-6f24-45ac-b442-c9003387dd8f service swift] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:38.246996 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a3a21-ebd8-40f8-8827-46c909147232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:38.247641 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a3a21-ebd8-40f8-8827-46c909147232 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:38.247915 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a3a21-ebd8-40f8-8827-46c909147232 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:38.248317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a3a21-ebd8-40f8-8827-46c909147232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:38.260499 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a3a21-ebd8-40f8-8827-46c909147232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:38.264105 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a3a21-ebd8-40f8-8827-46c909147232 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:38.301545 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1208/2429] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:06:37 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:06:41.394075 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfbc3d-c7ac-487d-a3a8-e0fd819604bf None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:41.394623 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfbc3d-c7ac-487d-a3a8-e0fd819604bf None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:41.394623 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfbc3d-c7ac-487d-a3a8-e0fd819604bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:41.428568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-e1dfbc3d-c7ac-487d-a3a8-e0fd819604bf None None] MFA Rules not processed for user `a5fb31c3d4874e13ba22e0242d4aaa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:41.430549 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e1dfbc3d-c7ac-487d-a3a8-e0fd819604bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:41.448421 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1222/2430] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:41 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:46.663388 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a3a21-ebd8-40f8-8827-46c909147232 service nova] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:46.664885 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-fd8a3a21-ebd8-40f8-8827-46c909147232 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:46.756260 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a3a21-ebd8-40f8-8827-46c909147232 service nova] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:46.775885 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6218fe-9a11-42aa-b408-ffbdd8f7fbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:46.777317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6218fe-9a11-42aa-b408-ffbdd8f7fbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:46.777597 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6218fe-9a11-42aa-b408-ffbdd8f7fbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:46.777903 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6218fe-9a11-42aa-b408-ffbdd8f7fbbf admin admin] PATH_INFO: `/v3/users/35d37a3d8e504b8186182468b77dd114` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:46.779200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6218fe-9a11-42aa-b408-ffbdd8f7fbbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d37a3d8e504b8186182468b77dd114)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:46.782375 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6218fe-9a11-42aa-b408-ffbdd8f7fbbf admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:46.864740 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fb6218fe-9a11-42aa-b408-ffbdd8f7fbbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d37a3d8e504b8186182468b77dd114'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:46.906272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fb6218fe-9a11-42aa-b408-ffbdd8f7fbbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d37a3d8e504b8186182468b77dd114'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:46.920973 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fb6218fe-9a11-42aa-b408-ffbdd8f7fbbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d37a3d8e504b8186182468b77dd114'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:46.932278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fb6218fe-9a11-42aa-b408-ffbdd8f7fbbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d37a3d8e504b8186182468b77dd114'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:46.935544 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fb6218fe-9a11-42aa-b408-ffbdd8f7fbbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d37a3d8e504b8186182468b77dd114'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:46.950036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1209/2431] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:06:46 2021] DELETE /identity/v3/users/35d37a3d8e504b8186182468b77dd114 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:47.468261 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfbc3d-c7ac-487d-a3a8-e0fd819604bf None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:47.497588 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfbc3d-c7ac-487d-a3a8-e0fd819604bf None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:47.577590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5479f-57b5-460f-9bb6-05ba339d9b72 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:47.578274 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5479f-57b5-460f-9bb6-05ba339d9b72 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:47.579211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5479f-57b5-460f-9bb6-05ba339d9b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:47.607426 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-8ad5479f-57b5-460f-9bb6-05ba339d9b72 None None] MFA Rules not processed for user `97bdf19af9e34fc3886ff451cb9d7a27`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:47.608719 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8ad5479f-57b5-460f-9bb6-05ba339d9b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:47.630928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89b384-025c-46d4-8265-587c13535f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:47.632873 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89b384-025c-46d4-8265-587c13535f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:47.633683 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89b384-025c-46d4-8265-587c13535f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:47.634152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89b384-025c-46d4-8265-587c13535f02 admin admin] PATH_INFO: `/v3/projects/409b41637da94c469444954258444b4b` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:47.635592 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89b384-025c-46d4-8265-587c13535f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=409b41637da94c469444954258444b4b)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:47.637704 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89b384-025c-46d4-8265-587c13535f02 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:47.697527 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1e89b384-025c-46d4-8265-587c13535f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '409b41637da94c469444954258444b4b', 'request_id': 'req-1e89b384-025c-46d4-8265-587c13535f02'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:47.705270 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1210/2432] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:47 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:06:47.705813 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1e89b384-025c-46d4-8265-587c13535f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '409b41637da94c469444954258444b4b', 'request_id': 'req-1e89b384-025c-46d4-8265-587c13535f02'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:47.713585 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1e89b384-025c-46d4-8265-587c13535f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '409b41637da94c469444954258444b4b', 'request_id': 'req-1e89b384-025c-46d4-8265-587c13535f02'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:47.725357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1e89b384-025c-46d4-8265-587c13535f02 admin admin] The token cache is being invalidate because project 409b41637da94c469444954258444b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:06:47.725922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1e89b384-025c-46d4-8265-587c13535f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:47.726778 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-1e89b384-025c-46d4-8265-587c13535f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:06:47.728797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1223/2433] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:06:47 2021] DELETE /identity/v3/projects/409b41637da94c469444954258444b4b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:47.734576 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d259d0c-a489-430e-8443-f81f2960c910 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:47.735635 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d259d0c-a489-430e-8443-f81f2960c910 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:47.736086 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d259d0c-a489-430e-8443-f81f2960c910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:47.771848 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-8d259d0c-a489-430e-8443-f81f2960c910 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:47.773339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8d259d0c-a489-430e-8443-f81f2960c910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:47.853931 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1211/2434] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:47.862867 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e17d0-72c3-41de-98a7-a3dda9294edf None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:47.863157 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e17d0-72c3-41de-98a7-a3dda9294edf None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:47.863446 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e17d0-72c3-41de-98a7-a3dda9294edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:47.895963 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-cb0e17d0-72c3-41de-98a7-a3dda9294edf None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:47.898511 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-cb0e17d0-72c3-41de-98a7-a3dda9294edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:47.920719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1224/2435] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:47.924748 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d259d0c-a489-430e-8443-f81f2960c910 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:47.941037 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d259d0c-a489-430e-8443-f81f2960c910 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:47.953130 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa369a-60dc-4aef-b68e-11b87424e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:47.954726 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa369a-60dc-4aef-b68e-11b87424e591 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:47.955198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa369a-60dc-4aef-b68e-11b87424e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:47.955910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa369a-60dc-4aef-b68e-11b87424e591 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:47.958527 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa369a-60dc-4aef-b68e-11b87424e591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:06:47.959438 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa369a-60dc-4aef-b68e-11b87424e591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:47.961327 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa369a-60dc-4aef-b68e-11b87424e591 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:47.975788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1212/2436] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:06:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:06:47.980338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e17d0-72c3-41de-98a7-a3dda9294edf None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:47.990218 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e17d0-72c3-41de-98a7-a3dda9294edf None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:47.996524 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9531d-bb35-401b-8c18-fe257cd6128a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:47.997186 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9531d-bb35-401b-8c18-fe257cd6128a admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:47.997469 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9531d-bb35-401b-8c18-fe257cd6128a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:47.997747 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9531d-bb35-401b-8c18-fe257cd6128a admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:47.998508 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9531d-bb35-401b-8c18-fe257cd6128a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:48.000439 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9531d-bb35-401b-8c18-fe257cd6128a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:48.051945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1225/2437] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:06:47 2021] POST /identity/v3/projects => generated 363 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:06:48.054343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa369a-60dc-4aef-b68e-11b87424e591 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:48.068070 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa369a-60dc-4aef-b68e-11b87424e591 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:48.206791 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba901ceb-c663-4689-a034-9f1266050eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:48.207528 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba901ceb-c663-4689-a034-9f1266050eec admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:48.208364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba901ceb-c663-4689-a034-9f1266050eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:48.208657 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba901ceb-c663-4689-a034-9f1266050eec admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:48.209376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba901ceb-c663-4689-a034-9f1266050eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:48.211329 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba901ceb-c663-4689-a034-9f1266050eec admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:48.246015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1213/2438] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:06:48 2021] POST /identity/v3/users => generated 282 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:06:48.247847 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9531d-bb35-401b-8c18-fe257cd6128a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:48.260959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9531d-bb35-401b-8c18-fe257cd6128a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:48.268430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d37d37-b0c2-444e-bd9d-0845bcced18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:48.269556 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d37d37-b0c2-444e-bd9d-0845bcced18a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:48.270084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d37d37-b0c2-444e-bd9d-0845bcced18a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:48.270568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d37d37-b0c2-444e-bd9d-0845bcced18a admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:48.271539 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d37d37-b0c2-444e-bd9d-0845bcced18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:48.273385 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d37d37-b0c2-444e-bd9d-0845bcced18a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:48.289370 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1226/2439] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:06:48 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:06:48.293088 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba901ceb-c663-4689-a034-9f1266050eec admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:48.303386 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba901ceb-c663-4689-a034-9f1266050eec admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:48.308367 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8961ec-e966-4bdd-8b7d-b3376867be1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:48.309030 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8961ec-e966-4bdd-8b7d-b3376867be1f admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:48.309366 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8961ec-e966-4bdd-8b7d-b3376867be1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:48.309781 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8961ec-e966-4bdd-8b7d-b3376867be1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:48.310570 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8961ec-e966-4bdd-8b7d-b3376867be1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:48.325410 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8961ec-e966-4bdd-8b7d-b3376867be1f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:48.346897 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d37d37-b0c2-444e-bd9d-0845bcced18a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:48.363283 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d37d37-b0c2-444e-bd9d-0845bcced18a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:48.365147 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1214/2440] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:06:48 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:06:48.383697 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885c327-fb59-4ba3-9079-7caef2e7da8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:48.384603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885c327-fb59-4ba3-9079-7caef2e7da8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:48.384884 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885c327-fb59-4ba3-9079-7caef2e7da8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:48.386196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885c327-fb59-4ba3-9079-7caef2e7da8b admin admin] PATH_INFO: `/v3/projects/da06e6d6d4c24b4c8d76cd04fe20a7d8/users/f51039f39b84411498a40c2600d57da6/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:48.421531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885c327-fb59-4ba3-9079-7caef2e7da8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da06e6d6d4c24b4c8d76cd04fe20a7d8, user_id=f51039f39b84411498a40c2600d57da6, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:48.427033 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885c327-fb59-4ba3-9079-7caef2e7da8b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:48.450195 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1227/2441] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:06:48 2021] PUT /identity/v3/projects/da06e6d6d4c24b4c8d76cd04fe20a7d8/users/f51039f39b84411498a40c2600d57da6/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:06:48.464065 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793118d-fa60-4b85-a3ea-dcb8bc83a2ea None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:48.464439 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793118d-fa60-4b85-a3ea-dcb8bc83a2ea None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:48.464632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793118d-fa60-4b85-a3ea-dcb8bc83a2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:48.517179 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-6793118d-fa60-4b85-a3ea-dcb8bc83a2ea None None] MFA Rules not processed for user `f51039f39b84411498a40c2600d57da6`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:48.518461 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6793118d-fa60-4b85-a3ea-dcb8bc83a2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:48.638050 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1215/2442] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:48 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:48.642311 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885c327-fb59-4ba3-9079-7caef2e7da8b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:48.770220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885c327-fb59-4ba3-9079-7caef2e7da8b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:48.775679 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386e439-9088-482f-be44-278f79a1e7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:48.776734 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386e439-9088-482f-be44-278f79a1e7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:48.777813 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386e439-9088-482f-be44-278f79a1e7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:48.778403 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386e439-9088-482f-be44-278f79a1e7b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:48.779483 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386e439-9088-482f-be44-278f79a1e7b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:48.782982 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386e439-9088-482f-be44-278f79a1e7b6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:48.840442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793118d-fa60-4b85-a3ea-dcb8bc83a2ea None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:48.841012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1228/2443] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:06:48 2021] POST /identity/v3/projects => generated 365 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:06:48.862610 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793118d-fa60-4b85-a3ea-dcb8bc83a2ea None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:48.887868 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386e439-9088-482f-be44-278f79a1e7b6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:48.889606 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-8386e439-9088-482f-be44-278f79a1e7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:48.978101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc0f51-5d68-43ef-b6cf-ef2da9b6d6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:48.978784 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc0f51-5d68-43ef-b6cf-ef2da9b6d6ce admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:48.979089 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc0f51-5d68-43ef-b6cf-ef2da9b6d6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:48.979363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc0f51-5d68-43ef-b6cf-ef2da9b6d6ce admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:48.980069 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc0f51-5d68-43ef-b6cf-ef2da9b6d6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:48.985313 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc0f51-5d68-43ef-b6cf-ef2da9b6d6ce admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:49.007396 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386e439-9088-482f-be44-278f79a1e7b6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:49.013136 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdfb94-e399-4674-bcfc-650ae880ba8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:49.013789 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdfb94-e399-4674-bcfc-650ae880ba8a service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:49.014102 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdfb94-e399-4674-bcfc-650ae880ba8a service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:49.014500 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdfb94-e399-4674-bcfc-650ae880ba8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:49.019979 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c9fdfb94-e399-4674-bcfc-650ae880ba8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:49.024100 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1216/2444] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:06:48 2021] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:06:49.027722 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc0f51-5d68-43ef-b6cf-ef2da9b6d6ce admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:49.053401 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc0f51-5d68-43ef-b6cf-ef2da9b6d6ce admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:49.060622 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9d484-bb1a-4a09-98d6-3f3efb238c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:49.061229 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9d484-bb1a-4a09-98d6-3f3efb238c33 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:49.061830 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9d484-bb1a-4a09-98d6-3f3efb238c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:49.062234 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9d484-bb1a-4a09-98d6-3f3efb238c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:49.063466 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9d484-bb1a-4a09-98d6-3f3efb238c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:49.065538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9d484-bb1a-4a09-98d6-3f3efb238c33 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:49.091492 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1217/2445] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:06:49 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:06:49.098627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9d484-bb1a-4a09-98d6-3f3efb238c33 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:49.116227 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9d484-bb1a-4a09-98d6-3f3efb238c33 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:49.128657 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec5fc6-5b3d-4fdc-b9cf-8af4a3a22449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:49.129765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec5fc6-5b3d-4fdc-b9cf-8af4a3a22449 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:49.130250 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec5fc6-5b3d-4fdc-b9cf-8af4a3a22449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:49.130706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec5fc6-5b3d-4fdc-b9cf-8af4a3a22449 admin admin] PATH_INFO: `/v3/projects/ab41b416e18f4b10923c29b3b7519344/users/050919739b724684a78d06c1d41b2aa2/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:49.151660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec5fc6-5b3d-4fdc-b9cf-8af4a3a22449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab41b416e18f4b10923c29b3b7519344, user_id=050919739b724684a78d06c1d41b2aa2, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:49.159663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec5fc6-5b3d-4fdc-b9cf-8af4a3a22449 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:49.166387 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdfb94-e399-4674-bcfc-650ae880ba8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:49.169916 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdfb94-e399-4674-bcfc-650ae880ba8a service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:49.189586 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1218/2446] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:06:49 2021] PUT /identity/v3/projects/ab41b416e18f4b10923c29b3b7519344/users/050919739b724684a78d06c1d41b2aa2/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:49.194128 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec5fc6-5b3d-4fdc-b9cf-8af4a3a22449 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:49.214244 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1229/2447] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:06:48 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:06:49.310965 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec5fc6-5b3d-4fdc-b9cf-8af4a3a22449 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:49.321738 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ddef3-0288-4811-84d8-19a5ded7d6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:49.322988 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ddef3-0288-4811-84d8-19a5ded7d6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:49.323422 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ddef3-0288-4811-84d8-19a5ded7d6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:49.323776 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ddef3-0288-4811-84d8-19a5ded7d6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:49.324692 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ddef3-0288-4811-84d8-19a5ded7d6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:49.326803 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ddef3-0288-4811-84d8-19a5ded7d6a3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:49.343466 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdfb94-e399-4674-bcfc-650ae880ba8a service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:49.350664 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1219/2448] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:06:49 2021] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:06:49.360738 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdfb94-e399-4674-bcfc-650ae880ba8a service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:49.366578 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dffa6f-0abd-4e16-9f05-643e2137efaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:49.367621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dffa6f-0abd-4e16-9f05-643e2137efaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:49.368176 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dffa6f-0abd-4e16-9f05-643e2137efaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:49.368635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dffa6f-0abd-4e16-9f05-643e2137efaf admin admin] PATH_INFO: `/v3/projects/ab41b416e18f4b10923c29b3b7519344/users/050919739b724684a78d06c1d41b2aa2/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:49.371072 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dffa6f-0abd-4e16-9f05-643e2137efaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab41b416e18f4b10923c29b3b7519344, user_id=050919739b724684a78d06c1d41b2aa2, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:49.374498 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dffa6f-0abd-4e16-9f05-643e2137efaf admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:49.400978 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c3a4c-8d6b-4efb-88c6-ceccd0d37191 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:49.401302 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c3a4c-8d6b-4efb-88c6-ceccd0d37191 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:49.401669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c3a4c-8d6b-4efb-88c6-ceccd0d37191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:49.403135 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1230/2449] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:06:49 2021] PUT /identity/v3/projects/ab41b416e18f4b10923c29b3b7519344/users/050919739b724684a78d06c1d41b2aa2/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:06:49.449870 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-d32c3a4c-8d6b-4efb-88c6-ceccd0d37191 None None] MFA Rules not processed for user `050919739b724684a78d06c1d41b2aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:49.451573 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d32c3a4c-8d6b-4efb-88c6-ceccd0d37191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:49.558004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1220/2450] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:06:49 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:49.567014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dffa6f-0abd-4e16-9f05-643e2137efaf admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:49.569124 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-20dffa6f-0abd-4e16-9f05-643e2137efaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:49.749208 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dffa6f-0abd-4e16-9f05-643e2137efaf admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:49.759217 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef65f8a-dd9f-4d53-9635-3c9f9724729b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:49.759887 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef65f8a-dd9f-4d53-9635-3c9f9724729b service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:49.760165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef65f8a-dd9f-4d53-9635-3c9f9724729b service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:49.760437 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef65f8a-dd9f-4d53-9635-3c9f9724729b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:49.784310 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef65f8a-dd9f-4d53-9635-3c9f9724729b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:49.788981 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef65f8a-dd9f-4d53-9635-3c9f9724729b service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:49.810905 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1231/2451] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:06:49 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:06:49.934789 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c3a4c-8d6b-4efb-88c6-ceccd0d37191 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:49.953816 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c3a4c-8d6b-4efb-88c6-ceccd0d37191 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:49.969823 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812fda2-dc39-4e11-9f4e-4ec34d9c8284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:49.970628 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812fda2-dc39-4e11-9f4e-4ec34d9c8284 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:49.970965 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812fda2-dc39-4e11-9f4e-4ec34d9c8284 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:49.971358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812fda2-dc39-4e11-9f4e-4ec34d9c8284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:50.064911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812fda2-dc39-4e11-9f4e-4ec34d9c8284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:50.066411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812fda2-dc39-4e11-9f4e-4ec34d9c8284 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:50.081095 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1221/2452] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:06:49 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:06:59.708959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea203f-eb73-41a4-9cf3-577740fee34f None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:59.709404 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea203f-eb73-41a4-9cf3-577740fee34f None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:59.709404 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea203f-eb73-41a4-9cf3-577740fee34f None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:59.711452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1232/2453] 10.222.0.18 () {54 vars in 921 bytes} [Wed Dec 15 03:06:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:06:59.718853 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b17115-1f63-4979-95db-fc8782ecf037 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:59.719414 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b17115-1f63-4979-95db-fc8782ecf037 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:59.719635 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b17115-1f63-4979-95db-fc8782ecf037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:59.760730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-63b17115-1f63-4979-95db-fc8782ecf037 None None] MFA Rules not processed for user `fcd50adcd390465ea6fc8582e1524909`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:06:59.762282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-63b17115-1f63-4979-95db-fc8782ecf037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:59.847627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1222/2454] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Dec 15 03:06:59 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:06:59.860362 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea203f-eb73-41a4-9cf3-577740fee34f None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:06:59.862219 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-66ea203f-eb73-41a4-9cf3-577740fee34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:06:59.941285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea203f-eb73-41a4-9cf3-577740fee34f None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:06:59.946336 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab83844-20c6-42f5-a614-68663c9b64f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48dcc22c7df4aed8fa6cf32e3c2ec51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:06:59.946904 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab83844-20c6-42f5-a614-68663c9b64f2 service glance] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:06:59.947164 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab83844-20c6-42f5-a614-68663c9b64f2 service glance] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:06:59.947451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab83844-20c6-42f5-a614-68663c9b64f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:06:59.958231 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab83844-20c6-42f5-a614-68663c9b64f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:06:59.959664 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab83844-20c6-42f5-a614-68663c9b64f2 service glance] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:06:59.972066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1233/2455] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:06:59 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:07:00.046787 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51199f12-4771-402c-a69e-78949f7732f6 None None] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:00.047124 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51199f12-4771-402c-a69e-78949f7732f6 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:00.047950 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51199f12-4771-402c-a69e-78949f7732f6 None None] PATH_INFO: `/` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:00.050162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1223/2456] 10.222.0.18 () {54 vars in 921 bytes} [Wed Dec 15 03:07:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 03:07:00.056194 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd3944-dd0b-42d3-818d-119ce9cdc2c1 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:00.056622 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd3944-dd0b-42d3-818d-119ce9cdc2c1 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:00.056890 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd3944-dd0b-42d3-818d-119ce9cdc2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:00.076180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-63bd3944-dd0b-42d3-818d-119ce9cdc2c1 None None] MFA Rules not processed for user `eb120cde66b246909cf8e0b7b8d96ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:00.077547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-63bd3944-dd0b-42d3-818d-119ce9cdc2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:00.132325 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1234/2457] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Dec 15 03:07:00 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:07:00.145030 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51199f12-4771-402c-a69e-78949f7732f6 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:00.146708 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-51199f12-4771-402c-a69e-78949f7732f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:00.160567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51199f12-4771-402c-a69e-78949f7732f6 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:00.163986 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03c16f-446a-4763-928a-09a1981852ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:00.164630 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03c16f-446a-4763-928a-09a1981852ef service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:00.164908 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03c16f-446a-4763-928a-09a1981852ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:00.165179 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03c16f-446a-4763-928a-09a1981852ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:00.171917 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03c16f-446a-4763-928a-09a1981852ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:00.173909 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03c16f-446a-4763-928a-09a1981852ef service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:00.181305 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1224/2458] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:00 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:07:00.997078 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd3944-dd0b-42d3-818d-119ce9cdc2c1 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:01.059151 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd3944-dd0b-42d3-818d-119ce9cdc2c1 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:01.064024 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcaebe-9721-417b-ace7-30f730dc840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:01.064884 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcaebe-9721-417b-ace7-30f730dc840c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:01.065169 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcaebe-9721-417b-ace7-30f730dc840c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:01.065443 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcaebe-9721-417b-ace7-30f730dc840c admin admin] PATH_INFO: `/v3/users/f51039f39b84411498a40c2600d57da6` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:01.066657 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcaebe-9721-417b-ace7-30f730dc840c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51039f39b84411498a40c2600d57da6)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:01.068544 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcaebe-9721-417b-ace7-30f730dc840c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:01.113355 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f3dcaebe-9721-417b-ace7-30f730dc840c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51039f39b84411498a40c2600d57da6'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:01.130156 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f3dcaebe-9721-417b-ace7-30f730dc840c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51039f39b84411498a40c2600d57da6'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:01.138411 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f3dcaebe-9721-417b-ace7-30f730dc840c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51039f39b84411498a40c2600d57da6'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:01.139099 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f3dcaebe-9721-417b-ace7-30f730dc840c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51039f39b84411498a40c2600d57da6'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:01.140188 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f3dcaebe-9721-417b-ace7-30f730dc840c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51039f39b84411498a40c2600d57da6'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:01.154992 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1235/2459] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:07:00 2021] DELETE /identity/v3/users/f51039f39b84411498a40c2600d57da6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:01.159767 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed2378-0960-4904-bb11-f20d49378c2e None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:01.160292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed2378-0960-4904-bb11-f20d49378c2e None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:01.160292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed2378-0960-4904-bb11-f20d49378c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:01.178994 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-60ed2378-0960-4904-bb11-f20d49378c2e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:01.180189 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-60ed2378-0960-4904-bb11-f20d49378c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:01.243842 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1225/2460] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:01.254914 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcaebe-9721-417b-ace7-30f730dc840c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:01.256441 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f3dcaebe-9721-417b-ace7-30f730dc840c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:01.318420 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcaebe-9721-417b-ace7-30f730dc840c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:01.322431 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e621ca-b090-4b36-8394-cd1526f8a1f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:01.323084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e621ca-b090-4b36-8394-cd1526f8a1f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:01.323370 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e621ca-b090-4b36-8394-cd1526f8a1f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:01.323651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e621ca-b090-4b36-8394-cd1526f8a1f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:01.332970 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e621ca-b090-4b36-8394-cd1526f8a1f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:01.334441 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e621ca-b090-4b36-8394-cd1526f8a1f4 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:01.343883 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1236/2461] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:07:01.600269 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed2378-0960-4904-bb11-f20d49378c2e None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:01.601757 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-60ed2378-0960-4904-bb11-f20d49378c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:01.616022 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed2378-0960-4904-bb11-f20d49378c2e None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:01.621169 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:01.622137 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:01.622422 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:01.622794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b admin admin] PATH_INFO: `/v3/projects/da06e6d6d4c24b4c8d76cd04fe20a7d8` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:01.624058 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=da06e6d6d4c24b4c8d76cd04fe20a7d8)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:01.626065 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:01.674661 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da06e6d6d4c24b4c8d76cd04fe20a7d8', 'request_id': 'req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:01.683511 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da06e6d6d4c24b4c8d76cd04fe20a7d8', 'request_id': 'req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:01.689779 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da06e6d6d4c24b4c8d76cd04fe20a7d8', 'request_id': 'req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:01.700024 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b admin admin] The token cache is being invalidate because project da06e6d6d4c24b4c8d76cd04fe20a7d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:07:01.700310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:01.700944 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:01.702594 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1226/2462] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:07:01 2021] DELETE /identity/v3/projects/da06e6d6d4c24b4c8d76cd04fe20a7d8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:01.706640 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e621ca-b090-4b36-8394-cd1526f8a1f4 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:01.715971 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e621ca-b090-4b36-8394-cd1526f8a1f4 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:01.770842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3907a-6bb1-4a0a-afd1-87599dd985a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:01.771706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3907a-6bb1-4a0a-afd1-87599dd985a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:01.771988 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3907a-6bb1-4a0a-afd1-87599dd985a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:01.772264 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3907a-6bb1-4a0a-afd1-87599dd985a0 admin admin] PATH_INFO: `/v3/users/050919739b724684a78d06c1d41b2aa2` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:01.773459 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3907a-6bb1-4a0a-afd1-87599dd985a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=050919739b724684a78d06c1d41b2aa2)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:01.775427 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3907a-6bb1-4a0a-afd1-87599dd985a0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:01.820293 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-a6d3907a-6bb1-4a0a-afd1-87599dd985a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '050919739b724684a78d06c1d41b2aa2'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:01.831697 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-a6d3907a-6bb1-4a0a-afd1-87599dd985a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '050919739b724684a78d06c1d41b2aa2'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:01.839150 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-a6d3907a-6bb1-4a0a-afd1-87599dd985a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '050919739b724684a78d06c1d41b2aa2'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:01.839755 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-a6d3907a-6bb1-4a0a-afd1-87599dd985a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '050919739b724684a78d06c1d41b2aa2'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:01.840357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-a6d3907a-6bb1-4a0a-afd1-87599dd985a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '050919739b724684a78d06c1d41b2aa2'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:01.852844 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1237/2463] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:07:01 2021] DELETE /identity/v3/users/050919739b724684a78d06c1d41b2aa2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:02.167437 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:02.169034 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:02.188267 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dade6-6c62-4a4b-9bdf-75b1e5fcbb8b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:02.273482 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164086f-88b6-4eb8-9881-40a0e9833bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:02.274590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164086f-88b6-4eb8-9881-40a0e9833bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:02.274882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164086f-88b6-4eb8-9881-40a0e9833bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:02.277671 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164086f-88b6-4eb8-9881-40a0e9833bb1 admin admin] PATH_INFO: `/v3/projects/ab41b416e18f4b10923c29b3b7519344` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:02.279582 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164086f-88b6-4eb8-9881-40a0e9833bb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab41b416e18f4b10923c29b3b7519344)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:02.282423 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164086f-88b6-4eb8-9881-40a0e9833bb1 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:02.332483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d164086f-88b6-4eb8-9881-40a0e9833bb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab41b416e18f4b10923c29b3b7519344', 'request_id': 'req-d164086f-88b6-4eb8-9881-40a0e9833bb1'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:02.341337 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d164086f-88b6-4eb8-9881-40a0e9833bb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab41b416e18f4b10923c29b3b7519344', 'request_id': 'req-d164086f-88b6-4eb8-9881-40a0e9833bb1'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:02.348142 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d164086f-88b6-4eb8-9881-40a0e9833bb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab41b416e18f4b10923c29b3b7519344', 'request_id': 'req-d164086f-88b6-4eb8-9881-40a0e9833bb1'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:02.358922 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d164086f-88b6-4eb8-9881-40a0e9833bb1 admin admin] The token cache is being invalidate because project ab41b416e18f4b10923c29b3b7519344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:07:02.359208 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d164086f-88b6-4eb8-9881-40a0e9833bb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:02.359895 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d164086f-88b6-4eb8-9881-40a0e9833bb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:02.361414 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1227/2464] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:07:02 2021] DELETE /identity/v3/projects/ab41b416e18f4b10923c29b3b7519344 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:02.367063 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ddd5e-f411-4463-9674-a37dc5a095bf None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:02.367905 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ddd5e-f411-4463-9674-a37dc5a095bf None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:02.368193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ddd5e-f411-4463-9674-a37dc5a095bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:02.387095 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-3c0ddd5e-f411-4463-9674-a37dc5a095bf None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:02.388281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3c0ddd5e-f411-4463-9674-a37dc5a095bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:02.455538 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1238/2465] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:02.464472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58563045-aac3-4416-99d9-89b4ed519bf0 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:02.464764 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58563045-aac3-4416-99d9-89b4ed519bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:02.465068 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58563045-aac3-4416-99d9-89b4ed519bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:02.482991 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-58563045-aac3-4416-99d9-89b4ed519bf0 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:02.484213 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-58563045-aac3-4416-99d9-89b4ed519bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:02.492080 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1228/2466] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:02.496557 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ddd5e-f411-4463-9674-a37dc5a095bf None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:02.506547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ddd5e-f411-4463-9674-a37dc5a095bf None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:02.511152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be57f06-7c90-4998-a799-97dc7ae71050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:02.511795 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be57f06-7c90-4998-a799-97dc7ae71050 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:02.512079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be57f06-7c90-4998-a799-97dc7ae71050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:02.512354 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be57f06-7c90-4998-a799-97dc7ae71050 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:02.513083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be57f06-7c90-4998-a799-97dc7ae71050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:07:02.513386 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be57f06-7c90-4998-a799-97dc7ae71050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:02.515008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be57f06-7c90-4998-a799-97dc7ae71050 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:02.526984 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1239/2467] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:07:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 03:07:02.531190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58563045-aac3-4416-99d9-89b4ed519bf0 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:02.540472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58563045-aac3-4416-99d9-89b4ed519bf0 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:02.545128 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdcad6-6c60-4a40-910e-58b8244f5d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:02.545767 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdcad6-6c60-4a40-910e-58b8244f5d1b admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:02.546074 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdcad6-6c60-4a40-910e-58b8244f5d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:02.546349 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdcad6-6c60-4a40-910e-58b8244f5d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:02.547156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdcad6-6c60-4a40-910e-58b8244f5d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:02.549006 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdcad6-6c60-4a40-910e-58b8244f5d1b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:02.578402 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1229/2468] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:07:02 2021] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:07:02.580641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be57f06-7c90-4998-a799-97dc7ae71050 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:02.590371 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be57f06-7c90-4998-a799-97dc7ae71050 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:02.644542 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041bae7-79e6-4929-bece-e14f5039fb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:02.645199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041bae7-79e6-4929-bece-e14f5039fb86 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:02.645478 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041bae7-79e6-4929-bece-e14f5039fb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:02.645752 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041bae7-79e6-4929-bece-e14f5039fb86 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:02.646480 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041bae7-79e6-4929-bece-e14f5039fb86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:02.648370 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041bae7-79e6-4929-bece-e14f5039fb86 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:02.666956 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1240/2469] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:07:02 2021] POST /identity/v3/users => generated 294 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:07:02.671271 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdcad6-6c60-4a40-910e-58b8244f5d1b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:02.681935 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdcad6-6c60-4a40-910e-58b8244f5d1b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:02.686503 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9c41b-afc5-412a-bf08-c3e8eafbc2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:02.687083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9c41b-afc5-412a-bf08-c3e8eafbc2dd admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:02.687366 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9c41b-afc5-412a-bf08-c3e8eafbc2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:02.687637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9c41b-afc5-412a-bf08-c3e8eafbc2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:02.689045 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9c41b-afc5-412a-bf08-c3e8eafbc2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:02.690661 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9c41b-afc5-412a-bf08-c3e8eafbc2dd admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:02.700550 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1230/2470] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:02.704397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041bae7-79e6-4929-bece-e14f5039fb86 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:02.714356 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041bae7-79e6-4929-bece-e14f5039fb86 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:02.719015 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e80ee-57c0-4703-9b2c-14f687feb51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:02.719669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e80ee-57c0-4703-9b2c-14f687feb51c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:02.719951 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e80ee-57c0-4703-9b2c-14f687feb51c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:02.720231 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e80ee-57c0-4703-9b2c-14f687feb51c admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:02.720996 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e80ee-57c0-4703-9b2c-14f687feb51c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:02.722894 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e80ee-57c0-4703-9b2c-14f687feb51c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:02.734364 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1241/2471] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:02.738965 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9c41b-afc5-412a-bf08-c3e8eafbc2dd admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:02.748866 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9c41b-afc5-412a-bf08-c3e8eafbc2dd admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:02.754123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e53f87-781d-40ba-b0d9-b02cd0cbd7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:02.755370 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e53f87-781d-40ba-b0d9-b02cd0cbd7cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:02.755647 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e53f87-781d-40ba-b0d9-b02cd0cbd7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:02.755930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e53f87-781d-40ba-b0d9-b02cd0cbd7cb admin admin] PATH_INFO: `/v3/projects/3592d462032342d2abcb732ebcf75a2e/users/60e23a3b0da6435badb6598fb3580278/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:02.771132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e53f87-781d-40ba-b0d9-b02cd0cbd7cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3592d462032342d2abcb732ebcf75a2e, user_id=60e23a3b0da6435badb6598fb3580278, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:02.773437 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e53f87-781d-40ba-b0d9-b02cd0cbd7cb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:02.786526 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1231/2472] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:02 2021] PUT /identity/v3/projects/3592d462032342d2abcb732ebcf75a2e/users/60e23a3b0da6435badb6598fb3580278/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:07:02.791659 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764efac-f74d-4029-b495-08d8c0af5691 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:02.791947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764efac-f74d-4029-b495-08d8c0af5691 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:02.792224 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764efac-f74d-4029-b495-08d8c0af5691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:02.796730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28870c-6990-4774-bd9a-f8b9f1360cf4 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:02.797633 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28870c-6990-4774-bd9a-f8b9f1360cf4 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:02.797996 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28870c-6990-4774-bd9a-f8b9f1360cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:02.823586 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-0a28870c-6990-4774-bd9a-f8b9f1360cf4 None None] MFA Rules not processed for user `60e23a3b0da6435badb6598fb3580278`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:02.824778 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0a28870c-6990-4774-bd9a-f8b9f1360cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:02.840157 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-4764efac-f74d-4029-b495-08d8c0af5691 None None] MFA Rules not processed for user `39cddc4e2ea943cd882b6a1addd98e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:02.841322 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4764efac-f74d-4029-b495-08d8c0af5691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:02.887460 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1232/2473] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:02 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:07:02.892051 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28870c-6990-4774-bd9a-f8b9f1360cf4 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:02.908471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1242/2474] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Dec 15 03:07:02 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:02.921032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764efac-f74d-4029-b495-08d8c0af5691 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:02.922947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4764efac-f74d-4029-b495-08d8c0af5691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:02.950789 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28870c-6990-4774-bd9a-f8b9f1360cf4 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:02.955430 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af30ab-8dbc-4cc1-b3a6-e6dc870ed9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:02.956069 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af30ab-8dbc-4cc1-b3a6-e6dc870ed9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:02.956343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af30ab-8dbc-4cc1-b3a6-e6dc870ed9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:02.956612 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af30ab-8dbc-4cc1-b3a6-e6dc870ed9e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:02.957330 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af30ab-8dbc-4cc1-b3a6-e6dc870ed9e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:02.959234 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af30ab-8dbc-4cc1-b3a6-e6dc870ed9e9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:02.986481 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1233/2475] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:07:02 2021] POST /identity/v3/projects => generated 389 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:07:02.987493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af30ab-8dbc-4cc1-b3a6-e6dc870ed9e9 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:03.010127 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764efac-f74d-4029-b495-08d8c0af5691 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:03.046147 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af30ab-8dbc-4cc1-b3a6-e6dc870ed9e9 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:03.052163 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12884a22-8dc4-4cf4-8c20-0748bc75f0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:03.052845 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12884a22-8dc4-4cf4-8c20-0748bc75f0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:03.053172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12884a22-8dc4-4cf4-8c20-0748bc75f0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:03.053442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12884a22-8dc4-4cf4-8c20-0748bc75f0f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:03.054218 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12884a22-8dc4-4cf4-8c20-0748bc75f0f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:03.056134 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12884a22-8dc4-4cf4-8c20-0748bc75f0f8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:03.068945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e0eec-eb34-4d84-93fe-efde7d79d83c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb0af7ac70d48989852c022c9f83848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:03.069728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0eec-eb34-4d84-93fe-efde7d79d83c service swift] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:03.070085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0eec-eb34-4d84-93fe-efde7d79d83c service swift] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:03.070326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0eec-eb34-4d84-93fe-efde7d79d83c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:03.076058 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1234/2476] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:07:02 2021] POST /identity/v3/users => generated 301 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:07:03.080138 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12884a22-8dc4-4cf4-8c20-0748bc75f0f8 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:03.089255 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12884a22-8dc4-4cf4-8c20-0748bc75f0f8 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:03.093743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896478f-c19e-484d-a36f-21eea381d62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:03.094900 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896478f-c19e-484d-a36f-21eea381d62a admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:03.095178 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896478f-c19e-484d-a36f-21eea381d62a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:03.095450 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896478f-c19e-484d-a36f-21eea381d62a admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:03.096165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896478f-c19e-484d-a36f-21eea381d62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:03.097724 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896478f-c19e-484d-a36f-21eea381d62a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:03.107209 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1235/2477] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:03 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:07:03.111861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896478f-c19e-484d-a36f-21eea381d62a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:03.121467 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896478f-c19e-484d-a36f-21eea381d62a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:03.126085 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18860fe5-0222-4b1e-a387-735ef9ee2d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:03.126917 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18860fe5-0222-4b1e-a387-735ef9ee2d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:03.127198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18860fe5-0222-4b1e-a387-735ef9ee2d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:03.127469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18860fe5-0222-4b1e-a387-735ef9ee2d37 admin admin] PATH_INFO: `/v3/projects/debd6221178c47ebb10f02d54cc8d0b1/users/8a5d1263925e41499130a064ba576707/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:03.128161 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e0eec-eb34-4d84-93fe-efde7d79d83c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:03.129783 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e0eec-eb34-4d84-93fe-efde7d79d83c service swift] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:03.137821 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1243/2478] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Dec 15 03:07:02 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 03:07:03.141642 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18860fe5-0222-4b1e-a387-735ef9ee2d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=debd6221178c47ebb10f02d54cc8d0b1, user_id=8a5d1263925e41499130a064ba576707, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:03.144280 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18860fe5-0222-4b1e-a387-735ef9ee2d37 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:03.158695 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1236/2479] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:03 2021] PUT /identity/v3/projects/debd6221178c47ebb10f02d54cc8d0b1/users/8a5d1263925e41499130a064ba576707/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:07:03.162545 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e0eec-eb34-4d84-93fe-efde7d79d83c service swift] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:03.175608 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e0eec-eb34-4d84-93fe-efde7d79d83c service swift] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:03.243121 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c5e39-1677-4dd4-b513-107fe7db6390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:03.244240 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c5e39-1677-4dd4-b513-107fe7db6390 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:03.244682 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c5e39-1677-4dd4-b513-107fe7db6390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:03.245232 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c5e39-1677-4dd4-b513-107fe7db6390 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:03.246373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c5e39-1677-4dd4-b513-107fe7db6390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:03.248291 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c5e39-1677-4dd4-b513-107fe7db6390 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:03.269338 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18860fe5-0222-4b1e-a387-735ef9ee2d37 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:03.280228 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1244/2480] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:03 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:03.285242 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18860fe5-0222-4b1e-a387-735ef9ee2d37 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:03.291832 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbffc59-f522-43db-858b-6a52d126f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:03.293158 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbffc59-f522-43db-858b-6a52d126f5a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:03.293576 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbffc59-f522-43db-858b-6a52d126f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:03.294106 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbffc59-f522-43db-858b-6a52d126f5a7 admin admin] PATH_INFO: `/v3/projects/debd6221178c47ebb10f02d54cc8d0b1/users/8a5d1263925e41499130a064ba576707/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:03.297000 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbffc59-f522-43db-858b-6a52d126f5a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=debd6221178c47ebb10f02d54cc8d0b1, user_id=8a5d1263925e41499130a064ba576707, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:03.301623 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbffc59-f522-43db-858b-6a52d126f5a7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:03.317363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1237/2481] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:03 2021] PUT /identity/v3/projects/debd6221178c47ebb10f02d54cc8d0b1/users/8a5d1263925e41499130a064ba576707/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:03.330848 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82969-beec-4439-bceb-d5127e704ebf None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:03.331270 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82969-beec-4439-bceb-d5127e704ebf None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:03.331681 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82969-beec-4439-bceb-d5127e704ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:03.389025 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-45a82969-beec-4439-bceb-d5127e704ebf None None] MFA Rules not processed for user `8a5d1263925e41499130a064ba576707`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:03.391504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-45a82969-beec-4439-bceb-d5127e704ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:03.494678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1245/2482] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:03 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:03.504597 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbffc59-f522-43db-858b-6a52d126f5a7 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:03.506341 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-5dbffc59-f522-43db-858b-6a52d126f5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:03.625758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbffc59-f522-43db-858b-6a52d126f5a7 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:03.638809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce1b0b-7fd6-4c8b-b78e-2004e759f8cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:03.639478 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce1b0b-7fd6-4c8b-b78e-2004e759f8cd service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:03.639756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce1b0b-7fd6-4c8b-b78e-2004e759f8cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:03.640028 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce1b0b-7fd6-4c8b-b78e-2004e759f8cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:03.652671 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce1b0b-7fd6-4c8b-b78e-2004e759f8cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:03.655399 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce1b0b-7fd6-4c8b-b78e-2004e759f8cd service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:03.686336 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1238/2483] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:03 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:07:03.841049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a82969-beec-4439-bceb-d5127e704ebf None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:03.922229 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a82969-beec-4439-bceb-d5127e704ebf None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:03.927119 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea0234-607b-431c-abac-4b09e5d3bbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:03.928008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea0234-607b-431c-abac-4b09e5d3bbce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:03.928286 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea0234-607b-431c-abac-4b09e5d3bbce admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:03.928573 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea0234-607b-431c-abac-4b09e5d3bbce admin admin] PATH_INFO: `/v3/users/60e23a3b0da6435badb6598fb3580278` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:03.929807 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea0234-607b-431c-abac-4b09e5d3bbce admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e23a3b0da6435badb6598fb3580278)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:03.931798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea0234-607b-431c-abac-4b09e5d3bbce admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:03.983583 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6aea0234-607b-431c-abac-4b09e5d3bbce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e23a3b0da6435badb6598fb3580278'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:03.998812 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6aea0234-607b-431c-abac-4b09e5d3bbce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e23a3b0da6435badb6598fb3580278'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:04.019046 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6aea0234-607b-431c-abac-4b09e5d3bbce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e23a3b0da6435badb6598fb3580278'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:04.019773 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6aea0234-607b-431c-abac-4b09e5d3bbce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e23a3b0da6435badb6598fb3580278'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:04.020445 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6aea0234-607b-431c-abac-4b09e5d3bbce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e23a3b0da6435badb6598fb3580278'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:04.036651 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1246/2484] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:07:03 2021] DELETE /identity/v3/users/60e23a3b0da6435badb6598fb3580278 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:04.041261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22a98c-a82c-40d9-9baa-3a43df001065 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:04.041553 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22a98c-a82c-40d9-9baa-3a43df001065 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:04.041831 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22a98c-a82c-40d9-9baa-3a43df001065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:04.077672 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-fd22a98c-a82c-40d9-9baa-3a43df001065 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:04.080042 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-fd22a98c-a82c-40d9-9baa-3a43df001065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:04.153318 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1239/2485] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:04.163184 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea0234-607b-431c-abac-4b09e5d3bbce admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:04.164591 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6aea0234-607b-431c-abac-4b09e5d3bbce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:04.231205 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea0234-607b-431c-abac-4b09e5d3bbce admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:04.235616 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926530e-7595-4952-be23-05621fbb4f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:04.236480 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926530e-7595-4952-be23-05621fbb4f84 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:04.236928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926530e-7595-4952-be23-05621fbb4f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:04.237477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926530e-7595-4952-be23-05621fbb4f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:04.249177 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926530e-7595-4952-be23-05621fbb4f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:04.251484 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926530e-7595-4952-be23-05621fbb4f84 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:04.261889 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1247/2486] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:07:04.560798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22a98c-a82c-40d9-9baa-3a43df001065 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:04.562355 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-fd22a98c-a82c-40d9-9baa-3a43df001065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:04.588264 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22a98c-a82c-40d9-9baa-3a43df001065 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:04.595851 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:04.597064 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:04.597561 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:04.598095 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71 admin admin] PATH_INFO: `/v3/projects/3592d462032342d2abcb732ebcf75a2e` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:04.599581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3592d462032342d2abcb732ebcf75a2e)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:04.602956 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:04.706029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3592d462032342d2abcb732ebcf75a2e', 'request_id': 'req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:04.713965 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3592d462032342d2abcb732ebcf75a2e', 'request_id': 'req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:04.720920 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3592d462032342d2abcb732ebcf75a2e', 'request_id': 'req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:04.731215 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71 admin admin] The token cache is being invalidate because project 3592d462032342d2abcb732ebcf75a2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:07:04.731596 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:04.735329 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:04.737684 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1240/2487] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:07:04 2021] DELETE /identity/v3/projects/3592d462032342d2abcb732ebcf75a2e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:04.741661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926530e-7595-4952-be23-05621fbb4f84 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:04.766975 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926530e-7595-4952-be23-05621fbb4f84 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:04.842492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14b2cf-6cbd-4477-9468-a469109ebfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:04.843629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14b2cf-6cbd-4477-9468-a469109ebfbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:04.844739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14b2cf-6cbd-4477-9468-a469109ebfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:04.845187 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14b2cf-6cbd-4477-9468-a469109ebfbd admin admin] PATH_INFO: `/v3/users/8a5d1263925e41499130a064ba576707` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:04.850807 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14b2cf-6cbd-4477-9468-a469109ebfbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5d1263925e41499130a064ba576707)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:04.852758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14b2cf-6cbd-4477-9468-a469109ebfbd admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:04.908589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ec14b2cf-6cbd-4477-9468-a469109ebfbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5d1263925e41499130a064ba576707'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:04.921635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ec14b2cf-6cbd-4477-9468-a469109ebfbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5d1263925e41499130a064ba576707'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:04.936585 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ec14b2cf-6cbd-4477-9468-a469109ebfbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5d1263925e41499130a064ba576707'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:04.937286 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ec14b2cf-6cbd-4477-9468-a469109ebfbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5d1263925e41499130a064ba576707'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:04.938143 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ec14b2cf-6cbd-4477-9468-a469109ebfbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5d1263925e41499130a064ba576707'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:04.965144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1248/2488] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:07:04 2021] DELETE /identity/v3/users/8a5d1263925e41499130a064ba576707 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:07:05.290626 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:05.292119 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:05.305712 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7c0a6-34a2-4da6-863d-8e5edcef1e71 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:05.379920 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1d7d7-e481-4d68-9380-4bfd91e97842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:05.380827 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1d7d7-e481-4d68-9380-4bfd91e97842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:05.381097 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1d7d7-e481-4d68-9380-4bfd91e97842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:05.381376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1d7d7-e481-4d68-9380-4bfd91e97842 admin admin] PATH_INFO: `/v3/projects/debd6221178c47ebb10f02d54cc8d0b1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:05.382706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1d7d7-e481-4d68-9380-4bfd91e97842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=debd6221178c47ebb10f02d54cc8d0b1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:05.384725 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1d7d7-e481-4d68-9380-4bfd91e97842 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:05.434417 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-dcd1d7d7-e481-4d68-9380-4bfd91e97842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'debd6221178c47ebb10f02d54cc8d0b1', 'request_id': 'req-dcd1d7d7-e481-4d68-9380-4bfd91e97842'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:05.441877 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-dcd1d7d7-e481-4d68-9380-4bfd91e97842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'debd6221178c47ebb10f02d54cc8d0b1', 'request_id': 'req-dcd1d7d7-e481-4d68-9380-4bfd91e97842'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:05.447963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-dcd1d7d7-e481-4d68-9380-4bfd91e97842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'debd6221178c47ebb10f02d54cc8d0b1', 'request_id': 'req-dcd1d7d7-e481-4d68-9380-4bfd91e97842'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:05.458876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-dcd1d7d7-e481-4d68-9380-4bfd91e97842 admin admin] The token cache is being invalidate because project debd6221178c47ebb10f02d54cc8d0b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:07:05.459406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-dcd1d7d7-e481-4d68-9380-4bfd91e97842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:05.460211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-dcd1d7d7-e481-4d68-9380-4bfd91e97842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:05.462331 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1241/2489] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:07:05 2021] DELETE /identity/v3/projects/debd6221178c47ebb10f02d54cc8d0b1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:05.468182 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aab3d6-5fe5-4f97-b7e5-a8d526070ac5 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:05.468451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aab3d6-5fe5-4f97-b7e5-a8d526070ac5 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:05.468733 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aab3d6-5fe5-4f97-b7e5-a8d526070ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:05.500724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-76aab3d6-5fe5-4f97-b7e5-a8d526070ac5 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:05.502067 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-76aab3d6-5fe5-4f97-b7e5-a8d526070ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:05.560390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1249/2490] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:05.570159 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce090b74-9488-4ee0-bb4a-9721847c1c23 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:05.570727 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce090b74-9488-4ee0-bb4a-9721847c1c23 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:05.570727 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce090b74-9488-4ee0-bb4a-9721847c1c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:05.590701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-ce090b74-9488-4ee0-bb4a-9721847c1c23 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:05.591894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-ce090b74-9488-4ee0-bb4a-9721847c1c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:05.599792 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1242/2491] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:05.604102 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aab3d6-5fe5-4f97-b7e5-a8d526070ac5 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:05.613661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aab3d6-5fe5-4f97-b7e5-a8d526070ac5 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:05.618612 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf57ccf-9794-4cca-bf92-86799b0a2756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:05.620014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57ccf-9794-4cca-bf92-86799b0a2756 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:05.620296 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57ccf-9794-4cca-bf92-86799b0a2756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:05.620756 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57ccf-9794-4cca-bf92-86799b0a2756 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:05.621682 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf57ccf-9794-4cca-bf92-86799b0a2756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:07:05.622154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf57ccf-9794-4cca-bf92-86799b0a2756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:05.624109 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf57ccf-9794-4cca-bf92-86799b0a2756 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:05.637635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1250/2492] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:07:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:07:05.642304 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce090b74-9488-4ee0-bb4a-9721847c1c23 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:05.652225 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce090b74-9488-4ee0-bb4a-9721847c1c23 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:05.658308 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a599d-facc-405a-a337-3b2c83060443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:05.658963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a599d-facc-405a-a337-3b2c83060443 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:05.659242 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a599d-facc-405a-a337-3b2c83060443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:05.659515 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a599d-facc-405a-a337-3b2c83060443 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:05.660235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a599d-facc-405a-a337-3b2c83060443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:05.662174 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a599d-facc-405a-a337-3b2c83060443 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:05.696351 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1243/2493] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:07:05 2021] POST /identity/v3/projects => generated 409 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:07:05.700474 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf57ccf-9794-4cca-bf92-86799b0a2756 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:05.710959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf57ccf-9794-4cca-bf92-86799b0a2756 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:05.784043 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf0ecb-c51d-4903-abd5-dbc9e1d89488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:05.784812 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf0ecb-c51d-4903-abd5-dbc9e1d89488 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:05.785159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf0ecb-c51d-4903-abd5-dbc9e1d89488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:05.785501 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf0ecb-c51d-4903-abd5-dbc9e1d89488 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:05.786298 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf0ecb-c51d-4903-abd5-dbc9e1d89488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:05.788253 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf0ecb-c51d-4903-abd5-dbc9e1d89488 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:05.810107 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1251/2494] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:07:05 2021] POST /identity/v3/users => generated 305 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:07:05.815341 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a599d-facc-405a-a337-3b2c83060443 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:05.829688 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a599d-facc-405a-a337-3b2c83060443 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:05.834590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768a88d-9a93-476a-bafa-5b79815149bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:05.835256 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768a88d-9a93-476a-bafa-5b79815149bb admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:05.835531 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768a88d-9a93-476a-bafa-5b79815149bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:05.835809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768a88d-9a93-476a-bafa-5b79815149bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:05.836545 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768a88d-9a93-476a-bafa-5b79815149bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:05.838259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768a88d-9a93-476a-bafa-5b79815149bb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:05.850030 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1244/2495] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:05 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:05.854884 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf0ecb-c51d-4903-abd5-dbc9e1d89488 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:05.885800 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf0ecb-c51d-4903-abd5-dbc9e1d89488 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:05.891602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e6db4-dcc1-4327-9ec2-e85f4fca7108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:05.892299 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e6db4-dcc1-4327-9ec2-e85f4fca7108 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:05.892637 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e6db4-dcc1-4327-9ec2-e85f4fca7108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:05.893056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e6db4-dcc1-4327-9ec2-e85f4fca7108 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:05.893829 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e6db4-dcc1-4327-9ec2-e85f4fca7108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:05.895485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e6db4-dcc1-4327-9ec2-e85f4fca7108 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:05.907192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1252/2496] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:05 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:05.910947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768a88d-9a93-476a-bafa-5b79815149bb admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:05.934112 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768a88d-9a93-476a-bafa-5b79815149bb admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:05.940066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0408700-9380-4075-a2e5-f27829757884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:05.941388 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0408700-9380-4075-a2e5-f27829757884 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:05.941876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0408700-9380-4075-a2e5-f27829757884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:05.942390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0408700-9380-4075-a2e5-f27829757884 admin admin] PATH_INFO: `/v3/projects/61021fcdf80e49c69f484ac93946c365/users/9e41523706c14defaaed8ca73bd228dc/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:05.963520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0408700-9380-4075-a2e5-f27829757884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61021fcdf80e49c69f484ac93946c365, user_id=9e41523706c14defaaed8ca73bd228dc, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:05.966663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0408700-9380-4075-a2e5-f27829757884 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:05.985675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1245/2497] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:05 2021] PUT /identity/v3/projects/61021fcdf80e49c69f484ac93946c365/users/9e41523706c14defaaed8ca73bd228dc/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:05.997144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb5116-8aac-471a-ac44-87d46e0654b2 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:05.997475 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb5116-8aac-471a-ac44-87d46e0654b2 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:05.997743 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb5116-8aac-471a-ac44-87d46e0654b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:06.032217 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-98bb5116-8aac-471a-ac44-87d46e0654b2 None None] MFA Rules not processed for user `9e41523706c14defaaed8ca73bd228dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:06.033468 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-98bb5116-8aac-471a-ac44-87d46e0654b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:06.109226 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1253/2498] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:05 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:07:06.114471 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0408700-9380-4075-a2e5-f27829757884 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:06.174540 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0408700-9380-4075-a2e5-f27829757884 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:06.179178 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869116c-dcd7-4e9c-8ee4-f1ac570caa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:06.179897 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869116c-dcd7-4e9c-8ee4-f1ac570caa79 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:06.180244 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869116c-dcd7-4e9c-8ee4-f1ac570caa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:06.180579 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869116c-dcd7-4e9c-8ee4-f1ac570caa79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:06.181346 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869116c-dcd7-4e9c-8ee4-f1ac570caa79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:06.183358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869116c-dcd7-4e9c-8ee4-f1ac570caa79 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:06.213066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1246/2499] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:07:06 2021] POST /identity/v3/projects => generated 409 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:07:06.214650 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb5116-8aac-471a-ac44-87d46e0654b2 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:06.225644 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb5116-8aac-471a-ac44-87d46e0654b2 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:06.286446 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587293ca-1508-4073-b4f3-3f86a5f90835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:06.287126 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587293ca-1508-4073-b4f3-3f86a5f90835 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:06.287405 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587293ca-1508-4073-b4f3-3f86a5f90835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:06.287674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587293ca-1508-4073-b4f3-3f86a5f90835 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:06.288370 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587293ca-1508-4073-b4f3-3f86a5f90835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:06.290307 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587293ca-1508-4073-b4f3-3f86a5f90835 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:06.312746 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1254/2500] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:07:06 2021] POST /identity/v3/users => generated 311 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:07:06.316801 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869116c-dcd7-4e9c-8ee4-f1ac570caa79 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:06.327289 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869116c-dcd7-4e9c-8ee4-f1ac570caa79 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:06.333905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8e15e-9aa9-4bd6-a294-9d954a9e4d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:06.334694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8e15e-9aa9-4bd6-a294-9d954a9e4d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:06.335125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8e15e-9aa9-4bd6-a294-9d954a9e4d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:06.335433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8e15e-9aa9-4bd6-a294-9d954a9e4d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:06.336196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8e15e-9aa9-4bd6-a294-9d954a9e4d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:06.337798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8e15e-9aa9-4bd6-a294-9d954a9e4d24 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:06.350941 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1247/2501] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:06 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:06.356033 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587293ca-1508-4073-b4f3-3f86a5f90835 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:06.368185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587293ca-1508-4073-b4f3-3f86a5f90835 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:06.373304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2fccb-3360-4c30-a9fa-43f878139149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:06.374236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2fccb-3360-4c30-a9fa-43f878139149 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:06.374520 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2fccb-3360-4c30-a9fa-43f878139149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:06.374797 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2fccb-3360-4c30-a9fa-43f878139149 admin admin] PATH_INFO: `/v3/projects/1e45468594294f8b9629f71c1338ff25/users/cf53c13cf7184bae81f2f2c38bd126b7/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:06.389542 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2fccb-3360-4c30-a9fa-43f878139149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e45468594294f8b9629f71c1338ff25, user_id=cf53c13cf7184bae81f2f2c38bd126b7, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:06.392230 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2fccb-3360-4c30-a9fa-43f878139149 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:06.407131 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1255/2502] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:06 2021] PUT /identity/v3/projects/1e45468594294f8b9629f71c1338ff25/users/cf53c13cf7184bae81f2f2c38bd126b7/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:06.411325 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8e15e-9aa9-4bd6-a294-9d954a9e4d24 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:06.423047 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8e15e-9aa9-4bd6-a294-9d954a9e4d24 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:06.482691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fd069-944c-487e-883d-2c94a90bfe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:06.483537 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fd069-944c-487e-883d-2c94a90bfe00 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:06.483792 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fd069-944c-487e-883d-2c94a90bfe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:06.484087 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fd069-944c-487e-883d-2c94a90bfe00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:06.484882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8fd069-944c-487e-883d-2c94a90bfe00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:06.486573 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8fd069-944c-487e-883d-2c94a90bfe00 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:06.497718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1248/2503] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:06 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:07:06.501495 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2fccb-3360-4c30-a9fa-43f878139149 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:06.512856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2fccb-3360-4c30-a9fa-43f878139149 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:06.518180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21259f0f-befa-4923-90c2-f9293922f894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:06.519070 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259f0f-befa-4923-90c2-f9293922f894 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:06.519363 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259f0f-befa-4923-90c2-f9293922f894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:06.519766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259f0f-befa-4923-90c2-f9293922f894 admin admin] PATH_INFO: `/v3/projects/1e45468594294f8b9629f71c1338ff25/users/cf53c13cf7184bae81f2f2c38bd126b7/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:06.521806 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21259f0f-befa-4923-90c2-f9293922f894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e45468594294f8b9629f71c1338ff25, user_id=cf53c13cf7184bae81f2f2c38bd126b7, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:06.524437 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21259f0f-befa-4923-90c2-f9293922f894 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:06.535979 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1256/2504] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:06 2021] PUT /identity/v3/projects/1e45468594294f8b9629f71c1338ff25/users/cf53c13cf7184bae81f2f2c38bd126b7/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:07:06.547096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06a446-95aa-4abb-a32f-a0db0d7609a6 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:06.547454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06a446-95aa-4abb-a32f-a0db0d7609a6 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:06.547739 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06a446-95aa-4abb-a32f-a0db0d7609a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:06.575211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-7f06a446-95aa-4abb-a32f-a0db0d7609a6 None None] MFA Rules not processed for user `cf53c13cf7184bae81f2f2c38bd126b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:06.577101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-7f06a446-95aa-4abb-a32f-a0db0d7609a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:06.645727 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1249/2505] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:06 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:06.657080 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21259f0f-befa-4923-90c2-f9293922f894 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:06.659213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-21259f0f-befa-4923-90c2-f9293922f894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:06.715900 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21259f0f-befa-4923-90c2-f9293922f894 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:06.720298 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63ef79-01d7-4743-b069-e8102b2ded68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:06.720936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63ef79-01d7-4743-b069-e8102b2ded68 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:06.721220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63ef79-01d7-4743-b069-e8102b2ded68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:06.721498 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63ef79-01d7-4743-b069-e8102b2ded68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:06.731241 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63ef79-01d7-4743-b069-e8102b2ded68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:06.732857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63ef79-01d7-4743-b069-e8102b2ded68 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:06.742852 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1257/2506] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:06 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:07:06.924876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06a446-95aa-4abb-a32f-a0db0d7609a6 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:06.944064 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06a446-95aa-4abb-a32f-a0db0d7609a6 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:06.947882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688652f-ce82-4ca9-8d52-f5252a5874ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:06.948666 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688652f-ce82-4ca9-8d52-f5252a5874ce service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:06.949021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688652f-ce82-4ca9-8d52-f5252a5874ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:06.949384 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688652f-ce82-4ca9-8d52-f5252a5874ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:07.009043 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688652f-ce82-4ca9-8d52-f5252a5874ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:07.010777 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688652f-ce82-4ca9-8d52-f5252a5874ce service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:07.023173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1250/2507] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:06 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:07:15.415674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63ef79-01d7-4743-b069-e8102b2ded68 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:15.481298 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63ef79-01d7-4743-b069-e8102b2ded68 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:15.485798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238f7bb-b863-4860-a7df-fc90063b7296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:15.486683 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238f7bb-b863-4860-a7df-fc90063b7296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:15.486964 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238f7bb-b863-4860-a7df-fc90063b7296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:15.487235 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238f7bb-b863-4860-a7df-fc90063b7296 admin admin] PATH_INFO: `/v3/users/9e41523706c14defaaed8ca73bd228dc` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:15.488405 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238f7bb-b863-4860-a7df-fc90063b7296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e41523706c14defaaed8ca73bd228dc)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:15.490728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238f7bb-b863-4860-a7df-fc90063b7296 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:15.537865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e238f7bb-b863-4860-a7df-fc90063b7296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e41523706c14defaaed8ca73bd228dc'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:15.549333 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e238f7bb-b863-4860-a7df-fc90063b7296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e41523706c14defaaed8ca73bd228dc'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:15.557247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e238f7bb-b863-4860-a7df-fc90063b7296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e41523706c14defaaed8ca73bd228dc'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:15.557856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e238f7bb-b863-4860-a7df-fc90063b7296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e41523706c14defaaed8ca73bd228dc'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:15.558473 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e238f7bb-b863-4860-a7df-fc90063b7296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e41523706c14defaaed8ca73bd228dc'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:15.570662 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1258/2508] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:07:15 2021] DELETE /identity/v3/users/9e41523706c14defaaed8ca73bd228dc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:15.575148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c847e-3323-4254-a53c-bdc8e8c1da96 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:15.575680 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c847e-3323-4254-a53c-bdc8e8c1da96 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:15.575812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c847e-3323-4254-a53c-bdc8e8c1da96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:15.593273 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-f24c847e-3323-4254-a53c-bdc8e8c1da96 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:15.595253 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f24c847e-3323-4254-a53c-bdc8e8c1da96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:15.650655 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1251/2509] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:15.660962 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238f7bb-b863-4860-a7df-fc90063b7296 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:15.662363 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e238f7bb-b863-4860-a7df-fc90063b7296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:15.716135 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238f7bb-b863-4860-a7df-fc90063b7296 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:15.720351 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae706a3-cbf8-431c-9cb9-1b15e4ee329e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:15.720979 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae706a3-cbf8-431c-9cb9-1b15e4ee329e service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:15.721258 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae706a3-cbf8-431c-9cb9-1b15e4ee329e service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:15.721531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae706a3-cbf8-431c-9cb9-1b15e4ee329e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:15.730480 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae706a3-cbf8-431c-9cb9-1b15e4ee329e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:15.731897 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae706a3-cbf8-431c-9cb9-1b15e4ee329e service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:15.740973 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1259/2510] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:07:15.991187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c847e-3323-4254-a53c-bdc8e8c1da96 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:15.992601 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f24c847e-3323-4254-a53c-bdc8e8c1da96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:16.005227 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c847e-3323-4254-a53c-bdc8e8c1da96 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:16.009835 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97180ca8-cf88-492c-957e-67a2d767b0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:16.010743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97180ca8-cf88-492c-957e-67a2d767b0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:16.011021 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97180ca8-cf88-492c-957e-67a2d767b0de admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:16.011294 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97180ca8-cf88-492c-957e-67a2d767b0de admin admin] PATH_INFO: `/v3/projects/61021fcdf80e49c69f484ac93946c365` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:16.012484 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97180ca8-cf88-492c-957e-67a2d767b0de admin admin] RBAC: Authorizing `identity:delete_project(project_id=61021fcdf80e49c69f484ac93946c365)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:16.014410 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97180ca8-cf88-492c-957e-67a2d767b0de admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:16.059047 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97180ca8-cf88-492c-957e-67a2d767b0de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61021fcdf80e49c69f484ac93946c365', 'request_id': 'req-97180ca8-cf88-492c-957e-67a2d767b0de'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:16.066325 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97180ca8-cf88-492c-957e-67a2d767b0de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61021fcdf80e49c69f484ac93946c365', 'request_id': 'req-97180ca8-cf88-492c-957e-67a2d767b0de'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:16.072430 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97180ca8-cf88-492c-957e-67a2d767b0de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61021fcdf80e49c69f484ac93946c365', 'request_id': 'req-97180ca8-cf88-492c-957e-67a2d767b0de'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:16.082929 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97180ca8-cf88-492c-957e-67a2d767b0de admin admin] The token cache is being invalidate because project 61021fcdf80e49c69f484ac93946c365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:07:16.083230 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97180ca8-cf88-492c-957e-67a2d767b0de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:16.083873 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97180ca8-cf88-492c-957e-67a2d767b0de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:16.085386 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1252/2511] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:07:15 2021] DELETE /identity/v3/projects/61021fcdf80e49c69f484ac93946c365 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:07:16.089310 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae706a3-cbf8-431c-9cb9-1b15e4ee329e service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:16.098645 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae706a3-cbf8-431c-9cb9-1b15e4ee329e service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:16.152566 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524dd78-f07d-438f-a619-2dd1dd088749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:16.153356 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524dd78-f07d-438f-a619-2dd1dd088749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:16.153639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524dd78-f07d-438f-a619-2dd1dd088749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:16.153914 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524dd78-f07d-438f-a619-2dd1dd088749 admin admin] PATH_INFO: `/v3/users/cf53c13cf7184bae81f2f2c38bd126b7` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:16.155150 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524dd78-f07d-438f-a619-2dd1dd088749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf53c13cf7184bae81f2f2c38bd126b7)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:16.157041 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524dd78-f07d-438f-a619-2dd1dd088749 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:16.200814 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5524dd78-f07d-438f-a619-2dd1dd088749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf53c13cf7184bae81f2f2c38bd126b7'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:16.213711 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5524dd78-f07d-438f-a619-2dd1dd088749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf53c13cf7184bae81f2f2c38bd126b7'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:16.221490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5524dd78-f07d-438f-a619-2dd1dd088749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf53c13cf7184bae81f2f2c38bd126b7'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:16.222160 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5524dd78-f07d-438f-a619-2dd1dd088749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf53c13cf7184bae81f2f2c38bd126b7'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:16.222757 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5524dd78-f07d-438f-a619-2dd1dd088749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf53c13cf7184bae81f2f2c38bd126b7'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:16.234952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1260/2512] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:07:16 2021] DELETE /identity/v3/users/cf53c13cf7184bae81f2f2c38bd126b7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:07:16.493638 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97180ca8-cf88-492c-957e-67a2d767b0de admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:16.495682 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-97180ca8-cf88-492c-957e-67a2d767b0de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:16.510740 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97180ca8-cf88-492c-957e-67a2d767b0de admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:16.566057 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1ce09-2535-4f79-b2bd-a6e5cd707265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:16.566899 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1ce09-2535-4f79-b2bd-a6e5cd707265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:16.567176 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1ce09-2535-4f79-b2bd-a6e5cd707265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:16.567447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1ce09-2535-4f79-b2bd-a6e5cd707265 admin admin] PATH_INFO: `/v3/projects/1e45468594294f8b9629f71c1338ff25` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:16.568628 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1ce09-2535-4f79-b2bd-a6e5cd707265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e45468594294f8b9629f71c1338ff25)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:16.570579 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1ce09-2535-4f79-b2bd-a6e5cd707265 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:16.621915 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-41c1ce09-2535-4f79-b2bd-a6e5cd707265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e45468594294f8b9629f71c1338ff25', 'request_id': 'req-41c1ce09-2535-4f79-b2bd-a6e5cd707265'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:16.630316 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-41c1ce09-2535-4f79-b2bd-a6e5cd707265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e45468594294f8b9629f71c1338ff25', 'request_id': 'req-41c1ce09-2535-4f79-b2bd-a6e5cd707265'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:16.637082 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-41c1ce09-2535-4f79-b2bd-a6e5cd707265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e45468594294f8b9629f71c1338ff25', 'request_id': 'req-41c1ce09-2535-4f79-b2bd-a6e5cd707265'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:16.650093 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-41c1ce09-2535-4f79-b2bd-a6e5cd707265 admin admin] The token cache is being invalidate because project 1e45468594294f8b9629f71c1338ff25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:07:16.650370 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-41c1ce09-2535-4f79-b2bd-a6e5cd707265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:16.651328 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-41c1ce09-2535-4f79-b2bd-a6e5cd707265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:16.653074 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1253/2513] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:07:16 2021] DELETE /identity/v3/projects/1e45468594294f8b9629f71c1338ff25 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:16.659172 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943348f-e34f-400c-a6f5-f300217227d9 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:16.659678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943348f-e34f-400c-a6f5-f300217227d9 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:16.659678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943348f-e34f-400c-a6f5-f300217227d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:16.680485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a943348f-e34f-400c-a6f5-f300217227d9 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:16.681789 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a943348f-e34f-400c-a6f5-f300217227d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:16.741675 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1261/2514] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:07:16.750118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79d8d-046c-4e56-b826-85314849be8c None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:16.750406 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79d8d-046c-4e56-b826-85314849be8c None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:16.751003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79d8d-046c-4e56-b826-85314849be8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:16.769324 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-87f79d8d-046c-4e56-b826-85314849be8c None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:16.770617 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-87f79d8d-046c-4e56-b826-85314849be8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:16.778800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1254/2515] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:16.783386 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943348f-e34f-400c-a6f5-f300217227d9 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:16.793072 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943348f-e34f-400c-a6f5-f300217227d9 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:16.798693 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d3e96-f9c5-465f-8a85-33dddd5d25dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:16.799342 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d3e96-f9c5-465f-8a85-33dddd5d25dc admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:16.799624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d3e96-f9c5-465f-8a85-33dddd5d25dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:16.799900 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d3e96-f9c5-465f-8a85-33dddd5d25dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:16.800634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d3e96-f9c5-465f-8a85-33dddd5d25dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:07:16.800941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d3e96-f9c5-465f-8a85-33dddd5d25dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:16.802561 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d3e96-f9c5-465f-8a85-33dddd5d25dc admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:16.813968 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1262/2516] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:07:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:07:16.818301 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f79d8d-046c-4e56-b826-85314849be8c None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:16.828679 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f79d8d-046c-4e56-b826-85314849be8c None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:16.833608 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13017215-a110-4557-b40d-f3f0cd3d5ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:16.834521 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13017215-a110-4557-b40d-f3f0cd3d5ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:16.835078 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13017215-a110-4557-b40d-f3f0cd3d5ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:16.835510 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13017215-a110-4557-b40d-f3f0cd3d5ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:16.836666 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13017215-a110-4557-b40d-f3f0cd3d5ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:16.839356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13017215-a110-4557-b40d-f3f0cd3d5ae7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:16.866074 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1255/2517] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:07:16 2021] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:07:16.870470 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d3e96-f9c5-465f-8a85-33dddd5d25dc admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:16.880473 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d3e96-f9c5-465f-8a85-33dddd5d25dc admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:16.934040 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e48fd2-12f5-4af1-b7bc-efed35dbf0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:16.934748 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e48fd2-12f5-4af1-b7bc-efed35dbf0cb admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:16.935031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e48fd2-12f5-4af1-b7bc-efed35dbf0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:16.935327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e48fd2-12f5-4af1-b7bc-efed35dbf0cb admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:16.936025 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e48fd2-12f5-4af1-b7bc-efed35dbf0cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:16.937941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e48fd2-12f5-4af1-b7bc-efed35dbf0cb admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:16.957498 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1263/2518] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:07:16 2021] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:07:16.961824 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13017215-a110-4557-b40d-f3f0cd3d5ae7 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:16.972562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13017215-a110-4557-b40d-f3f0cd3d5ae7 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:16.977362 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829800d-7b72-45de-9394-7d1d95502aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:16.978042 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829800d-7b72-45de-9394-7d1d95502aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:16.978330 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829800d-7b72-45de-9394-7d1d95502aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:16.978607 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829800d-7b72-45de-9394-7d1d95502aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:16.979341 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829800d-7b72-45de-9394-7d1d95502aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:16.980933 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829800d-7b72-45de-9394-7d1d95502aa2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:16.992547 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1256/2519] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:16 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:16.996768 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e48fd2-12f5-4af1-b7bc-efed35dbf0cb admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:17.006442 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e48fd2-12f5-4af1-b7bc-efed35dbf0cb admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:17.011020 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74bf9e-6346-4e4c-b5d3-dec80f3e12f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:17.011666 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74bf9e-6346-4e4c-b5d3-dec80f3e12f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:17.011951 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74bf9e-6346-4e4c-b5d3-dec80f3e12f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:17.012231 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74bf9e-6346-4e4c-b5d3-dec80f3e12f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:17.012959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74bf9e-6346-4e4c-b5d3-dec80f3e12f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:17.014576 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74bf9e-6346-4e4c-b5d3-dec80f3e12f2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:17.025048 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1264/2520] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:16 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:17.028924 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829800d-7b72-45de-9394-7d1d95502aa2 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:17.039032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829800d-7b72-45de-9394-7d1d95502aa2 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:17.043536 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b88f7-d702-446f-b55c-20ad5b8e1ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:17.044390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b88f7-d702-446f-b55c-20ad5b8e1ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:17.044675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b88f7-d702-446f-b55c-20ad5b8e1ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:17.044952 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b88f7-d702-446f-b55c-20ad5b8e1ffb admin admin] PATH_INFO: `/v3/projects/9f126442ce364b10a058ba122aa4c67a/users/6fc370c670184041965ad0ca7c308c8c/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:17.059309 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b88f7-d702-446f-b55c-20ad5b8e1ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f126442ce364b10a058ba122aa4c67a, user_id=6fc370c670184041965ad0ca7c308c8c, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:17.062128 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b88f7-d702-446f-b55c-20ad5b8e1ffb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:17.075298 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1257/2521] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:17 2021] PUT /identity/v3/projects/9f126442ce364b10a058ba122aa4c67a/users/6fc370c670184041965ad0ca7c308c8c/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:17.085762 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8567f58-6111-49d3-a24d-9a8f1b6d39c7 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:17.086193 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8567f58-6111-49d3-a24d-9a8f1b6d39c7 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:17.086477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8567f58-6111-49d3-a24d-9a8f1b6d39c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:17.112830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-b8567f58-6111-49d3-a24d-9a8f1b6d39c7 None None] MFA Rules not processed for user `6fc370c670184041965ad0ca7c308c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:17.114040 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b8567f58-6111-49d3-a24d-9a8f1b6d39c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:17.176899 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1265/2522] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:17 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:17.181340 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b88f7-d702-446f-b55c-20ad5b8e1ffb admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:17.241742 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b88f7-d702-446f-b55c-20ad5b8e1ffb admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:17.246719 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbe474-4a82-412b-8cea-c397a545f945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:17.247368 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe474-4a82-412b-8cea-c397a545f945 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:17.247661 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe474-4a82-412b-8cea-c397a545f945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:17.247937 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe474-4a82-412b-8cea-c397a545f945 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:17.248634 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbe474-4a82-412b-8cea-c397a545f945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:17.251298 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbe474-4a82-412b-8cea-c397a545f945 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:17.275534 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1258/2523] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:07:17 2021] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:07:17.279524 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8567f58-6111-49d3-a24d-9a8f1b6d39c7 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:17.290441 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8567f58-6111-49d3-a24d-9a8f1b6d39c7 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:17.344057 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0dde3-556b-4594-8b8c-8840ed5f77a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:17.344707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0dde3-556b-4594-8b8c-8840ed5f77a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:17.344991 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0dde3-556b-4594-8b8c-8840ed5f77a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:17.345269 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0dde3-556b-4594-8b8c-8840ed5f77a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:17.345994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0dde3-556b-4594-8b8c-8840ed5f77a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:17.347903 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0dde3-556b-4594-8b8c-8840ed5f77a1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:17.371353 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1266/2524] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:07:17 2021] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:07:17.372826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbe474-4a82-412b-8cea-c397a545f945 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:17.383155 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbe474-4a82-412b-8cea-c397a545f945 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:17.387953 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723c2f7-fea4-432c-b5ad-b119a95ebd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:17.388638 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723c2f7-fea4-432c-b5ad-b119a95ebd8e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:17.388924 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723c2f7-fea4-432c-b5ad-b119a95ebd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:17.389223 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723c2f7-fea4-432c-b5ad-b119a95ebd8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:17.389958 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723c2f7-fea4-432c-b5ad-b119a95ebd8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:17.391679 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723c2f7-fea4-432c-b5ad-b119a95ebd8e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:17.402131 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1259/2525] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:17.406577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0dde3-556b-4594-8b8c-8840ed5f77a1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:17.416137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0dde3-556b-4594-8b8c-8840ed5f77a1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:17.420724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb15c70-0b30-4f4f-b120-3c97b64c3f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:17.421371 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb15c70-0b30-4f4f-b120-3c97b64c3f9d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:17.422310 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb15c70-0b30-4f4f-b120-3c97b64c3f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:17.422603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb15c70-0b30-4f4f-b120-3c97b64c3f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:17.423338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb15c70-0b30-4f4f-b120-3c97b64c3f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:17.424970 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb15c70-0b30-4f4f-b120-3c97b64c3f9d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:17.434617 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1267/2526] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:17 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:17.438583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723c2f7-fea4-432c-b5ad-b119a95ebd8e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:17.448261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723c2f7-fea4-432c-b5ad-b119a95ebd8e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:17.452845 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d9284-83d3-4a20-ac64-eb25b4534cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:17.453699 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d9284-83d3-4a20-ac64-eb25b4534cfb admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:17.454008 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d9284-83d3-4a20-ac64-eb25b4534cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:17.454289 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d9284-83d3-4a20-ac64-eb25b4534cfb admin admin] PATH_INFO: `/v3/projects/fa8e7eaaa12a49429ba4bec8c63fa832/users/5d2fa1994d6a481c86e17aa6fdaff3a1/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:17.469994 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d9284-83d3-4a20-ac64-eb25b4534cfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8e7eaaa12a49429ba4bec8c63fa832, user_id=5d2fa1994d6a481c86e17aa6fdaff3a1, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:17.472617 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d9284-83d3-4a20-ac64-eb25b4534cfb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:17.485731 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1260/2527] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:17 2021] PUT /identity/v3/projects/fa8e7eaaa12a49429ba4bec8c63fa832/users/5d2fa1994d6a481c86e17aa6fdaff3a1/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:17.496924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7aab6-1732-4df6-a770-4aa62710a453 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:17.497210 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7aab6-1732-4df6-a770-4aa62710a453 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:17.497485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7aab6-1732-4df6-a770-4aa62710a453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:17.522381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-42d7aab6-1732-4df6-a770-4aa62710a453 None None] MFA Rules not processed for user `5d2fa1994d6a481c86e17aa6fdaff3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:17.523547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-42d7aab6-1732-4df6-a770-4aa62710a453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:17.584359 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1268/2528] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:17 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:07:17.588882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d9284-83d3-4a20-ac64-eb25b4534cfb admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:17.648502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d9284-83d3-4a20-ac64-eb25b4534cfb admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:17.653220 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404e801-4beb-4e63-831f-69d936bbdf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:17.653936 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404e801-4beb-4e63-831f-69d936bbdf32 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:17.654247 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404e801-4beb-4e63-831f-69d936bbdf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:17.654526 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404e801-4beb-4e63-831f-69d936bbdf32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:17.655240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404e801-4beb-4e63-831f-69d936bbdf32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:17.657688 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404e801-4beb-4e63-831f-69d936bbdf32 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:17.683785 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1261/2529] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:07:17 2021] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:07:17.688060 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7aab6-1732-4df6-a770-4aa62710a453 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:17.698769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7aab6-1732-4df6-a770-4aa62710a453 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:17.755152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df53a-3444-462c-b18a-a8fc44a5e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:17.755818 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df53a-3444-462c-b18a-a8fc44a5e998 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:17.756098 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df53a-3444-462c-b18a-a8fc44a5e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:17.756374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df53a-3444-462c-b18a-a8fc44a5e998 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:17.757094 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8df53a-3444-462c-b18a-a8fc44a5e998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:17.759037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8df53a-3444-462c-b18a-a8fc44a5e998 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:17.779083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1269/2530] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:07:17 2021] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:07:17.783501 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404e801-4beb-4e63-831f-69d936bbdf32 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:17.794177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404e801-4beb-4e63-831f-69d936bbdf32 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:17.799242 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5dc27-e1f2-43bd-b12d-d4a42453ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:17.799893 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5dc27-e1f2-43bd-b12d-d4a42453ffce admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:17.800176 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5dc27-e1f2-43bd-b12d-d4a42453ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:17.800455 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5dc27-e1f2-43bd-b12d-d4a42453ffce admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:17.801190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5dc27-e1f2-43bd-b12d-d4a42453ffce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:17.802814 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5dc27-e1f2-43bd-b12d-d4a42453ffce admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:17.813191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1262/2531] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:17.817446 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df53a-3444-462c-b18a-a8fc44a5e998 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:17.827322 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df53a-3444-462c-b18a-a8fc44a5e998 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:17.832328 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fea0a-cbb5-4639-9f12-d8afad9ca1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:17.833196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fea0a-cbb5-4639-9f12-d8afad9ca1a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:17.833473 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fea0a-cbb5-4639-9f12-d8afad9ca1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:17.833744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fea0a-cbb5-4639-9f12-d8afad9ca1a3 admin admin] PATH_INFO: `/v3/projects/1da9e09c84fc4f97869ead8d8991439d/users/6cd0f7b729404f5dbb209602b25d3f61/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:17.849344 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fea0a-cbb5-4639-9f12-d8afad9ca1a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da9e09c84fc4f97869ead8d8991439d, user_id=6cd0f7b729404f5dbb209602b25d3f61, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:17.852001 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fea0a-cbb5-4639-9f12-d8afad9ca1a3 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:17.867886 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1270/2532] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:17 2021] PUT /identity/v3/projects/1da9e09c84fc4f97869ead8d8991439d/users/6cd0f7b729404f5dbb209602b25d3f61/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:17.872372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5dc27-e1f2-43bd-b12d-d4a42453ffce admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:17.883228 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5dc27-e1f2-43bd-b12d-d4a42453ffce admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:17.938093 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ac43e-ec82-461c-b529-70b1ac0b6512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:17.938767 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ac43e-ec82-461c-b529-70b1ac0b6512 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:17.939048 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ac43e-ec82-461c-b529-70b1ac0b6512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:17.939323 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ac43e-ec82-461c-b529-70b1ac0b6512 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:17.940066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ac43e-ec82-461c-b529-70b1ac0b6512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:17.941665 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ac43e-ec82-461c-b529-70b1ac0b6512 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:17.954197 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1263/2533] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:17 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:17.956816 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fea0a-cbb5-4639-9f12-d8afad9ca1a3 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:17.967187 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fea0a-cbb5-4639-9f12-d8afad9ca1a3 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:17.975076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b23e5f-1f0b-4c75-bbf0-faa5a3460bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:17.976134 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b23e5f-1f0b-4c75-bbf0-faa5a3460bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:17.976417 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b23e5f-1f0b-4c75-bbf0-faa5a3460bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:17.976691 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b23e5f-1f0b-4c75-bbf0-faa5a3460bf5 admin admin] PATH_INFO: `/v3/projects/1da9e09c84fc4f97869ead8d8991439d/users/6cd0f7b729404f5dbb209602b25d3f61/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:17.978829 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b23e5f-1f0b-4c75-bbf0-faa5a3460bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da9e09c84fc4f97869ead8d8991439d, user_id=6cd0f7b729404f5dbb209602b25d3f61, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:17.981573 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b23e5f-1f0b-4c75-bbf0-faa5a3460bf5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:17.994565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1271/2534] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:17 2021] PUT /identity/v3/projects/1da9e09c84fc4f97869ead8d8991439d/users/6cd0f7b729404f5dbb209602b25d3f61/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:18.004606 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90d957-93f1-40e9-b77d-dbd0e9f5fb14 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:18.004891 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90d957-93f1-40e9-b77d-dbd0e9f5fb14 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:18.005163 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90d957-93f1-40e9-b77d-dbd0e9f5fb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:18.033801 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-0d90d957-93f1-40e9-b77d-dbd0e9f5fb14 None None] MFA Rules not processed for user `6cd0f7b729404f5dbb209602b25d3f61`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:18.035043 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0d90d957-93f1-40e9-b77d-dbd0e9f5fb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:18.113706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1264/2535] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:18 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:18.125971 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b23e5f-1f0b-4c75-bbf0-faa5a3460bf5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:18.127754 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-41b23e5f-1f0b-4c75-bbf0-faa5a3460bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:18.143606 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90d957-93f1-40e9-b77d-dbd0e9f5fb14 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:18.145224 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0d90d957-93f1-40e9-b77d-dbd0e9f5fb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:18.187105 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b23e5f-1f0b-4c75-bbf0-faa5a3460bf5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:18.192262 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562409a-6cef-4fc7-9836-b94d1497e11d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:18.193191 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562409a-6cef-4fc7-9836-b94d1497e11d service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:18.193562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562409a-6cef-4fc7-9836-b94d1497e11d service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:18.193895 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562409a-6cef-4fc7-9836-b94d1497e11d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:18.214435 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90d957-93f1-40e9-b77d-dbd0e9f5fb14 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:18.215385 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562409a-6cef-4fc7-9836-b94d1497e11d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:18.216908 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562409a-6cef-4fc7-9836-b94d1497e11d service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:18.218190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9924c71-2fc9-4704-9406-2cb2037416fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:18.218973 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9924c71-2fc9-4704-9406-2cb2037416fb service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:18.219254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9924c71-2fc9-4704-9406-2cb2037416fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:18.219526 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9924c71-2fc9-4704-9406-2cb2037416fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:18.221347 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d9924c71-2fc9-4704-9406-2cb2037416fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:18.227179 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1272/2536] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:18 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:07:18.271859 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562409a-6cef-4fc7-9836-b94d1497e11d service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:18.273533 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3562409a-6cef-4fc7-9836-b94d1497e11d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:18.284942 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562409a-6cef-4fc7-9836-b94d1497e11d service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:18.288177 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9924c71-2fc9-4704-9406-2cb2037416fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:18.289594 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec21615-716f-4b30-8e41-eb39ec17dd53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:18.289775 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9924c71-2fc9-4704-9406-2cb2037416fb service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:18.290394 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec21615-716f-4b30-8e41-eb39ec17dd53 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:18.290739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec21615-716f-4b30-8e41-eb39ec17dd53 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:18.291081 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec21615-716f-4b30-8e41-eb39ec17dd53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:18.299703 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1265/2537] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:18 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:07:18.349905 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec21615-716f-4b30-8e41-eb39ec17dd53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:18.351398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec21615-716f-4b30-8e41-eb39ec17dd53 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:18.360958 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1273/2538] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:18 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:07:21.204303 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9924c71-2fc9-4704-9406-2cb2037416fb service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:21.267617 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9924c71-2fc9-4704-9406-2cb2037416fb service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:21.272211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d403845-e125-4991-b508-7e9fba46b60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:21.273186 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d403845-e125-4991-b508-7e9fba46b60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:21.273466 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d403845-e125-4991-b508-7e9fba46b60d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:21.273737 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d403845-e125-4991-b508-7e9fba46b60d admin admin] PATH_INFO: `/v3/users/6fc370c670184041965ad0ca7c308c8c` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:21.275031 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d403845-e125-4991-b508-7e9fba46b60d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fc370c670184041965ad0ca7c308c8c)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:21.276925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d403845-e125-4991-b508-7e9fba46b60d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:21.323826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2d403845-e125-4991-b508-7e9fba46b60d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc370c670184041965ad0ca7c308c8c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:21.336146 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2d403845-e125-4991-b508-7e9fba46b60d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc370c670184041965ad0ca7c308c8c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:21.343758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2d403845-e125-4991-b508-7e9fba46b60d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc370c670184041965ad0ca7c308c8c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:21.351618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2d403845-e125-4991-b508-7e9fba46b60d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc370c670184041965ad0ca7c308c8c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:21.352557 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2d403845-e125-4991-b508-7e9fba46b60d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc370c670184041965ad0ca7c308c8c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:21.360265 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1266/2539] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:07:21 2021] DELETE /identity/v3/users/6fc370c670184041965ad0ca7c308c8c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:21.364589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c825a-859e-495c-a378-f1d1c4d50b69 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:21.365051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c825a-859e-495c-a378-f1d1c4d50b69 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:21.365239 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c825a-859e-495c-a378-f1d1c4d50b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:21.385153 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-021c825a-859e-495c-a378-f1d1c4d50b69 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:21.386896 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-021c825a-859e-495c-a378-f1d1c4d50b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:21.448656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1274/2540] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:07:21.461867 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d403845-e125-4991-b508-7e9fba46b60d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:21.463337 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-2d403845-e125-4991-b508-7e9fba46b60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:21.526475 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d403845-e125-4991-b508-7e9fba46b60d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:21.530064 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bab93-9573-4b82-bf11-96cb68facd0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:21.530707 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bab93-9573-4b82-bf11-96cb68facd0a service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:21.531018 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bab93-9573-4b82-bf11-96cb68facd0a service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:21.531326 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bab93-9573-4b82-bf11-96cb68facd0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:21.540939 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bab93-9573-4b82-bf11-96cb68facd0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:21.542466 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bab93-9573-4b82-bf11-96cb68facd0a service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:21.551991 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1267/2541] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:07:21.805433 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c825a-859e-495c-a378-f1d1c4d50b69 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:21.807015 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-021c825a-859e-495c-a378-f1d1c4d50b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:21.819389 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c825a-859e-495c-a378-f1d1c4d50b69 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:21.824090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:21.825027 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:21.825373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:21.825745 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7 admin admin] PATH_INFO: `/v3/projects/9f126442ce364b10a058ba122aa4c67a` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:21.827030 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f126442ce364b10a058ba122aa4c67a)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:21.828995 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:21.874694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f126442ce364b10a058ba122aa4c67a', 'request_id': 'req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:21.881769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f126442ce364b10a058ba122aa4c67a', 'request_id': 'req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:21.888031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f126442ce364b10a058ba122aa4c67a', 'request_id': 'req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:21.897877 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7 admin admin] The token cache is being invalidate because project 9f126442ce364b10a058ba122aa4c67a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:07:21.898130 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:21.898751 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:21.900252 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1275/2542] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:07:21 2021] DELETE /identity/v3/projects/9f126442ce364b10a058ba122aa4c67a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:21.904162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bab93-9573-4b82-bf11-96cb68facd0a service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:21.914156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bab93-9573-4b82-bf11-96cb68facd0a service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:21.966841 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a24e6-f140-4a26-8c9a-a11d7a7a3c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:21.967701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a24e6-f140-4a26-8c9a-a11d7a7a3c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:21.967982 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a24e6-f140-4a26-8c9a-a11d7a7a3c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:21.968259 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a24e6-f140-4a26-8c9a-a11d7a7a3c6e admin admin] PATH_INFO: `/v3/users/5d2fa1994d6a481c86e17aa6fdaff3a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:21.969955 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a24e6-f140-4a26-8c9a-a11d7a7a3c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d2fa1994d6a481c86e17aa6fdaff3a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:21.971879 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a24e6-f140-4a26-8c9a-a11d7a7a3c6e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:22.016956 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cd3a24e6-f140-4a26-8c9a-a11d7a7a3c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d2fa1994d6a481c86e17aa6fdaff3a1'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:22.028009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cd3a24e6-f140-4a26-8c9a-a11d7a7a3c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d2fa1994d6a481c86e17aa6fdaff3a1'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:22.035143 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cd3a24e6-f140-4a26-8c9a-a11d7a7a3c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d2fa1994d6a481c86e17aa6fdaff3a1'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:22.041946 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cd3a24e6-f140-4a26-8c9a-a11d7a7a3c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d2fa1994d6a481c86e17aa6fdaff3a1'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:22.042630 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cd3a24e6-f140-4a26-8c9a-a11d7a7a3c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d2fa1994d6a481c86e17aa6fdaff3a1'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:22.048974 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1268/2543] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:07:21 2021] DELETE /identity/v3/users/5d2fa1994d6a481c86e17aa6fdaff3a1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:22.304739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:22.306225 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:22.320251 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3b0ac-d2e8-4d95-829a-89926cdcbce7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:22.379191 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0da788-3c8e-44ea-aa78-574ce2a49af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:22.380234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0da788-3c8e-44ea-aa78-574ce2a49af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:22.380514 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0da788-3c8e-44ea-aa78-574ce2a49af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:22.380783 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0da788-3c8e-44ea-aa78-574ce2a49af7 admin admin] PATH_INFO: `/v3/projects/fa8e7eaaa12a49429ba4bec8c63fa832` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:22.381962 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0da788-3c8e-44ea-aa78-574ce2a49af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8e7eaaa12a49429ba4bec8c63fa832)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:22.383860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0da788-3c8e-44ea-aa78-574ce2a49af7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:22.428300 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ca0da788-3c8e-44ea-aa78-574ce2a49af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8e7eaaa12a49429ba4bec8c63fa832', 'request_id': 'req-ca0da788-3c8e-44ea-aa78-574ce2a49af7'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:22.435371 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ca0da788-3c8e-44ea-aa78-574ce2a49af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8e7eaaa12a49429ba4bec8c63fa832', 'request_id': 'req-ca0da788-3c8e-44ea-aa78-574ce2a49af7'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:22.441864 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ca0da788-3c8e-44ea-aa78-574ce2a49af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8e7eaaa12a49429ba4bec8c63fa832', 'request_id': 'req-ca0da788-3c8e-44ea-aa78-574ce2a49af7'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:22.451489 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ca0da788-3c8e-44ea-aa78-574ce2a49af7 admin admin] The token cache is being invalidate because project fa8e7eaaa12a49429ba4bec8c63fa832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:07:22.451769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ca0da788-3c8e-44ea-aa78-574ce2a49af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:22.452379 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ca0da788-3c8e-44ea-aa78-574ce2a49af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:22.453869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1276/2544] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:07:22 2021] DELETE /identity/v3/projects/fa8e7eaaa12a49429ba4bec8c63fa832 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:22.457753 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a24e6-f140-4a26-8c9a-a11d7a7a3c6e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:22.459161 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-cd3a24e6-f140-4a26-8c9a-a11d7a7a3c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:22.471230 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a24e6-f140-4a26-8c9a-a11d7a7a3c6e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:22.526651 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef0417-9c3c-4507-944d-e669c496eff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:22.527533 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef0417-9c3c-4507-944d-e669c496eff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:22.527813 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef0417-9c3c-4507-944d-e669c496eff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:22.528086 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef0417-9c3c-4507-944d-e669c496eff8 admin admin] PATH_INFO: `/v3/users/6cd0f7b729404f5dbb209602b25d3f61` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:22.529288 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef0417-9c3c-4507-944d-e669c496eff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd0f7b729404f5dbb209602b25d3f61)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:22.531818 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef0417-9c3c-4507-944d-e669c496eff8 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:22.576547 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7aef0417-9c3c-4507-944d-e669c496eff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd0f7b729404f5dbb209602b25d3f61'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:22.588512 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7aef0417-9c3c-4507-944d-e669c496eff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd0f7b729404f5dbb209602b25d3f61'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:22.596476 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7aef0417-9c3c-4507-944d-e669c496eff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd0f7b729404f5dbb209602b25d3f61'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:22.603480 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7aef0417-9c3c-4507-944d-e669c496eff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd0f7b729404f5dbb209602b25d3f61'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:22.604120 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7aef0417-9c3c-4507-944d-e669c496eff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd0f7b729404f5dbb209602b25d3f61'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:22.610502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1269/2545] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:07:22 2021] DELETE /identity/v3/users/6cd0f7b729404f5dbb209602b25d3f61 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:22.874480 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0da788-3c8e-44ea-aa78-574ce2a49af7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:22.875912 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-ca0da788-3c8e-44ea-aa78-574ce2a49af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:22.888942 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0da788-3c8e-44ea-aa78-574ce2a49af7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:22.954687 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba1e88-b5d0-464c-9fb3-0ec06a4bd46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:22.955452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba1e88-b5d0-464c-9fb3-0ec06a4bd46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:22.955736 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba1e88-b5d0-464c-9fb3-0ec06a4bd46d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:22.956011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba1e88-b5d0-464c-9fb3-0ec06a4bd46d admin admin] PATH_INFO: `/v3/projects/1da9e09c84fc4f97869ead8d8991439d` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:22.957200 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba1e88-b5d0-464c-9fb3-0ec06a4bd46d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da9e09c84fc4f97869ead8d8991439d)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:22.959159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba1e88-b5d0-464c-9fb3-0ec06a4bd46d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:23.003360 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-feba1e88-b5d0-464c-9fb3-0ec06a4bd46d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da9e09c84fc4f97869ead8d8991439d', 'request_id': 'req-feba1e88-b5d0-464c-9fb3-0ec06a4bd46d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:23.010353 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-feba1e88-b5d0-464c-9fb3-0ec06a4bd46d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da9e09c84fc4f97869ead8d8991439d', 'request_id': 'req-feba1e88-b5d0-464c-9fb3-0ec06a4bd46d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:23.016943 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-feba1e88-b5d0-464c-9fb3-0ec06a4bd46d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da9e09c84fc4f97869ead8d8991439d', 'request_id': 'req-feba1e88-b5d0-464c-9fb3-0ec06a4bd46d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:23.026945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-feba1e88-b5d0-464c-9fb3-0ec06a4bd46d admin admin] The token cache is being invalidate because project 1da9e09c84fc4f97869ead8d8991439d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:07:23.027227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-feba1e88-b5d0-464c-9fb3-0ec06a4bd46d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:23.027848 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-feba1e88-b5d0-464c-9fb3-0ec06a4bd46d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:23.029334 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1277/2546] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:07:22 2021] DELETE /identity/v3/projects/1da9e09c84fc4f97869ead8d8991439d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:23.037371 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ce93d-96a5-4102-a469-bb81248e7f70 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:23.037661 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ce93d-96a5-4102-a469-bb81248e7f70 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:23.037937 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ce93d-96a5-4102-a469-bb81248e7f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:23.055976 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-289ce93d-96a5-4102-a469-bb81248e7f70 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:23.057166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-289ce93d-96a5-4102-a469-bb81248e7f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:23.115713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1270/2547] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:23.124273 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8b14d-b137-4109-8a05-0b449c7ed272 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:23.124566 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8b14d-b137-4109-8a05-0b449c7ed272 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:23.124848 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8b14d-b137-4109-8a05-0b449c7ed272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:23.143365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-c8b8b14d-b137-4109-8a05-0b449c7ed272 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:23.144569 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c8b8b14d-b137-4109-8a05-0b449c7ed272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:23.152399 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1278/2548] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:23.157104 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ce93d-96a5-4102-a469-bb81248e7f70 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:23.166738 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ce93d-96a5-4102-a469-bb81248e7f70 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:23.171199 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406c64a-248e-455c-9c2b-eb42f200e517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:23.171863 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406c64a-248e-455c-9c2b-eb42f200e517 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:23.172143 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406c64a-248e-455c-9c2b-eb42f200e517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:23.172423 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406c64a-248e-455c-9c2b-eb42f200e517 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:23.173139 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406c64a-248e-455c-9c2b-eb42f200e517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:07:23.173435 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406c64a-248e-455c-9c2b-eb42f200e517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:23.175036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406c64a-248e-455c-9c2b-eb42f200e517 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:23.189678 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1271/2549] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:07:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:07:23.191602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8b14d-b137-4109-8a05-0b449c7ed272 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:23.203702 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8b14d-b137-4109-8a05-0b449c7ed272 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:23.206451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88190b1-22b8-442a-8ac9-c8887e24bc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:23.207009 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88190b1-22b8-442a-8ac9-c8887e24bc8c admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:23.207450 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88190b1-22b8-442a-8ac9-c8887e24bc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:23.207774 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88190b1-22b8-442a-8ac9-c8887e24bc8c admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:23.208422 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88190b1-22b8-442a-8ac9-c8887e24bc8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:23.210500 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88190b1-22b8-442a-8ac9-c8887e24bc8c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:23.236047 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1279/2550] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:07:23 2021] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:07:23.240432 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406c64a-248e-455c-9c2b-eb42f200e517 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:23.250580 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406c64a-248e-455c-9c2b-eb42f200e517 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:23.304916 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c99659-3b2b-4170-8333-2b5a081ca734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:23.305572 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c99659-3b2b-4170-8333-2b5a081ca734 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:23.305856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c99659-3b2b-4170-8333-2b5a081ca734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:23.306171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c99659-3b2b-4170-8333-2b5a081ca734 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:23.306872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c99659-3b2b-4170-8333-2b5a081ca734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:23.308770 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c99659-3b2b-4170-8333-2b5a081ca734 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:23.328419 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1272/2551] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:07:23 2021] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:07:23.332410 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88190b1-22b8-442a-8ac9-c8887e24bc8c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:23.342458 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88190b1-22b8-442a-8ac9-c8887e24bc8c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:23.347126 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002a174-4cfa-46e6-88fa-3a973cc1ff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:23.347777 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002a174-4cfa-46e6-88fa-3a973cc1ff27 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:23.348061 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002a174-4cfa-46e6-88fa-3a973cc1ff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:23.348341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002a174-4cfa-46e6-88fa-3a973cc1ff27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:23.349125 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002a174-4cfa-46e6-88fa-3a973cc1ff27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:23.350751 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002a174-4cfa-46e6-88fa-3a973cc1ff27 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:23.362041 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1280/2552] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:23.365602 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c99659-3b2b-4170-8333-2b5a081ca734 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:23.375950 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c99659-3b2b-4170-8333-2b5a081ca734 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:23.380543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da475c95-febb-4267-bc7b-3129ee0efe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:23.381183 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da475c95-febb-4267-bc7b-3129ee0efe03 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:23.381466 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da475c95-febb-4267-bc7b-3129ee0efe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:23.381819 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da475c95-febb-4267-bc7b-3129ee0efe03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:23.382576 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da475c95-febb-4267-bc7b-3129ee0efe03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:23.384238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da475c95-febb-4267-bc7b-3129ee0efe03 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:23.394547 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1273/2553] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:23.398415 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002a174-4cfa-46e6-88fa-3a973cc1ff27 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:23.408062 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002a174-4cfa-46e6-88fa-3a973cc1ff27 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:23.412654 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea68c9-3fee-4e26-969d-42a0b273d91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:23.413515 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea68c9-3fee-4e26-969d-42a0b273d91d admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:23.413800 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea68c9-3fee-4e26-969d-42a0b273d91d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:23.414112 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea68c9-3fee-4e26-969d-42a0b273d91d admin admin] PATH_INFO: `/v3/projects/de704058493d4ebab3838691e80e2940/users/477e6b8a50a24c869b53a7868ea54ead/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:23.428704 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea68c9-3fee-4e26-969d-42a0b273d91d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de704058493d4ebab3838691e80e2940, user_id=477e6b8a50a24c869b53a7868ea54ead, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:23.431440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea68c9-3fee-4e26-969d-42a0b273d91d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:23.444398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1281/2554] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:23 2021] PUT /identity/v3/projects/de704058493d4ebab3838691e80e2940/users/477e6b8a50a24c869b53a7868ea54ead/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:23.456657 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7685a3d-e054-4e0a-9b3a-443427d236d8 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:23.456886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7685a3d-e054-4e0a-9b3a-443427d236d8 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:23.457165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7685a3d-e054-4e0a-9b3a-443427d236d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:23.482470 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-a7685a3d-e054-4e0a-9b3a-443427d236d8 None None] MFA Rules not processed for user `477e6b8a50a24c869b53a7868ea54ead`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:23.483770 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-a7685a3d-e054-4e0a-9b3a-443427d236d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:23.544350 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1274/2555] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:23 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:07:23.548798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea68c9-3fee-4e26-969d-42a0b273d91d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:23.605836 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea68c9-3fee-4e26-969d-42a0b273d91d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:23.611009 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cf342-35e8-4277-80b7-296837440364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:23.611695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cf342-35e8-4277-80b7-296837440364 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:23.611979 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cf342-35e8-4277-80b7-296837440364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:23.612259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cf342-35e8-4277-80b7-296837440364 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:23.612964 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cf342-35e8-4277-80b7-296837440364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:23.614911 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cf342-35e8-4277-80b7-296837440364 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:23.639167 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1282/2556] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:07:23 2021] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:07:23.643725 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7685a3d-e054-4e0a-9b3a-443427d236d8 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:23.654196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7685a3d-e054-4e0a-9b3a-443427d236d8 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:23.709178 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1164f5-96bf-4522-9c7b-19ce04d0df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:23.709856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1164f5-96bf-4522-9c7b-19ce04d0df36 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:23.710509 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1164f5-96bf-4522-9c7b-19ce04d0df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:23.710509 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1164f5-96bf-4522-9c7b-19ce04d0df36 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:23.711127 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1164f5-96bf-4522-9c7b-19ce04d0df36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:23.713012 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1164f5-96bf-4522-9c7b-19ce04d0df36 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:23.735400 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1275/2557] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:07:23 2021] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:07:23.739397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cf342-35e8-4277-80b7-296837440364 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:23.750943 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cf342-35e8-4277-80b7-296837440364 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:23.755599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc3f67-b550-44e4-9399-59be9fdec4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:23.756308 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc3f67-b550-44e4-9399-59be9fdec4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:23.756594 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc3f67-b550-44e4-9399-59be9fdec4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:23.756875 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc3f67-b550-44e4-9399-59be9fdec4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:23.757600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc3f67-b550-44e4-9399-59be9fdec4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:23.759617 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc3f67-b550-44e4-9399-59be9fdec4b7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:23.774214 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1283/2558] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:23 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:23.775625 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1164f5-96bf-4522-9c7b-19ce04d0df36 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:23.787454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1164f5-96bf-4522-9c7b-19ce04d0df36 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:23.793394 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5905f-c581-42d7-89d9-b90f69e02e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:23.794466 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5905f-c581-42d7-89d9-b90f69e02e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:23.794864 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5905f-c581-42d7-89d9-b90f69e02e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:23.795766 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5905f-c581-42d7-89d9-b90f69e02e3c admin admin] PATH_INFO: `/v3/projects/2923ec2abe6443c79caed7b8094289c2/users/fd9e15daa2f346c9a039f52c90e7cbfd/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:23.811603 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5905f-c581-42d7-89d9-b90f69e02e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2923ec2abe6443c79caed7b8094289c2, user_id=fd9e15daa2f346c9a039f52c90e7cbfd, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:23.815067 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5905f-c581-42d7-89d9-b90f69e02e3c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:23.833036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1276/2559] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:23 2021] PUT /identity/v3/projects/2923ec2abe6443c79caed7b8094289c2/users/fd9e15daa2f346c9a039f52c90e7cbfd/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:07:23.834371 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc3f67-b550-44e4-9399-59be9fdec4b7 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:23.845266 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc3f67-b550-44e4-9399-59be9fdec4b7 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:23.908348 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef28708-39be-4498-9562-bba76844276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:23.909024 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef28708-39be-4498-9562-bba76844276a admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:23.909308 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef28708-39be-4498-9562-bba76844276a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:23.909588 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef28708-39be-4498-9562-bba76844276a admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:23.910362 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef28708-39be-4498-9562-bba76844276a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:23.911954 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef28708-39be-4498-9562-bba76844276a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:23.922321 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1284/2560] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:23 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:23.926604 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5905f-c581-42d7-89d9-b90f69e02e3c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:23.936769 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5905f-c581-42d7-89d9-b90f69e02e3c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:23.941964 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210cec3-b000-4a86-a020-7f96fcc89560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:23.942861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210cec3-b000-4a86-a020-7f96fcc89560 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:23.943143 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210cec3-b000-4a86-a020-7f96fcc89560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:23.943417 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210cec3-b000-4a86-a020-7f96fcc89560 admin admin] PATH_INFO: `/v3/projects/2923ec2abe6443c79caed7b8094289c2/users/fd9e15daa2f346c9a039f52c90e7cbfd/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:23.945408 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210cec3-b000-4a86-a020-7f96fcc89560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2923ec2abe6443c79caed7b8094289c2, user_id=fd9e15daa2f346c9a039f52c90e7cbfd, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:23.948059 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210cec3-b000-4a86-a020-7f96fcc89560 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:23.958091 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1277/2561] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:23 2021] PUT /identity/v3/projects/2923ec2abe6443c79caed7b8094289c2/users/fd9e15daa2f346c9a039f52c90e7cbfd/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:23.968012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc59d19-c679-4737-84fa-d16cc8b0090a None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:23.968257 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc59d19-c679-4737-84fa-d16cc8b0090a None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:23.968557 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc59d19-c679-4737-84fa-d16cc8b0090a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:23.994952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-edc59d19-c679-4737-84fa-d16cc8b0090a None None] MFA Rules not processed for user `fd9e15daa2f346c9a039f52c90e7cbfd`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:23.996162 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-edc59d19-c679-4737-84fa-d16cc8b0090a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:24.061205 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1285/2562] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:23 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:24.071211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210cec3-b000-4a86-a020-7f96fcc89560 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:24.072881 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d210cec3-b000-4a86-a020-7f96fcc89560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:24.127720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210cec3-b000-4a86-a020-7f96fcc89560 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:24.131316 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a57b4-eb92-4b13-8789-a989963815ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:24.131943 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a57b4-eb92-4b13-8789-a989963815ed service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:24.132254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a57b4-eb92-4b13-8789-a989963815ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:24.132521 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a57b4-eb92-4b13-8789-a989963815ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:24.141314 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a57b4-eb92-4b13-8789-a989963815ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:24.142795 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a57b4-eb92-4b13-8789-a989963815ed service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:24.151978 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1278/2563] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:24 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:07:24.646414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc59d19-c679-4737-84fa-d16cc8b0090a None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:24.705956 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc59d19-c679-4737-84fa-d16cc8b0090a None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:24.710504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87748919-17a4-4ea3-8fd9-4b47a41ebe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:24.711348 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87748919-17a4-4ea3-8fd9-4b47a41ebe5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:24.711623 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87748919-17a4-4ea3-8fd9-4b47a41ebe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:24.711923 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87748919-17a4-4ea3-8fd9-4b47a41ebe5a admin admin] PATH_INFO: `/v3/users/477e6b8a50a24c869b53a7868ea54ead` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:24.713087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87748919-17a4-4ea3-8fd9-4b47a41ebe5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=477e6b8a50a24c869b53a7868ea54ead)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:24.715012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87748919-17a4-4ea3-8fd9-4b47a41ebe5a admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:24.758521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-87748919-17a4-4ea3-8fd9-4b47a41ebe5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477e6b8a50a24c869b53a7868ea54ead'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:24.770165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-87748919-17a4-4ea3-8fd9-4b47a41ebe5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477e6b8a50a24c869b53a7868ea54ead'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:24.776746 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-87748919-17a4-4ea3-8fd9-4b47a41ebe5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477e6b8a50a24c869b53a7868ea54ead'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:24.777368 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-87748919-17a4-4ea3-8fd9-4b47a41ebe5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477e6b8a50a24c869b53a7868ea54ead'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:24.777970 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-87748919-17a4-4ea3-8fd9-4b47a41ebe5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477e6b8a50a24c869b53a7868ea54ead'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:24.790259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1286/2564] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:07:24 2021] DELETE /identity/v3/users/477e6b8a50a24c869b53a7868ea54ead => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:24.794827 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352ce6f-d2e2-461d-8c32-4acbaf699ddf None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:24.795303 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352ce6f-d2e2-461d-8c32-4acbaf699ddf None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:24.795405 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352ce6f-d2e2-461d-8c32-4acbaf699ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:24.812727 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c352ce6f-d2e2-461d-8c32-4acbaf699ddf None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:24.813894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c352ce6f-d2e2-461d-8c32-4acbaf699ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:24.868156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1279/2565] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:24.878805 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87748919-17a4-4ea3-8fd9-4b47a41ebe5a admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:24.880199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-87748919-17a4-4ea3-8fd9-4b47a41ebe5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:24.936148 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87748919-17a4-4ea3-8fd9-4b47a41ebe5a admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:24.940311 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d11f60-9ecb-48f9-aa52-fb3d3ebda26a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:24.940953 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d11f60-9ecb-48f9-aa52-fb3d3ebda26a service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:24.941239 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d11f60-9ecb-48f9-aa52-fb3d3ebda26a service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:24.941515 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d11f60-9ecb-48f9-aa52-fb3d3ebda26a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:24.957331 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d11f60-9ecb-48f9-aa52-fb3d3ebda26a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:24.958807 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d11f60-9ecb-48f9-aa52-fb3d3ebda26a service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:24.969515 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1287/2566] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:07:25.292431 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352ce6f-d2e2-461d-8c32-4acbaf699ddf None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:25.294041 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c352ce6f-d2e2-461d-8c32-4acbaf699ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:25.306132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352ce6f-d2e2-461d-8c32-4acbaf699ddf None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:25.311374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d074e-ac38-49ce-a540-9cf543d715b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:25.312907 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d074e-ac38-49ce-a540-9cf543d715b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:25.313390 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d074e-ac38-49ce-a540-9cf543d715b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:25.313734 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d074e-ac38-49ce-a540-9cf543d715b7 admin admin] PATH_INFO: `/v3/projects/de704058493d4ebab3838691e80e2940` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:25.315130 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d074e-ac38-49ce-a540-9cf543d715b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de704058493d4ebab3838691e80e2940)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:25.317026 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d074e-ac38-49ce-a540-9cf543d715b7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:25.364195 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2d0d074e-ac38-49ce-a540-9cf543d715b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de704058493d4ebab3838691e80e2940', 'request_id': 'req-2d0d074e-ac38-49ce-a540-9cf543d715b7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:25.371371 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2d0d074e-ac38-49ce-a540-9cf543d715b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de704058493d4ebab3838691e80e2940', 'request_id': 'req-2d0d074e-ac38-49ce-a540-9cf543d715b7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:25.378338 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2d0d074e-ac38-49ce-a540-9cf543d715b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de704058493d4ebab3838691e80e2940', 'request_id': 'req-2d0d074e-ac38-49ce-a540-9cf543d715b7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:25.388320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2d0d074e-ac38-49ce-a540-9cf543d715b7 admin admin] The token cache is being invalidate because project de704058493d4ebab3838691e80e2940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:07:25.388604 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2d0d074e-ac38-49ce-a540-9cf543d715b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:25.389239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-2d0d074e-ac38-49ce-a540-9cf543d715b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:25.390805 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1280/2567] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:07:25 2021] DELETE /identity/v3/projects/de704058493d4ebab3838691e80e2940 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:25.394820 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d11f60-9ecb-48f9-aa52-fb3d3ebda26a service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:25.404062 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d11f60-9ecb-48f9-aa52-fb3d3ebda26a service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:25.458838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb15c7-75b6-4d4a-8555-40587b3e1bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:25.459689 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb15c7-75b6-4d4a-8555-40587b3e1bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:25.459966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb15c7-75b6-4d4a-8555-40587b3e1bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:25.460235 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb15c7-75b6-4d4a-8555-40587b3e1bd7 admin admin] PATH_INFO: `/v3/users/fd9e15daa2f346c9a039f52c90e7cbfd` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:25.461485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb15c7-75b6-4d4a-8555-40587b3e1bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd9e15daa2f346c9a039f52c90e7cbfd)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:25.463416 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb15c7-75b6-4d4a-8555-40587b3e1bd7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:25.507896 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3cfb15c7-75b6-4d4a-8555-40587b3e1bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd9e15daa2f346c9a039f52c90e7cbfd'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:25.518900 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3cfb15c7-75b6-4d4a-8555-40587b3e1bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd9e15daa2f346c9a039f52c90e7cbfd'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:25.526081 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3cfb15c7-75b6-4d4a-8555-40587b3e1bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd9e15daa2f346c9a039f52c90e7cbfd'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:25.526683 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3cfb15c7-75b6-4d4a-8555-40587b3e1bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd9e15daa2f346c9a039f52c90e7cbfd'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:25.527372 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3cfb15c7-75b6-4d4a-8555-40587b3e1bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd9e15daa2f346c9a039f52c90e7cbfd'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:25.539520 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1288/2568] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:07:25 2021] DELETE /identity/v3/users/fd9e15daa2f346c9a039f52c90e7cbfd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:07:25.795126 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d074e-ac38-49ce-a540-9cf543d715b7 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:25.797875 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-2d0d074e-ac38-49ce-a540-9cf543d715b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:25.811834 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d074e-ac38-49ce-a540-9cf543d715b7 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:25.869278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26515e0-b936-4065-91bd-22d0a972d69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:25.870165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26515e0-b936-4065-91bd-22d0a972d69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:25.870444 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26515e0-b936-4065-91bd-22d0a972d69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:25.870960 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26515e0-b936-4065-91bd-22d0a972d69c admin admin] PATH_INFO: `/v3/projects/2923ec2abe6443c79caed7b8094289c2` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:25.871905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26515e0-b936-4065-91bd-22d0a972d69c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2923ec2abe6443c79caed7b8094289c2)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:25.873799 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26515e0-b936-4065-91bd-22d0a972d69c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:25.920733 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-f26515e0-b936-4065-91bd-22d0a972d69c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2923ec2abe6443c79caed7b8094289c2', 'request_id': 'req-f26515e0-b936-4065-91bd-22d0a972d69c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:25.931004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-f26515e0-b936-4065-91bd-22d0a972d69c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2923ec2abe6443c79caed7b8094289c2', 'request_id': 'req-f26515e0-b936-4065-91bd-22d0a972d69c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:25.937736 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-f26515e0-b936-4065-91bd-22d0a972d69c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2923ec2abe6443c79caed7b8094289c2', 'request_id': 'req-f26515e0-b936-4065-91bd-22d0a972d69c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:25.948384 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-f26515e0-b936-4065-91bd-22d0a972d69c admin admin] The token cache is being invalidate because project 2923ec2abe6443c79caed7b8094289c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:07:25.948640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-f26515e0-b936-4065-91bd-22d0a972d69c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:25.949285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-f26515e0-b936-4065-91bd-22d0a972d69c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:25.951046 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1281/2569] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:07:25 2021] DELETE /identity/v3/projects/2923ec2abe6443c79caed7b8094289c2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:25.956993 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412c8e5-9136-4049-b383-ce99a4e63795 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:25.957499 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412c8e5-9136-4049-b383-ce99a4e63795 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:25.957762 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412c8e5-9136-4049-b383-ce99a4e63795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:25.978343 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-1412c8e5-9136-4049-b383-ce99a4e63795 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:25.979549 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-1412c8e5-9136-4049-b383-ce99a4e63795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:26.039137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1289/2570] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:26.048196 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7d79d-778c-4dc6-942a-6b43f2944ff2 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:26.048512 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7d79d-778c-4dc6-942a-6b43f2944ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:26.048784 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7d79d-778c-4dc6-942a-6b43f2944ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:26.066513 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-22e7d79d-778c-4dc6-942a-6b43f2944ff2 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:26.067711 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-22e7d79d-778c-4dc6-942a-6b43f2944ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:26.075360 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1282/2571] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:26.079911 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412c8e5-9136-4049-b383-ce99a4e63795 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:26.089233 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412c8e5-9136-4049-b383-ce99a4e63795 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:26.094417 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48b2ea-abc2-48fb-a692-7f9626cf76b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:26.095047 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48b2ea-abc2-48fb-a692-7f9626cf76b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:26.095326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48b2ea-abc2-48fb-a692-7f9626cf76b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:26.095600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48b2ea-abc2-48fb-a692-7f9626cf76b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:26.096320 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48b2ea-abc2-48fb-a692-7f9626cf76b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:07:26.096624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48b2ea-abc2-48fb-a692-7f9626cf76b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:26.098238 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48b2ea-abc2-48fb-a692-7f9626cf76b2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:26.109263 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1290/2572] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:07:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:07:26.114241 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7d79d-778c-4dc6-942a-6b43f2944ff2 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:26.123281 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7d79d-778c-4dc6-942a-6b43f2944ff2 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:26.127848 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f516f-8bcd-4a7e-ba33-4841867f70cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:26.128501 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f516f-8bcd-4a7e-ba33-4841867f70cc admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:26.128780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f516f-8bcd-4a7e-ba33-4841867f70cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:26.129048 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f516f-8bcd-4a7e-ba33-4841867f70cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:26.129736 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f516f-8bcd-4a7e-ba33-4841867f70cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:26.131768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f516f-8bcd-4a7e-ba33-4841867f70cc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:26.160751 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1283/2573] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:07:26 2021] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:07:26.162005 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48b2ea-abc2-48fb-a692-7f9626cf76b2 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:26.171735 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48b2ea-abc2-48fb-a692-7f9626cf76b2 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:26.230634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9924bc-c6e9-4dac-bc11-acac95ddb8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:26.231296 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9924bc-c6e9-4dac-bc11-acac95ddb8b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:26.231575 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9924bc-c6e9-4dac-bc11-acac95ddb8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:26.231851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9924bc-c6e9-4dac-bc11-acac95ddb8b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:26.232547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9924bc-c6e9-4dac-bc11-acac95ddb8b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:26.234517 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9924bc-c6e9-4dac-bc11-acac95ddb8b2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:26.255837 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1291/2574] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:07:26 2021] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:07:26.259949 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f516f-8bcd-4a7e-ba33-4841867f70cc admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:26.270338 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f516f-8bcd-4a7e-ba33-4841867f70cc admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:26.274969 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b743d-9585-4a7a-a24b-c10537e0ce0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:26.275617 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b743d-9585-4a7a-a24b-c10537e0ce0c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:26.275895 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b743d-9585-4a7a-a24b-c10537e0ce0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:26.276166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b743d-9585-4a7a-a24b-c10537e0ce0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:26.276891 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b743d-9585-4a7a-a24b-c10537e0ce0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:26.278508 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b743d-9585-4a7a-a24b-c10537e0ce0c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:26.290144 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1284/2575] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:26.294723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9924bc-c6e9-4dac-bc11-acac95ddb8b2 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:26.304654 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9924bc-c6e9-4dac-bc11-acac95ddb8b2 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:26.309316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffc24d-afae-4f15-8d4c-8d82ad654cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:26.310016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffc24d-afae-4f15-8d4c-8d82ad654cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:26.310291 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffc24d-afae-4f15-8d4c-8d82ad654cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:26.310567 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffc24d-afae-4f15-8d4c-8d82ad654cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:26.311308 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffc24d-afae-4f15-8d4c-8d82ad654cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:26.313433 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffc24d-afae-4f15-8d4c-8d82ad654cf7 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:26.323941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1292/2576] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:26 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:26.329234 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b743d-9585-4a7a-a24b-c10537e0ce0c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:26.339145 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b743d-9585-4a7a-a24b-c10537e0ce0c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:26.343710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8243d5-c4a7-4f5f-a199-4875828be4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:26.344567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8243d5-c4a7-4f5f-a199-4875828be4dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:26.344845 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8243d5-c4a7-4f5f-a199-4875828be4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:26.345118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8243d5-c4a7-4f5f-a199-4875828be4dc admin admin] PATH_INFO: `/v3/projects/bf10cbabc96c46019a4a6ac5e0617d6a/users/88355145b39c4391bde3afaa541199a8/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:26.359636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8243d5-c4a7-4f5f-a199-4875828be4dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf10cbabc96c46019a4a6ac5e0617d6a, user_id=88355145b39c4391bde3afaa541199a8, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:26.362291 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8243d5-c4a7-4f5f-a199-4875828be4dc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:26.376450 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1285/2577] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:26 2021] PUT /identity/v3/projects/bf10cbabc96c46019a4a6ac5e0617d6a/users/88355145b39c4391bde3afaa541199a8/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:26.386851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1e7c4-d59e-4879-8280-381939699253 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:26.387236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1e7c4-d59e-4879-8280-381939699253 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:26.387616 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1e7c4-d59e-4879-8280-381939699253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:26.415231 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-88a1e7c4-d59e-4879-8280-381939699253 None None] MFA Rules not processed for user `88355145b39c4391bde3afaa541199a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:26.416435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-88a1e7c4-d59e-4879-8280-381939699253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:26.483512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1293/2578] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:26 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:26.487807 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8243d5-c4a7-4f5f-a199-4875828be4dc admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:26.549342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8243d5-c4a7-4f5f-a199-4875828be4dc admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:26.555375 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc43350-9d9c-4778-8cbb-57970894f282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:26.555977 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc43350-9d9c-4778-8cbb-57970894f282 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:26.556285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc43350-9d9c-4778-8cbb-57970894f282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:26.556558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc43350-9d9c-4778-8cbb-57970894f282 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:26.557261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc43350-9d9c-4778-8cbb-57970894f282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:26.559358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc43350-9d9c-4778-8cbb-57970894f282 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:26.588384 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1286/2579] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:07:26 2021] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:07:26.589550 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1e7c4-d59e-4879-8280-381939699253 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:26.600196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1e7c4-d59e-4879-8280-381939699253 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:26.653521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cf5b5-5ed3-49de-bf82-e1e8f89fcad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:26.654229 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cf5b5-5ed3-49de-bf82-e1e8f89fcad9 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:26.654511 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cf5b5-5ed3-49de-bf82-e1e8f89fcad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:26.654787 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cf5b5-5ed3-49de-bf82-e1e8f89fcad9 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:26.655486 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2cf5b5-5ed3-49de-bf82-e1e8f89fcad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:26.657486 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2cf5b5-5ed3-49de-bf82-e1e8f89fcad9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:26.676630 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1294/2580] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:07:26 2021] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:07:26.680739 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc43350-9d9c-4778-8cbb-57970894f282 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:26.691422 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc43350-9d9c-4778-8cbb-57970894f282 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:26.695936 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350c603-b352-4fbd-bab5-f16f7812cbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:26.696581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350c603-b352-4fbd-bab5-f16f7812cbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:26.696879 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350c603-b352-4fbd-bab5-f16f7812cbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:26.697139 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350c603-b352-4fbd-bab5-f16f7812cbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:26.697895 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350c603-b352-4fbd-bab5-f16f7812cbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:26.699516 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350c603-b352-4fbd-bab5-f16f7812cbc6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:26.710810 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1287/2581] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:26.714948 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cf5b5-5ed3-49de-bf82-e1e8f89fcad9 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:26.724705 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cf5b5-5ed3-49de-bf82-e1e8f89fcad9 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:26.729204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9694a08-1327-4d14-a72a-a9b56de2d707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:26.730095 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9694a08-1327-4d14-a72a-a9b56de2d707 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:26.730383 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9694a08-1327-4d14-a72a-a9b56de2d707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:26.730658 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9694a08-1327-4d14-a72a-a9b56de2d707 admin admin] PATH_INFO: `/v3/projects/167900db94a446b4b8513b1af3d11fa1/users/6b6556d8dbeb45ef99d99632fb66b1b7/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:26.745850 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9694a08-1327-4d14-a72a-a9b56de2d707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167900db94a446b4b8513b1af3d11fa1, user_id=6b6556d8dbeb45ef99d99632fb66b1b7, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:26.748553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9694a08-1327-4d14-a72a-a9b56de2d707 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:26.761879 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1295/2582] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:26 2021] PUT /identity/v3/projects/167900db94a446b4b8513b1af3d11fa1/users/6b6556d8dbeb45ef99d99632fb66b1b7/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:07:26.765858 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350c603-b352-4fbd-bab5-f16f7812cbc6 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:26.775553 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350c603-b352-4fbd-bab5-f16f7812cbc6 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:26.829225 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553eb0e-9355-4aae-9de1-5f5ab0642b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:26.829824 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553eb0e-9355-4aae-9de1-5f5ab0642b8d admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:26.830112 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553eb0e-9355-4aae-9de1-5f5ab0642b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:26.830392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553eb0e-9355-4aae-9de1-5f5ab0642b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:26.831123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553eb0e-9355-4aae-9de1-5f5ab0642b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:26.832744 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553eb0e-9355-4aae-9de1-5f5ab0642b8d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:26.842381 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1288/2583] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:26 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:26.846384 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9694a08-1327-4d14-a72a-a9b56de2d707 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:26.856285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9694a08-1327-4d14-a72a-a9b56de2d707 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:26.861364 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccdd3f-0b4d-47f0-aa31-10c1de91189f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:26.862240 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccdd3f-0b4d-47f0-aa31-10c1de91189f admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:26.862528 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccdd3f-0b4d-47f0-aa31-10c1de91189f admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:26.862801 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccdd3f-0b4d-47f0-aa31-10c1de91189f admin admin] PATH_INFO: `/v3/projects/167900db94a446b4b8513b1af3d11fa1/users/6b6556d8dbeb45ef99d99632fb66b1b7/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:26.864771 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccdd3f-0b4d-47f0-aa31-10c1de91189f admin admin] RBAC: Authorizing `identity:create_grant(project_id=167900db94a446b4b8513b1af3d11fa1, user_id=6b6556d8dbeb45ef99d99632fb66b1b7, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:26.867421 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccdd3f-0b4d-47f0-aa31-10c1de91189f admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:26.878339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1296/2584] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:26 2021] PUT /identity/v3/projects/167900db94a446b4b8513b1af3d11fa1/users/6b6556d8dbeb45ef99d99632fb66b1b7/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:26.888267 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20115f0-c0df-42c7-9b90-4c29dc3592e5 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:26.888559 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20115f0-c0df-42c7-9b90-4c29dc3592e5 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:26.888840 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20115f0-c0df-42c7-9b90-4c29dc3592e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:26.914215 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-b20115f0-c0df-42c7-9b90-4c29dc3592e5 None None] MFA Rules not processed for user `6b6556d8dbeb45ef99d99632fb66b1b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:26.915404 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b20115f0-c0df-42c7-9b90-4c29dc3592e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:26.980408 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1289/2585] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:26 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:26.991134 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccdd3f-0b4d-47f0-aa31-10c1de91189f admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:26.992823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b5ccdd3f-0b4d-47f0-aa31-10c1de91189f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:27.048414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccdd3f-0b4d-47f0-aa31-10c1de91189f admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:27.052252 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349896a5-be64-4fd2-8433-e467581cedec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:27.052883 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349896a5-be64-4fd2-8433-e467581cedec service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:27.053161 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349896a5-be64-4fd2-8433-e467581cedec service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:27.053432 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349896a5-be64-4fd2-8433-e467581cedec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:27.106628 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349896a5-be64-4fd2-8433-e467581cedec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:27.107977 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349896a5-be64-4fd2-8433-e467581cedec service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:27.117012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1297/2586] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:26 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:07:27.830736 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f5de3-090a-4565-8a3e-b6e123f601db None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:27.831236 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f5de3-090a-4565-8a3e-b6e123f601db None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:27.831361 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f5de3-090a-4565-8a3e-b6e123f601db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:27.848684 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-5d7f5de3-090a-4565-8a3e-b6e123f601db None None] MFA Rules not processed for user `39cddc4e2ea943cd882b6a1addd98e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:27.849875 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-5d7f5de3-090a-4565-8a3e-b6e123f601db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:27.907408 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1290/2587] 10.222.0.18 () {58 vars in 967 bytes} [Wed Dec 15 03:07:27 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:27.921370 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349896a5-be64-4fd2-8433-e467581cedec service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:27.922837 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-349896a5-be64-4fd2-8433-e467581cedec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:27.988592 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349896a5-be64-4fd2-8433-e467581cedec service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:27.993856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88120e-2e33-4a84-9118-07abfc4ed8b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb0af7ac70d48989852c022c9f83848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:27.994540 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88120e-2e33-4a84-9118-07abfc4ed8b5 service swift] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:27.994810 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88120e-2e33-4a84-9118-07abfc4ed8b5 service swift] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:27.995085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88120e-2e33-4a84-9118-07abfc4ed8b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:28.004258 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88120e-2e33-4a84-9118-07abfc4ed8b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:28.005772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88120e-2e33-4a84-9118-07abfc4ed8b5 service swift] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:28.013645 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1298/2588] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Dec 15 03:07:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 03:07:29.617544 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f5de3-090a-4565-8a3e-b6e123f601db None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:29.676432 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f5de3-090a-4565-8a3e-b6e123f601db None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:29.680947 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dac5a-ee98-4ee2-a9c7-29a6abb07da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:29.681835 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dac5a-ee98-4ee2-a9c7-29a6abb07da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:29.682123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dac5a-ee98-4ee2-a9c7-29a6abb07da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:29.682402 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dac5a-ee98-4ee2-a9c7-29a6abb07da1 admin admin] PATH_INFO: `/v3/users/88355145b39c4391bde3afaa541199a8` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:29.683660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2dac5a-ee98-4ee2-a9c7-29a6abb07da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88355145b39c4391bde3afaa541199a8)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:29.685601 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2dac5a-ee98-4ee2-a9c7-29a6abb07da1 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:29.731445 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-aa2dac5a-ee98-4ee2-a9c7-29a6abb07da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88355145b39c4391bde3afaa541199a8'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:29.742681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-aa2dac5a-ee98-4ee2-a9c7-29a6abb07da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88355145b39c4391bde3afaa541199a8'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:29.752045 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-aa2dac5a-ee98-4ee2-a9c7-29a6abb07da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88355145b39c4391bde3afaa541199a8'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:29.759241 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-aa2dac5a-ee98-4ee2-a9c7-29a6abb07da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88355145b39c4391bde3afaa541199a8'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:29.760030 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-aa2dac5a-ee98-4ee2-a9c7-29a6abb07da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88355145b39c4391bde3afaa541199a8'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:29.766457 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1291/2589] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:07:29 2021] DELETE /identity/v3/users/88355145b39c4391bde3afaa541199a8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:29.770931 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b84846-b0f6-4b98-9ea1-13f6170014ea None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:29.771408 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b84846-b0f6-4b98-9ea1-13f6170014ea None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:29.771526 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b84846-b0f6-4b98-9ea1-13f6170014ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:29.789148 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-52b84846-b0f6-4b98-9ea1-13f6170014ea None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:29.790420 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-52b84846-b0f6-4b98-9ea1-13f6170014ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:29.855025 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1299/2590] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:29.861426 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dac5a-ee98-4ee2-a9c7-29a6abb07da1 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:29.862845 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-aa2dac5a-ee98-4ee2-a9c7-29a6abb07da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:29.919955 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dac5a-ee98-4ee2-a9c7-29a6abb07da1 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:29.923634 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dad8a-5bbc-44c4-b1dc-e836b118e376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:29.924272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dad8a-5bbc-44c4-b1dc-e836b118e376 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:29.924574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dad8a-5bbc-44c4-b1dc-e836b118e376 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:29.924854 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dad8a-5bbc-44c4-b1dc-e836b118e376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:29.933692 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4dad8a-5bbc-44c4-b1dc-e836b118e376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:29.935152 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4dad8a-5bbc-44c4-b1dc-e836b118e376 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:29.944327 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1292/2591] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:07:30.198470 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b84846-b0f6-4b98-9ea1-13f6170014ea None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:30.204604 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-52b84846-b0f6-4b98-9ea1-13f6170014ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:30.213154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b84846-b0f6-4b98-9ea1-13f6170014ea None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:30.217709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d8654-10bb-4302-9792-6ff29592d14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:30.218589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d8654-10bb-4302-9792-6ff29592d14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:30.218882 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d8654-10bb-4302-9792-6ff29592d14d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:30.219139 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d8654-10bb-4302-9792-6ff29592d14d admin admin] PATH_INFO: `/v3/projects/bf10cbabc96c46019a4a6ac5e0617d6a` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:30.220311 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d8654-10bb-4302-9792-6ff29592d14d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf10cbabc96c46019a4a6ac5e0617d6a)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:30.222304 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d8654-10bb-4302-9792-6ff29592d14d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:30.268251 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-bc4d8654-10bb-4302-9792-6ff29592d14d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf10cbabc96c46019a4a6ac5e0617d6a', 'request_id': 'req-bc4d8654-10bb-4302-9792-6ff29592d14d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:30.275345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-bc4d8654-10bb-4302-9792-6ff29592d14d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf10cbabc96c46019a4a6ac5e0617d6a', 'request_id': 'req-bc4d8654-10bb-4302-9792-6ff29592d14d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:30.281504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-bc4d8654-10bb-4302-9792-6ff29592d14d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf10cbabc96c46019a4a6ac5e0617d6a', 'request_id': 'req-bc4d8654-10bb-4302-9792-6ff29592d14d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:30.291948 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-bc4d8654-10bb-4302-9792-6ff29592d14d admin admin] The token cache is being invalidate because project bf10cbabc96c46019a4a6ac5e0617d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:07:30.292250 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-bc4d8654-10bb-4302-9792-6ff29592d14d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:30.292897 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-bc4d8654-10bb-4302-9792-6ff29592d14d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:30.294485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1300/2592] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:07:30 2021] DELETE /identity/v3/projects/bf10cbabc96c46019a4a6ac5e0617d6a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:30.298462 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dad8a-5bbc-44c4-b1dc-e836b118e376 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:30.307801 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dad8a-5bbc-44c4-b1dc-e836b118e376 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:30.361554 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef391d-cbf9-4e21-8378-4187a5e934a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:30.362435 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef391d-cbf9-4e21-8378-4187a5e934a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:30.362716 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef391d-cbf9-4e21-8378-4187a5e934a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:30.362989 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef391d-cbf9-4e21-8378-4187a5e934a6 admin admin] PATH_INFO: `/v3/users/6b6556d8dbeb45ef99d99632fb66b1b7` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:30.364198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef391d-cbf9-4e21-8378-4187a5e934a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6556d8dbeb45ef99d99632fb66b1b7)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:30.366173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef391d-cbf9-4e21-8378-4187a5e934a6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:30.411989 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-78ef391d-cbf9-4e21-8378-4187a5e934a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6556d8dbeb45ef99d99632fb66b1b7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:30.423769 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-78ef391d-cbf9-4e21-8378-4187a5e934a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6556d8dbeb45ef99d99632fb66b1b7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:30.430764 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-78ef391d-cbf9-4e21-8378-4187a5e934a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6556d8dbeb45ef99d99632fb66b1b7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:30.437839 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-78ef391d-cbf9-4e21-8378-4187a5e934a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6556d8dbeb45ef99d99632fb66b1b7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:30.438511 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-78ef391d-cbf9-4e21-8378-4187a5e934a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6556d8dbeb45ef99d99632fb66b1b7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:30.444246 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1293/2593] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:07:30 2021] DELETE /identity/v3/users/6b6556d8dbeb45ef99d99632fb66b1b7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:30.705313 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d8654-10bb-4302-9792-6ff29592d14d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:30.706724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-bc4d8654-10bb-4302-9792-6ff29592d14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:30.720686 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d8654-10bb-4302-9792-6ff29592d14d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:30.776013 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a99b7-c7ce-4f69-9ec3-4d2e3790f3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:30.776870 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a99b7-c7ce-4f69-9ec3-4d2e3790f3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:30.777155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a99b7-c7ce-4f69-9ec3-4d2e3790f3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:30.777435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a99b7-c7ce-4f69-9ec3-4d2e3790f3ec admin admin] PATH_INFO: `/v3/projects/167900db94a446b4b8513b1af3d11fa1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:30.778631 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a99b7-c7ce-4f69-9ec3-4d2e3790f3ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=167900db94a446b4b8513b1af3d11fa1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:30.781079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a99b7-c7ce-4f69-9ec3-4d2e3790f3ec admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:30.825101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e23a99b7-c7ce-4f69-9ec3-4d2e3790f3ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167900db94a446b4b8513b1af3d11fa1', 'request_id': 'req-e23a99b7-c7ce-4f69-9ec3-4d2e3790f3ec'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:30.831770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e23a99b7-c7ce-4f69-9ec3-4d2e3790f3ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167900db94a446b4b8513b1af3d11fa1', 'request_id': 'req-e23a99b7-c7ce-4f69-9ec3-4d2e3790f3ec'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:30.837637 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e23a99b7-c7ce-4f69-9ec3-4d2e3790f3ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167900db94a446b4b8513b1af3d11fa1', 'request_id': 'req-e23a99b7-c7ce-4f69-9ec3-4d2e3790f3ec'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:30.847874 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e23a99b7-c7ce-4f69-9ec3-4d2e3790f3ec admin admin] The token cache is being invalidate because project 167900db94a446b4b8513b1af3d11fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:07:30.848157 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e23a99b7-c7ce-4f69-9ec3-4d2e3790f3ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:30.848780 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e23a99b7-c7ce-4f69-9ec3-4d2e3790f3ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:07:30.850316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1301/2594] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:07:30 2021] DELETE /identity/v3/projects/167900db94a446b4b8513b1af3d11fa1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:30.856116 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4430f3-5fa1-4067-ba2e-1035d7e4e15b None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:30.856590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4430f3-5fa1-4067-ba2e-1035d7e4e15b None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:30.856685 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4430f3-5fa1-4067-ba2e-1035d7e4e15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:30.875145 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-cd4430f3-5fa1-4067-ba2e-1035d7e4e15b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:30.876413 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-cd4430f3-5fa1-4067-ba2e-1035d7e4e15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:30.933261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1294/2595] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:30.942269 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b57e53-63e2-4dd9-a46a-855a4eec16a2 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:30.942560 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b57e53-63e2-4dd9-a46a-855a4eec16a2 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:30.942840 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b57e53-63e2-4dd9-a46a-855a4eec16a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:30.961487 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-04b57e53-63e2-4dd9-a46a-855a4eec16a2 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:30.963530 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-04b57e53-63e2-4dd9-a46a-855a4eec16a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:30.974196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1302/2596] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:30.978521 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4430f3-5fa1-4067-ba2e-1035d7e4e15b None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:30.988520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4430f3-5fa1-4067-ba2e-1035d7e4e15b None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:30.993671 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da631404-4496-44b7-8290-815312ca2d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:30.994362 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da631404-4496-44b7-8290-815312ca2d75 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:30.994629 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da631404-4496-44b7-8290-815312ca2d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:30.994905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da631404-4496-44b7-8290-815312ca2d75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:30.995637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da631404-4496-44b7-8290-815312ca2d75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:07:30.995943 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da631404-4496-44b7-8290-815312ca2d75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:30.997539 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da631404-4496-44b7-8290-815312ca2d75 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:31.009020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1295/2597] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:07:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 03:07:31.013223 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b57e53-63e2-4dd9-a46a-855a4eec16a2 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:31.022421 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b57e53-63e2-4dd9-a46a-855a4eec16a2 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:31.027020 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62606d2-8f3e-4f1d-8854-cf6644fea1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:31.027661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62606d2-8f3e-4f1d-8854-cf6644fea1cd admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:31.027954 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62606d2-8f3e-4f1d-8854-cf6644fea1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:31.028215 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62606d2-8f3e-4f1d-8854-cf6644fea1cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:31.028988 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62606d2-8f3e-4f1d-8854-cf6644fea1cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:31.031513 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62606d2-8f3e-4f1d-8854-cf6644fea1cd admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:31.059357 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1303/2598] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:07:31 2021] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:07:31.063496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da631404-4496-44b7-8290-815312ca2d75 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:31.073185 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da631404-4496-44b7-8290-815312ca2d75 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:31.127276 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7815a0e-4c9f-47f0-9233-92132c73f6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:31.127968 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7815a0e-4c9f-47f0-9233-92132c73f6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:31.128254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7815a0e-4c9f-47f0-9233-92132c73f6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:31.128533 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7815a0e-4c9f-47f0-9233-92132c73f6c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:31.129224 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7815a0e-4c9f-47f0-9233-92132c73f6c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:31.131172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7815a0e-4c9f-47f0-9233-92132c73f6c5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:31.150788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1296/2599] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:07:31 2021] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:07:31.154050 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62606d2-8f3e-4f1d-8854-cf6644fea1cd admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:31.164427 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62606d2-8f3e-4f1d-8854-cf6644fea1cd admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:31.168939 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37f40c-f29b-4793-a501-88f967a0f562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:31.169575 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37f40c-f29b-4793-a501-88f967a0f562 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:31.169859 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37f40c-f29b-4793-a501-88f967a0f562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:31.170164 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37f40c-f29b-4793-a501-88f967a0f562 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:31.170887 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37f40c-f29b-4793-a501-88f967a0f562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:31.173176 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37f40c-f29b-4793-a501-88f967a0f562 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:31.183081 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1304/2600] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:31.186753 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7815a0e-4c9f-47f0-9233-92132c73f6c5 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:31.196480 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7815a0e-4c9f-47f0-9233-92132c73f6c5 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:31.201187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050315c-970c-4664-b276-cff0713fc1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:31.201867 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050315c-970c-4664-b276-cff0713fc1eb admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:31.202185 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050315c-970c-4664-b276-cff0713fc1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:31.202978 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050315c-970c-4664-b276-cff0713fc1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:31.203717 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050315c-970c-4664-b276-cff0713fc1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:31.205546 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050315c-970c-4664-b276-cff0713fc1eb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:31.215677 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1297/2601] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:07:31 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:07:31.220234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37f40c-f29b-4793-a501-88f967a0f562 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:31.229742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37f40c-f29b-4793-a501-88f967a0f562 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:31.234340 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74943ae7-0c6f-41e3-a421-f246010a6fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:31.235204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74943ae7-0c6f-41e3-a421-f246010a6fac admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:31.235479 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74943ae7-0c6f-41e3-a421-f246010a6fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:31.235753 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74943ae7-0c6f-41e3-a421-f246010a6fac admin admin] PATH_INFO: `/v3/projects/9ca6934bc24846ad82474c4ef7ba6323/users/e4ffcca165af40abbd93569e7f01acbe/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:31.249676 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74943ae7-0c6f-41e3-a421-f246010a6fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca6934bc24846ad82474c4ef7ba6323, user_id=e4ffcca165af40abbd93569e7f01acbe, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:31.252297 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74943ae7-0c6f-41e3-a421-f246010a6fac admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:31.264565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1305/2602] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:07:31 2021] PUT /identity/v3/projects/9ca6934bc24846ad82474c4ef7ba6323/users/e4ffcca165af40abbd93569e7f01acbe/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:07:31.269921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0061-ec64-4ace-a10e-876806b653b1 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:31.270299 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0061-ec64-4ace-a10e-876806b653b1 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:31.270572 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0061-ec64-4ace-a10e-876806b653b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:31.288058 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-874d0061-ec64-4ace-a10e-876806b653b1 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:31.289297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-874d0061-ec64-4ace-a10e-876806b653b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:31.344669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1298/2603] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:31.354307 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74943ae7-0c6f-41e3-a421-f246010a6fac admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:31.355968 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-74943ae7-0c6f-41e3-a421-f246010a6fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:31.411204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74943ae7-0c6f-41e3-a421-f246010a6fac admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:31.414804 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb964d-da26-4573-91b8-dad356a225e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:31.415436 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb964d-da26-4573-91b8-dad356a225e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:31.415718 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb964d-da26-4573-91b8-dad356a225e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:31.415994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb964d-da26-4573-91b8-dad356a225e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:31.424906 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb964d-da26-4573-91b8-dad356a225e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:31.426343 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb964d-da26-4573-91b8-dad356a225e6 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:31.435535 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1306/2604] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:07:32.014348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b68ced-b405-4af4-b916-2b9f543e5624 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:32.014882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b68ced-b405-4af4-b916-2b9f543e5624 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:32.014882 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b68ced-b405-4af4-b916-2b9f543e5624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:32.041247 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-77b68ced-b405-4af4-b916-2b9f543e5624 None None] MFA Rules not processed for user `e4ffcca165af40abbd93569e7f01acbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:32.042510 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-77b68ced-b405-4af4-b916-2b9f543e5624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:32.105395 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1299/2605] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:32 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:07:32.115947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb964d-da26-4573-91b8-dad356a225e6 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:07:32.117362 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-1aeb964d-da26-4573-91b8-dad356a225e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:32.178951 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb964d-da26-4573-91b8-dad356a225e6 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:07:32.182542 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3a772-431c-4609-bf26-716d56a4da08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:07:32.183197 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3a772-431c-4609-bf26-716d56a4da08 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:32.183481 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3a772-431c-4609-bf26-716d56a4da08 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:32.183762 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3a772-431c-4609-bf26-716d56a4da08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:32.193319 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3a772-431c-4609-bf26-716d56a4da08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:07:32.194792 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3a772-431c-4609-bf26-716d56a4da08 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:07:32.204716 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1307/2606] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:07:32 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:07:33.533744 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247e6ea-834d-4798-9ece-3870bfcf9c5f None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:07:33.534316 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247e6ea-834d-4798-9ece-3870bfcf9c5f None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:07:33.534424 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247e6ea-834d-4798-9ece-3870bfcf9c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:07:33.552020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-1247e6ea-834d-4798-9ece-3870bfcf9c5f None None] MFA Rules not processed for user `e4ffcca165af40abbd93569e7f01acbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:07:33.553200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1247e6ea-834d-4798-9ece-3870bfcf9c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:07:33.559963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1300/2607] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:07:33 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:08:07.690271 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3a772-431c-4609-bf26-716d56a4da08 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:08:07.699519 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3a772-431c-4609-bf26-716d56a4da08 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:08:07.703167 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c76992-e554-47eb-a475-94406ea6f6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:08:07.703795 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c76992-e554-47eb-a475-94406ea6f6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:08:07.704077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c76992-e554-47eb-a475-94406ea6f6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:08:07.704352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c76992-e554-47eb-a475-94406ea6f6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:08:07.706100 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-00c76992-e554-47eb-a475-94406ea6f6e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:08:07.774395 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c76992-e554-47eb-a475-94406ea6f6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:08:07.775812 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c76992-e554-47eb-a475-94406ea6f6e8 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:08:07.787127 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1308/2608] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:08:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:08:08.955702 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247e6ea-834d-4798-9ece-3870bfcf9c5f None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:08:08.957129 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1247e6ea-834d-4798-9ece-3870bfcf9c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:08:08.969159 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247e6ea-834d-4798-9ece-3870bfcf9c5f None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:08:08.972685 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1769cab-57f8-4c64-94a9-213886ffb6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:08:08.973306 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1769cab-57f8-4c64-94a9-213886ffb6af service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:08:08.973587 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1769cab-57f8-4c64-94a9-213886ffb6af service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:08:08.974565 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1769cab-57f8-4c64-94a9-213886ffb6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:08:08.976292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e1769cab-57f8-4c64-94a9-213886ffb6af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:08:08.988928 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1769cab-57f8-4c64-94a9-213886ffb6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:08:08.990377 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1769cab-57f8-4c64-94a9-213886ffb6af service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:08:09.001040 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1301/2609] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:08:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:09:03.625523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c76992-e554-47eb-a475-94406ea6f6e8 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:09:03.636858 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c76992-e554-47eb-a475-94406ea6f6e8 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:09:03.640553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48d4ff-5c9c-42a3-aa36-a326656975c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:09:03.641178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48d4ff-5c9c-42a3-aa36-a326656975c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:09:03.641458 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48d4ff-5c9c-42a3-aa36-a326656975c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:09:03.641732 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48d4ff-5c9c-42a3-aa36-a326656975c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:09:03.643476 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7f48d4ff-5c9c-42a3-aa36-a326656975c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:09:03.652611 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48d4ff-5c9c-42a3-aa36-a326656975c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:09:03.654027 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48d4ff-5c9c-42a3-aa36-a326656975c4 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:09:03.661522 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1309/2610] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:09:03 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:09:10.501183 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1769cab-57f8-4c64-94a9-213886ffb6af service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:09:10.503350 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e1769cab-57f8-4c64-94a9-213886ffb6af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:09:10.519926 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1769cab-57f8-4c64-94a9-213886ffb6af service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:09:10.527592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffec67-8a60-4743-ae10-9f53f78720da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:09:10.528238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffec67-8a60-4743-ae10-9f53f78720da service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:09:10.528520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffec67-8a60-4743-ae10-9f53f78720da service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:09:10.528794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffec67-8a60-4743-ae10-9f53f78720da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:09:10.530699 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-21ffec67-8a60-4743-ae10-9f53f78720da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:09:10.543976 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffec67-8a60-4743-ae10-9f53f78720da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:09:10.545648 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffec67-8a60-4743-ae10-9f53f78720da service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:09:10.557364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1302/2611] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:09:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:09:28.534136 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48d4ff-5c9c-42a3-aa36-a326656975c4 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:09:28.548900 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48d4ff-5c9c-42a3-aa36-a326656975c4 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:09:28.559569 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2326b-e9e6-426c-9c88-ecac8af2efdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:09:28.560324 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2326b-e9e6-426c-9c88-ecac8af2efdc service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:09:28.560608 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2326b-e9e6-426c-9c88-ecac8af2efdc service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:09:28.561122 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2326b-e9e6-426c-9c88-ecac8af2efdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:09:28.563466 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-41a2326b-e9e6-426c-9c88-ecac8af2efdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:09:28.576644 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2326b-e9e6-426c-9c88-ecac8af2efdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:09:28.578257 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2326b-e9e6-426c-9c88-ecac8af2efdc service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:09:28.589659 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1310/2612] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:09:28 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:09:36.263743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffec67-8a60-4743-ae10-9f53f78720da service nova] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:09:36.275172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffec67-8a60-4743-ae10-9f53f78720da service nova] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:09:36.280597 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5edb6e-8d16-4072-8f96-b0449c3a3b3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:09:36.281213 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5edb6e-8d16-4072-8f96-b0449c3a3b3a service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:09:36.281494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5edb6e-8d16-4072-8f96-b0449c3a3b3a service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:09:36.281769 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5edb6e-8d16-4072-8f96-b0449c3a3b3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:09:36.283522 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-7d5edb6e-8d16-4072-8f96-b0449c3a3b3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:09:36.339333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5edb6e-8d16-4072-8f96-b0449c3a3b3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:09:36.340898 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5edb6e-8d16-4072-8f96-b0449c3a3b3a service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:09:36.349616 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1303/2613] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:09:36 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:10:55.608952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2326b-e9e6-426c-9c88-ecac8af2efdc service nova] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:10:55.610579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-41a2326b-e9e6-426c-9c88-ecac8af2efdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:10:55.624822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2326b-e9e6-426c-9c88-ecac8af2efdc service nova] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:10:55.630517 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70085f86-f6b4-4ec0-8c1f-7e522547f584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:10:55.631153 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70085f86-f6b4-4ec0-8c1f-7e522547f584 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:10:55.631435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70085f86-f6b4-4ec0-8c1f-7e522547f584 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:10:55.631709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70085f86-f6b4-4ec0-8c1f-7e522547f584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:10:55.633895 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-70085f86-f6b4-4ec0-8c1f-7e522547f584 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:10:55.696205 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70085f86-f6b4-4ec0-8c1f-7e522547f584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:10:55.697805 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70085f86-f6b4-4ec0-8c1f-7e522547f584 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:10:55.706952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1311/2614] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:10:55 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:11:27.315342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5edb6e-8d16-4072-8f96-b0449c3a3b3a service nova] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:11:27.326642 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5edb6e-8d16-4072-8f96-b0449c3a3b3a service nova] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:11:27.332447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c44265-2655-43c3-a134-8a912bf4aebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:11:27.332765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c44265-2655-43c3-a134-8a912bf4aebe service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:11:27.332952 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c44265-2655-43c3-a134-8a912bf4aebe service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:11:27.333226 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c44265-2655-43c3-a134-8a912bf4aebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:11:27.334988 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-47c44265-2655-43c3-a134-8a912bf4aebe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:11:27.390999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c44265-2655-43c3-a134-8a912bf4aebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:11:27.392579 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c44265-2655-43c3-a134-8a912bf4aebe service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:11:27.402333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1304/2615] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:11:27 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:12:28.154333 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70085f86-f6b4-4ec0-8c1f-7e522547f584 service nova] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:12:28.155732 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-70085f86-f6b4-4ec0-8c1f-7e522547f584 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:12:28.229657 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70085f86-f6b4-4ec0-8c1f-7e522547f584 service nova] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:12:28.234720 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c50cd-1b6c-4877-97f5-93eb6544dda9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93762c21f03d44d5bf3881d17e14ef90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:12:28.235353 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c50cd-1b6c-4877-97f5-93eb6544dda9 service placement] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:12:28.235635 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c50cd-1b6c-4877-97f5-93eb6544dda9 service placement] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:12:28.235911 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c50cd-1b6c-4877-97f5-93eb6544dda9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:12:28.237912 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-1f1c50cd-1b6c-4877-97f5-93eb6544dda9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:12:28.249328 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c50cd-1b6c-4877-97f5-93eb6544dda9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:12:28.250992 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c50cd-1b6c-4877-97f5-93eb6544dda9 service placement] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:12:28.261467 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1312/2616] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:12:28 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:13:08.043774 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c44265-2655-43c3-a134-8a912bf4aebe service nova] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:13:08.053005 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c44265-2655-43c3-a134-8a912bf4aebe service nova] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:13:08.056563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce0e02-467d-4497-8299-5c3a96e39c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:13:08.057189 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce0e02-467d-4497-8299-5c3a96e39c94 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:13:08.057473 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce0e02-467d-4497-8299-5c3a96e39c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:13:08.057746 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce0e02-467d-4497-8299-5c3a96e39c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:13:08.067628 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce0e02-467d-4497-8299-5c3a96e39c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:13:08.069041 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce0e02-467d-4497-8299-5c3a96e39c94 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:13:08.080075 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1305/2617] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:13:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:13:09.181302 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c50cd-1b6c-4877-97f5-93eb6544dda9 service placement] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:13:09.191094 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c50cd-1b6c-4877-97f5-93eb6544dda9 service placement] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:13:09.194601 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af42b3f-d409-4996-8601-c2fed26d5c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:13:09.195217 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af42b3f-d409-4996-8601-c2fed26d5c00 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:13:09.195494 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af42b3f-d409-4996-8601-c2fed26d5c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:13:09.195766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af42b3f-d409-4996-8601-c2fed26d5c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:13:09.208991 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af42b3f-d409-4996-8601-c2fed26d5c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:13:09.210771 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af42b3f-d409-4996-8601-c2fed26d5c00 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:13:09.222496 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1313/2618] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:13:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:13:10.652897 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce0e02-467d-4497-8299-5c3a96e39c94 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:13:10.662125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce0e02-467d-4497-8299-5c3a96e39c94 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:13:10.666358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ba40e-c59c-4e83-a272-aaacd945090d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:13:10.666980 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ba40e-c59c-4e83-a272-aaacd945090d service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:13:10.667278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ba40e-c59c-4e83-a272-aaacd945090d service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:13:10.667551 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ba40e-c59c-4e83-a272-aaacd945090d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:13:10.675516 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ba40e-c59c-4e83-a272-aaacd945090d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:13:10.676927 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ba40e-c59c-4e83-a272-aaacd945090d service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:13:10.685420 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1306/2619] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:13:10 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:13:10.709113 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af42b3f-d409-4996-8601-c2fed26d5c00 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:13:10.718477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af42b3f-d409-4996-8601-c2fed26d5c00 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:13:10.721969 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfae25-32f5-453d-b5e8-a2725ff0df64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:13:10.722612 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfae25-32f5-453d-b5e8-a2725ff0df64 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:13:10.722891 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfae25-32f5-453d-b5e8-a2725ff0df64 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:13:10.723167 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfae25-32f5-453d-b5e8-a2725ff0df64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:13:10.724881 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4dcfae25-32f5-453d-b5e8-a2725ff0df64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:13:10.780221 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcfae25-32f5-453d-b5e8-a2725ff0df64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:13:10.781638 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcfae25-32f5-453d-b5e8-a2725ff0df64 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:13:10.790864 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1314/2620] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:13:10 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:14:23.846389 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ba40e-c59c-4e83-a272-aaacd945090d service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:14:23.856122 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ba40e-c59c-4e83-a272-aaacd945090d service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:14:23.859689 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb956cd-36d6-4d55-af16-092b01cad31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:14:23.860307 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb956cd-36d6-4d55-af16-092b01cad31e service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:14:23.860853 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb956cd-36d6-4d55-af16-092b01cad31e service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:14:23.861131 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb956cd-36d6-4d55-af16-092b01cad31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:14:23.868037 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb956cd-36d6-4d55-af16-092b01cad31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:14:23.869445 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb956cd-36d6-4d55-af16-092b01cad31e service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:14:23.877312 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1307/2621] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:14:23 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:14:54.674224 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfae25-32f5-453d-b5e8-a2725ff0df64 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:14:54.686556 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfae25-32f5-453d-b5e8-a2725ff0df64 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:14:54.692548 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e78a0c-a8b5-4b49-9704-5c1cae2a6a4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:14:54.693255 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e78a0c-a8b5-4b49-9704-5c1cae2a6a4a service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:14:54.693761 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e78a0c-a8b5-4b49-9704-5c1cae2a6a4a service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:14:54.694316 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e78a0c-a8b5-4b49-9704-5c1cae2a6a4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:14:54.697110 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-95e78a0c-a8b5-4b49-9704-5c1cae2a6a4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:14:54.710251 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e78a0c-a8b5-4b49-9704-5c1cae2a6a4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:14:54.712019 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e78a0c-a8b5-4b49-9704-5c1cae2a6a4a service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:14:54.723309 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1315/2622] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:14:54 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:15:10.588830 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb956cd-36d6-4d55-af16-092b01cad31e service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:15:10.590792 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-feb956cd-36d6-4d55-af16-092b01cad31e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:15:10.602335 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb956cd-36d6-4d55-af16-092b01cad31e service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:15:10.606476 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c05496-a88d-4b22-97c2-80540e673f27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:15:10.607102 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c05496-a88d-4b22-97c2-80540e673f27 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:15:10.607384 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c05496-a88d-4b22-97c2-80540e673f27 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:15:10.608020 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c05496-a88d-4b22-97c2-80540e673f27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:15:10.616598 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c05496-a88d-4b22-97c2-80540e673f27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:15:10.618035 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c05496-a88d-4b22-97c2-80540e673f27 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:15:10.644876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1308/2623] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:15:10 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:15:55.566451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e78a0c-a8b5-4b49-9704-5c1cae2a6a4a service nova] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:15:55.577314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e78a0c-a8b5-4b49-9704-5c1cae2a6a4a service nova] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:15:55.582736 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a8a9a-5a1a-49f9-a18e-fb0b1aa2b157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:15:55.583377 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a8a9a-5a1a-49f9-a18e-fb0b1aa2b157 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:15:55.583659 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a8a9a-5a1a-49f9-a18e-fb0b1aa2b157 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:15:55.583936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a8a9a-5a1a-49f9-a18e-fb0b1aa2b157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:15:55.592052 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a8a9a-5a1a-49f9-a18e-fb0b1aa2b157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:15:55.593555 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a8a9a-5a1a-49f9-a18e-fb0b1aa2b157 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:15:55.621155 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1316/2624] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:15:55 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:17:10.677952 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c05496-a88d-4b22-97c2-80540e673f27 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:17:10.712975 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c05496-a88d-4b22-97c2-80540e673f27 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:17:10.716724 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42983a2-5428-41d8-80a7-7903c9573c20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:17:10.717411 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42983a2-5428-41d8-80a7-7903c9573c20 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:17:10.717696 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42983a2-5428-41d8-80a7-7903c9573c20 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:17:10.717969 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42983a2-5428-41d8-80a7-7903c9573c20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:17:10.739202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42983a2-5428-41d8-80a7-7903c9573c20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:17:10.740614 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42983a2-5428-41d8-80a7-7903c9573c20 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:17:10.766340 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1309/2625] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:17:10 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:17:35.151829 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61373d25-cff0-40ff-b4bd-d38ecd97e8ed None None] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:17:35.152268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61373d25-cff0-40ff-b4bd-d38ecd97e8ed None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:17:35.152397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61373d25-cff0-40ff-b4bd-d38ecd97e8ed None None] PATH_INFO: `/` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:17:35.154211 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1317/2626] 10.222.0.18 () {54 vars in 960 bytes} [Wed Dec 15 03:17:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 03:17:35.159438 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd268a23-d029-4da5-bab0-9bd58a029f84 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:17:35.159842 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd268a23-d029-4da5-bab0-9bd58a029f84 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:17:35.159989 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd268a23-d029-4da5-bab0-9bd58a029f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:17:35.235664 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-bd268a23-d029-4da5-bab0-9bd58a029f84 None None] MFA Rules not processed for user `93762c21f03d44d5bf3881d17e14ef90`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:17:35.236845 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-bd268a23-d029-4da5-bab0-9bd58a029f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:17:35.260558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1310/2627] 10.222.0.18 () {58 vars in 1057 bytes} [Wed Dec 15 03:17:35 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:17:35.270507 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61373d25-cff0-40ff-b4bd-d38ecd97e8ed None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:17:35.283360 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61373d25-cff0-40ff-b4bd-d38ecd97e8ed None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:17:35.288223 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a3cd9-a3ab-4930-9f1f-0a119362edcf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93762c21f03d44d5bf3881d17e14ef90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:17:35.288971 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a3cd9-a3ab-4930-9f1f-0a119362edcf service placement] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:17:35.289284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a3cd9-a3ab-4930-9f1f-0a119362edcf service placement] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:17:35.289541 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a3cd9-a3ab-4930-9f1f-0a119362edcf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:17:35.298780 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a3cd9-a3ab-4930-9f1f-0a119362edcf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:17:35.300345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a3cd9-a3ab-4930-9f1f-0a119362edcf service placement] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:17:35.309728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1318/2628] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:17:35 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:19:11.330838 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd268a23-d029-4da5-bab0-9bd58a029f84 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:19:11.332454 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-bd268a23-d029-4da5-bab0-9bd58a029f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:19:11.398335 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd268a23-d029-4da5-bab0-9bd58a029f84 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:19:11.401900 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d39194-dc22-4d70-b74b-5bc49ffa7317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:19:11.402570 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d39194-dc22-4d70-b74b-5bc49ffa7317 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:19:11.402844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d39194-dc22-4d70-b74b-5bc49ffa7317 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:19:11.403113 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d39194-dc22-4d70-b74b-5bc49ffa7317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:19:11.411307 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d39194-dc22-4d70-b74b-5bc49ffa7317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:19:11.412710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d39194-dc22-4d70-b74b-5bc49ffa7317 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:19:11.438708 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1311/2629] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:19:11 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:19:11.483474 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a3cd9-a3ab-4930-9f1f-0a119362edcf service placement] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:19:11.493227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a3cd9-a3ab-4930-9f1f-0a119362edcf service placement] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:19:11.496766 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb0117-3b97-4deb-8dc2-beab846e0950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:19:11.497386 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb0117-3b97-4deb-8dc2-beab846e0950 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:19:11.497669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb0117-3b97-4deb-8dc2-beab846e0950 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:19:11.497948 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb0117-3b97-4deb-8dc2-beab846e0950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:19:11.500404 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-2cfb0117-3b97-4deb-8dc2-beab846e0950 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:19:11.583911 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb0117-3b97-4deb-8dc2-beab846e0950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:19:11.585332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb0117-3b97-4deb-8dc2-beab846e0950 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:19:11.604940 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1319/2630] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:19:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:19:11.612975 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d39194-dc22-4d70-b74b-5bc49ffa7317 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:19:11.621162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d39194-dc22-4d70-b74b-5bc49ffa7317 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:19:11.624666 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c32751-7ec3-4b54-b3a1-42eecd70162c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:19:11.625305 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c32751-7ec3-4b54-b3a1-42eecd70162c service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:19:11.625578 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c32751-7ec3-4b54-b3a1-42eecd70162c service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:19:11.625847 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c32751-7ec3-4b54-b3a1-42eecd70162c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:19:11.627821 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-30c32751-7ec3-4b54-b3a1-42eecd70162c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:19:11.702732 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c32751-7ec3-4b54-b3a1-42eecd70162c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:19:11.704160 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c32751-7ec3-4b54-b3a1-42eecd70162c service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:19:11.721741 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1312/2631] 10.222.0.18 () {60 vars in 1396 bytes} [Wed Dec 15 03:19:11 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:19:11.762369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb0117-3b97-4deb-8dc2-beab846e0950 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:19:11.771006 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb0117-3b97-4deb-8dc2-beab846e0950 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:19:11.774779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf54e7-9d6f-424f-8025-488a81f01a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:19:11.775479 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf54e7-9d6f-424f-8025-488a81f01a24 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:19:11.775758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf54e7-9d6f-424f-8025-488a81f01a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:19:11.776030 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf54e7-9d6f-424f-8025-488a81f01a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:19:11.778096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4ddf54e7-9d6f-424f-8025-488a81f01a24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:19:11.793359 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf54e7-9d6f-424f-8025-488a81f01a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:19:11.794807 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf54e7-9d6f-424f-8025-488a81f01a24 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:19:11.807593 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1320/2632] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:19:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:19:28.849743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c32751-7ec3-4b54-b3a1-42eecd70162c service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:19:28.851417 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-30c32751-7ec3-4b54-b3a1-42eecd70162c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:19:28.923782 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c32751-7ec3-4b54-b3a1-42eecd70162c service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:19:28.927331 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f7b71-aba1-477d-ab04-7431107d31b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:19:28.927956 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f7b71-aba1-477d-ab04-7431107d31b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:19:28.928230 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f7b71-aba1-477d-ab04-7431107d31b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:19:28.928498 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f7b71-aba1-477d-ab04-7431107d31b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:19:28.930343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e19f7b71-aba1-477d-ab04-7431107d31b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:19:28.940026 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f7b71-aba1-477d-ab04-7431107d31b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:19:28.941434 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f7b71-aba1-477d-ab04-7431107d31b2 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:19:28.949100 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1313/2633] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:19:28 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:21:10.860843 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf54e7-9d6f-424f-8025-488a81f01a24 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:21:10.869046 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf54e7-9d6f-424f-8025-488a81f01a24 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:21:10.872611 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14edd22-01bc-4456-b9af-1016b2b4127c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:21:10.873234 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14edd22-01bc-4456-b9af-1016b2b4127c service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:21:10.873515 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14edd22-01bc-4456-b9af-1016b2b4127c service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:21:10.873787 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14edd22-01bc-4456-b9af-1016b2b4127c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:21:10.876179 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b14edd22-01bc-4456-b9af-1016b2b4127c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:21:10.942358 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14edd22-01bc-4456-b9af-1016b2b4127c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:21:10.943772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14edd22-01bc-4456-b9af-1016b2b4127c service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:21:10.952308 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1321/2634] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:21:10 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:21:12.202113 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f7b71-aba1-477d-ab04-7431107d31b2 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:21:12.212189 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f7b71-aba1-477d-ab04-7431107d31b2 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:21:12.215712 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f77b62-e4c2-43d5-b162-8b21f6c566be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:21:12.216341 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f77b62-e4c2-43d5-b162-8b21f6c566be service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:21:12.216646 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f77b62-e4c2-43d5-b162-8b21f6c566be service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:21:12.216917 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f77b62-e4c2-43d5-b162-8b21f6c566be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:21:12.219562 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-75f77b62-e4c2-43d5-b162-8b21f6c566be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:21:12.285999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f77b62-e4c2-43d5-b162-8b21f6c566be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:21:12.287366 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f77b62-e4c2-43d5-b162-8b21f6c566be service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:21:12.296043 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1314/2635] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:21:12 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:22:40.201580 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14edd22-01bc-4456-b9af-1016b2b4127c service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:22:40.203164 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b14edd22-01bc-4456-b9af-1016b2b4127c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:22:40.269233 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14edd22-01bc-4456-b9af-1016b2b4127c service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:22:40.274158 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58b9ed-a4bb-44ab-9b01-74b2c7a911c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93762c21f03d44d5bf3881d17e14ef90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:22:40.274791 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58b9ed-a4bb-44ab-9b01-74b2c7a911c1 service placement] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:22:40.275097 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58b9ed-a4bb-44ab-9b01-74b2c7a911c1 service placement] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:22:40.275381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58b9ed-a4bb-44ab-9b01-74b2c7a911c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:22:40.277227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-fd58b9ed-a4bb-44ab-9b01-74b2c7a911c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:22:40.288640 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58b9ed-a4bb-44ab-9b01-74b2c7a911c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:22:40.290235 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58b9ed-a4bb-44ab-9b01-74b2c7a911c1 service placement] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:22:40.300442 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1322/2636] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:22:40 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:23:11.022176 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f77b62-e4c2-43d5-b162-8b21f6c566be service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:23:11.031409 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f77b62-e4c2-43d5-b162-8b21f6c566be service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:23:11.036026 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ece0e-1004-4277-8f52-0e70365b5d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:23:11.036665 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ece0e-1004-4277-8f52-0e70365b5d24 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:23:11.036949 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ece0e-1004-4277-8f52-0e70365b5d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:23:11.037225 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ece0e-1004-4277-8f52-0e70365b5d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:23:11.039130 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e80ece0e-1004-4277-8f52-0e70365b5d24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:23:11.107794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ece0e-1004-4277-8f52-0e70365b5d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:23:11.109219 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ece0e-1004-4277-8f52-0e70365b5d24 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:23:11.118322 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1315/2637] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:23:11 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:24:36.851060 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58b9ed-a4bb-44ab-9b01-74b2c7a911c1 service placement] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:24:36.860249 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58b9ed-a4bb-44ab-9b01-74b2c7a911c1 service placement] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:24:36.863728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac849a1a-00c7-4802-8995-cc83bc472b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:24:36.864346 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac849a1a-00c7-4802-8995-cc83bc472b00 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:24:36.864623 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac849a1a-00c7-4802-8995-cc83bc472b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:24:36.864894 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac849a1a-00c7-4802-8995-cc83bc472b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:24:36.871781 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac849a1a-00c7-4802-8995-cc83bc472b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:24:36.873173 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac849a1a-00c7-4802-8995-cc83bc472b00 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:24:36.881247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1323/2638] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:24:36 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:25:11.150278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ece0e-1004-4277-8f52-0e70365b5d24 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:25:11.151825 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e80ece0e-1004-4277-8f52-0e70365b5d24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:25:11.163011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ece0e-1004-4277-8f52-0e70365b5d24 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:25:11.166552 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80c0a4-b0b9-40b5-b539-414b0077c371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:25:11.167171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80c0a4-b0b9-40b5-b539-414b0077c371 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:25:11.167449 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80c0a4-b0b9-40b5-b539-414b0077c371 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:25:11.167720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80c0a4-b0b9-40b5-b539-414b0077c371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:25:11.177610 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80c0a4-b0b9-40b5-b539-414b0077c371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:25:11.179053 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80c0a4-b0b9-40b5-b539-414b0077c371 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:25:11.190104 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1316/2639] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:25:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:25:11.197324 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac849a1a-00c7-4802-8995-cc83bc472b00 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:25:11.211197 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac849a1a-00c7-4802-8995-cc83bc472b00 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:25:11.214903 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8748daa-e9d1-4ce2-9c8a-97096bc68901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:25:11.216920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8748daa-e9d1-4ce2-9c8a-97096bc68901 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:25:11.216920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8748daa-e9d1-4ce2-9c8a-97096bc68901 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:25:11.216920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8748daa-e9d1-4ce2-9c8a-97096bc68901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:25:11.226159 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8748daa-e9d1-4ce2-9c8a-97096bc68901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:25:11.227610 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8748daa-e9d1-4ce2-9c8a-97096bc68901 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:25:11.236486 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1324/2640] 10.222.0.18 () {60 vars in 1396 bytes} [Wed Dec 15 03:25:11 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3248 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:25:11.284274 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80c0a4-b0b9-40b5-b539-414b0077c371 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:25:11.292702 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80c0a4-b0b9-40b5-b539-414b0077c371 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:25:11.296346 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff342f-471f-4278-8054-5ea8f27b832e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:25:11.296998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff342f-471f-4278-8054-5ea8f27b832e service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:25:11.297255 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff342f-471f-4278-8054-5ea8f27b832e service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:25:11.297532 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff342f-471f-4278-8054-5ea8f27b832e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:25:11.308047 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff342f-471f-4278-8054-5ea8f27b832e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:25:11.309761 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff342f-471f-4278-8054-5ea8f27b832e service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:25:11.320950 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1317/2641] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:25:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:25:12.628599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8748daa-e9d1-4ce2-9c8a-97096bc68901 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:25:12.636487 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8748daa-e9d1-4ce2-9c8a-97096bc68901 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:25:12.640533 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c343c7-5062-464e-b295-3eab0f3b0faa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:25:12.641667 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c343c7-5062-464e-b295-3eab0f3b0faa service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:25:12.641997 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c343c7-5062-464e-b295-3eab0f3b0faa service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:25:12.642281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c343c7-5062-464e-b295-3eab0f3b0faa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:25:12.644160 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c2c343c7-5062-464e-b295-3eab0f3b0faa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:25:12.724915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c343c7-5062-464e-b295-3eab0f3b0faa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:25:12.726376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c343c7-5062-464e-b295-3eab0f3b0faa service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:25:12.735676 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1325/2642] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:25:12 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:27:11.468090 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff342f-471f-4278-8054-5ea8f27b832e service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:27:11.505731 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff342f-471f-4278-8054-5ea8f27b832e service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:27:11.510914 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9bb41-6bc1-42d0-bc2a-d5698d0198a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:27:11.511745 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9bb41-6bc1-42d0-bc2a-d5698d0198a8 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:27:11.512028 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9bb41-6bc1-42d0-bc2a-d5698d0198a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:27:11.512303 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9bb41-6bc1-42d0-bc2a-d5698d0198a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:27:11.533111 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9bb41-6bc1-42d0-bc2a-d5698d0198a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:27:11.534561 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9bb41-6bc1-42d0-bc2a-d5698d0198a8 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:27:11.560702 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1318/2643] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:27:11 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:27:12.540786 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c343c7-5062-464e-b295-3eab0f3b0faa service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:27:12.559350 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c343c7-5062-464e-b295-3eab0f3b0faa service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:27:12.563407 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd60f-b96f-4bd0-baee-50496337de5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:27:12.564029 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd60f-b96f-4bd0-baee-50496337de5a service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:27:12.564306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd60f-b96f-4bd0-baee-50496337de5a service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:27:12.564577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd60f-b96f-4bd0-baee-50496337de5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:27:12.572787 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abd60f-b96f-4bd0-baee-50496337de5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:27:12.574219 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abd60f-b96f-4bd0-baee-50496337de5a service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:27:12.600084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1326/2644] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:27:12 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:27:43.105911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9bb41-6bc1-42d0-bc2a-d5698d0198a8 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:27:43.133725 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9bb41-6bc1-42d0-bc2a-d5698d0198a8 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:27:43.138672 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef920481-6981-4b4b-9abc-e5fb566e785d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93762c21f03d44d5bf3881d17e14ef90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:27:43.139320 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef920481-6981-4b4b-9abc-e5fb566e785d service placement] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:27:43.139600 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef920481-6981-4b4b-9abc-e5fb566e785d service placement] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:27:43.139872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef920481-6981-4b4b-9abc-e5fb566e785d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:27:43.148080 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef920481-6981-4b4b-9abc-e5fb566e785d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:27:43.149711 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef920481-6981-4b4b-9abc-e5fb566e785d service placement] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:27:43.159752 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1319/2645] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:27:43 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:29:11.702382 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd60f-b96f-4bd0-baee-50496337de5a service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:29:11.717770 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef920481-6981-4b4b-9abc-e5fb566e785d service placement] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:29:11.719575 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-ef920481-6981-4b4b-9abc-e5fb566e785d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:29:11.760806 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd60f-b96f-4bd0-baee-50496337de5a service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:29:11.764899 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d391550-8853-43ff-9180-b276c506b5c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:29:11.765660 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d391550-8853-43ff-9180-b276c506b5c6 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:29:11.765952 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d391550-8853-43ff-9180-b276c506b5c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:29:11.766252 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d391550-8853-43ff-9180-b276c506b5c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:29:11.774929 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d391550-8853-43ff-9180-b276c506b5c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:29:11.776465 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d391550-8853-43ff-9180-b276c506b5c6 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:29:11.804490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1327/2646] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:29:11 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:29:11.840636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef920481-6981-4b4b-9abc-e5fb566e785d service placement] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:29:11.846835 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ec908-d011-47f1-9847-c3b660595860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:29:11.847498 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ec908-d011-47f1-9847-c3b660595860 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:29:11.847810 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ec908-d011-47f1-9847-c3b660595860 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:29:11.848084 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ec908-d011-47f1-9847-c3b660595860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:29:11.856282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ec908-d011-47f1-9847-c3b660595860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:29:11.857857 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ec908-d011-47f1-9847-c3b660595860 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:29:11.867358 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1320/2647] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:29:11 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:29:12.134739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d391550-8853-43ff-9180-b276c506b5c6 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:29:12.147284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d391550-8853-43ff-9180-b276c506b5c6 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:29:12.152705 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a22acc-e689-4bca-b57d-619a8c01bd3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:29:12.153329 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a22acc-e689-4bca-b57d-619a8c01bd3a service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:29:12.153614 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a22acc-e689-4bca-b57d-619a8c01bd3a service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:29:12.153892 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a22acc-e689-4bca-b57d-619a8c01bd3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:29:12.155758 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-44a22acc-e689-4bca-b57d-619a8c01bd3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:29:12.168130 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a22acc-e689-4bca-b57d-619a8c01bd3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:29:12.169706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a22acc-e689-4bca-b57d-619a8c01bd3a service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:29:12.179709 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1328/2648] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:29:12 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:29:39.845195 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ec908-d011-47f1-9847-c3b660595860 service nova] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:29:39.846786 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-998ec908-d011-47f1-9847-c3b660595860 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:29:39.919713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ec908-d011-47f1-9847-c3b660595860 service nova] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:29:39.923805 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8799436-e761-4a1f-ab67-c3794f84763e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:29:39.924431 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8799436-e761-4a1f-ab67-c3794f84763e service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:29:39.924710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8799436-e761-4a1f-ab67-c3794f84763e service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:29:39.924985 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8799436-e761-4a1f-ab67-c3794f84763e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:29:39.926843 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c8799436-e761-4a1f-ab67-c3794f84763e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:29:39.935828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8799436-e761-4a1f-ab67-c3794f84763e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:29:39.937239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8799436-e761-4a1f-ab67-c3794f84763e service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:29:39.945346 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1321/2649] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:29:39 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:31:11.871886 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a22acc-e689-4bca-b57d-619a8c01bd3a service nova] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:31:11.881780 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a22acc-e689-4bca-b57d-619a8c01bd3a service nova] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:31:11.885251 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b47aa0-7440-4c99-ae67-4fd1807ccfca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:31:11.885869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b47aa0-7440-4c99-ae67-4fd1807ccfca service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:31:11.886174 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b47aa0-7440-4c99-ae67-4fd1807ccfca service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:31:11.886445 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b47aa0-7440-4c99-ae67-4fd1807ccfca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:31:11.888256 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-92b47aa0-7440-4c99-ae67-4fd1807ccfca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:31:11.962530 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b47aa0-7440-4c99-ae67-4fd1807ccfca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:31:11.963928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b47aa0-7440-4c99-ae67-4fd1807ccfca service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:31:11.980910 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1329/2650] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:31:11 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:31:12.026548 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8799436-e761-4a1f-ab67-c3794f84763e service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:31:12.035408 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8799436-e761-4a1f-ab67-c3794f84763e service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:31:12.038916 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afd922-d747-44d3-a924-aa656f5c72af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:31:12.039529 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afd922-d747-44d3-a924-aa656f5c72af service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:31:12.039804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afd922-d747-44d3-a924-aa656f5c72af service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:31:12.040119 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afd922-d747-44d3-a924-aa656f5c72af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:31:12.041900 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-92afd922-d747-44d3-a924-aa656f5c72af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:31:12.055147 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afd922-d747-44d3-a924-aa656f5c72af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:31:12.056551 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afd922-d747-44d3-a924-aa656f5c72af service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:31:12.067906 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1322/2651] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:31:12 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:31:12.113290 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b47aa0-7440-4c99-ae67-4fd1807ccfca service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:31:12.121489 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b47aa0-7440-4c99-ae67-4fd1807ccfca service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:31:12.125027 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a93ce-4e7c-4e37-96d9-9dbaa704bb17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:31:12.126369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a93ce-4e7c-4e37-96d9-9dbaa704bb17 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:31:12.126646 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a93ce-4e7c-4e37-96d9-9dbaa704bb17 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:31:12.126915 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a93ce-4e7c-4e37-96d9-9dbaa704bb17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:31:12.128734 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-830a93ce-4e7c-4e37-96d9-9dbaa704bb17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:31:12.141857 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a93ce-4e7c-4e37-96d9-9dbaa704bb17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:31:12.143285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a93ce-4e7c-4e37-96d9-9dbaa704bb17 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:31:12.153621 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1330/2652] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:31:12 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:31:13.044697 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afd922-d747-44d3-a924-aa656f5c72af service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:31:13.046279 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-92afd922-d747-44d3-a924-aa656f5c72af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:31:13.068818 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afd922-d747-44d3-a924-aa656f5c72af service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:31:13.072433 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665f8b5-229f-402f-9f45-e4fe929ec9db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:31:13.073051 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665f8b5-229f-402f-9f45-e4fe929ec9db service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:31:13.073331 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665f8b5-229f-402f-9f45-e4fe929ec9db service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:31:13.073603 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665f8b5-229f-402f-9f45-e4fe929ec9db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:31:13.082197 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665f8b5-229f-402f-9f45-e4fe929ec9db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:31:13.083613 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665f8b5-229f-402f-9f45-e4fe929ec9db service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:31:13.109162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1323/2653] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:31:13 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:32:48.140723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a93ce-4e7c-4e37-96d9-9dbaa704bb17 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:32:48.142293 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-830a93ce-4e7c-4e37-96d9-9dbaa704bb17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:32:48.219609 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a93ce-4e7c-4e37-96d9-9dbaa704bb17 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:32:48.224753 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0408b-5606-4165-a530-28c904ed28fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93762c21f03d44d5bf3881d17e14ef90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:32:48.225390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0408b-5606-4165-a530-28c904ed28fb service placement] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:32:48.225669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0408b-5606-4165-a530-28c904ed28fb service placement] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:32:48.225943 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0408b-5606-4165-a530-28c904ed28fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:32:48.227820 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-06a0408b-5606-4165-a530-28c904ed28fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:32:48.238720 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0408b-5606-4165-a530-28c904ed28fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:32:48.240298 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0408b-5606-4165-a530-28c904ed28fb service placement] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:32:48.250238 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1331/2654] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:32:48 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:33:12.298011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665f8b5-229f-402f-9f45-e4fe929ec9db service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:33:12.299553 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e665f8b5-229f-402f-9f45-e4fe929ec9db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:33:12.315167 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665f8b5-229f-402f-9f45-e4fe929ec9db service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:33:12.321377 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2391e37-83c1-4f1d-a790-c4dd26ed2489 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:33:12.322648 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2391e37-83c1-4f1d-a790-c4dd26ed2489 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:33:12.322648 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2391e37-83c1-4f1d-a790-c4dd26ed2489 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:33:12.322648 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2391e37-83c1-4f1d-a790-c4dd26ed2489 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:33:12.324435 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d2391e37-83c1-4f1d-a790-c4dd26ed2489 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:33:12.330420 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0408b-5606-4165-a530-28c904ed28fb service placement] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:33:12.342226 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0408b-5606-4165-a530-28c904ed28fb service placement] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:33:12.351216 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9c58e-a0a0-4202-b48f-0f346a202f62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:33:12.351851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9c58e-a0a0-4202-b48f-0f346a202f62 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:33:12.352129 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9c58e-a0a0-4202-b48f-0f346a202f62 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:33:12.352430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9c58e-a0a0-4202-b48f-0f346a202f62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:33:12.354323 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b0b9c58e-a0a0-4202-b48f-0f346a202f62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:33:12.398495 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2391e37-83c1-4f1d-a790-c4dd26ed2489 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:33:12.400079 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2391e37-83c1-4f1d-a790-c4dd26ed2489 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:33:12.409034 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1324/2655] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:33:12 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:33:12.409840 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2391e37-83c1-4f1d-a790-c4dd26ed2489 service nova] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:33:12.418374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2391e37-83c1-4f1d-a790-c4dd26ed2489 service nova] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:33:12.422093 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efa287-4bfc-4789-b268-8f431c3a92c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:33:12.422813 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efa287-4bfc-4789-b268-8f431c3a92c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:33:12.423011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efa287-4bfc-4789-b268-8f431c3a92c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:33:12.423288 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efa287-4bfc-4789-b268-8f431c3a92c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:33:12.425398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9c58e-a0a0-4202-b48f-0f346a202f62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:33:12.426997 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9c58e-a0a0-4202-b48f-0f346a202f62 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:33:12.431957 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efa287-4bfc-4789-b268-8f431c3a92c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:33:12.433373 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efa287-4bfc-4789-b268-8f431c3a92c3 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:33:12.435926 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1332/2656] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:33:12 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:33:12.443683 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1325/2657] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:33:12 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:33:13.991036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9c58e-a0a0-4202-b48f-0f346a202f62 service nova] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:33:13.992628 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b0b9c58e-a0a0-4202-b48f-0f346a202f62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:33:14.007241 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9c58e-a0a0-4202-b48f-0f346a202f62 service nova] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:33:14.010908 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8db62-c336-4e85-9e94-fe2ea75d7d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:33:14.011547 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8db62-c336-4e85-9e94-fe2ea75d7d9d service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:33:14.011827 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8db62-c336-4e85-9e94-fe2ea75d7d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:33:14.012278 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8db62-c336-4e85-9e94-fe2ea75d7d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:33:14.014665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7fd8db62-c336-4e85-9e94-fe2ea75d7d9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:33:14.105106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8db62-c336-4e85-9e94-fe2ea75d7d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:33:14.106589 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8db62-c336-4e85-9e94-fe2ea75d7d9d service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:33:14.125812 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1333/2658] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:33:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:33:16.589602 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168022c2-0dcc-457c-bcab-934573134dba None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:33:16.590144 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168022c2-0dcc-457c-bcab-934573134dba None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:33:16.590513 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168022c2-0dcc-457c-bcab-934573134dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:33:16.620602 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-168022c2-0dcc-457c-bcab-934573134dba None None] MFA Rules not processed for user `fedc11e2dbd74b919982a0657222cca4`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:33:16.623871 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-168022c2-0dcc-457c-bcab-934573134dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:33:16.632011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1326/2659] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:33:16 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:33:17.261156 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8db62-c336-4e85-9e94-fe2ea75d7d9d service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:33:17.270061 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8db62-c336-4e85-9e94-fe2ea75d7d9d service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:33:17.273767 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067740c6-f9f1-4c63-9ed5-a464541bfea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:33:17.274428 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067740c6-f9f1-4c63-9ed5-a464541bfea6 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:33:17.274714 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067740c6-f9f1-4c63-9ed5-a464541bfea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:33:17.274992 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067740c6-f9f1-4c63-9ed5-a464541bfea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:33:17.276746 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-067740c6-f9f1-4c63-9ed5-a464541bfea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:33:17.286862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067740c6-f9f1-4c63-9ed5-a464541bfea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:33:17.288268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067740c6-f9f1-4c63-9ed5-a464541bfea6 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:33:17.296082 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1334/2660] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:33:17 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:33:17.792310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168022c2-0dcc-457c-bcab-934573134dba None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:33:17.794924 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-168022c2-0dcc-457c-bcab-934573134dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:33:17.811903 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168022c2-0dcc-457c-bcab-934573134dba None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:33:17.819124 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047e209-585a-4466-a1f6-11616d4f968e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93762c21f03d44d5bf3881d17e14ef90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:33:17.820526 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047e209-585a-4466-a1f6-11616d4f968e service placement] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:33:17.820965 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047e209-585a-4466-a1f6-11616d4f968e service placement] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:33:17.821412 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047e209-585a-4466-a1f6-11616d4f968e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:33:17.826808 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-a047e209-585a-4466-a1f6-11616d4f968e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:33:17.848387 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047e209-585a-4466-a1f6-11616d4f968e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:33:17.850619 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047e209-585a-4466-a1f6-11616d4f968e service placement] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:33:17.874212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1327/2661] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:33:17 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:33:22.822118 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067740c6-f9f1-4c63-9ed5-a464541bfea6 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:33:22.823756 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-067740c6-f9f1-4c63-9ed5-a464541bfea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:33:22.838506 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067740c6-f9f1-4c63-9ed5-a464541bfea6 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:33:22.843578 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b8528-8ede-48b8-aa14-df0ab9929f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:33:22.844437 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b8528-8ede-48b8-aa14-df0ab9929f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:33:22.844716 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b8528-8ede-48b8-aa14-df0ab9929f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:33:22.844985 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b8528-8ede-48b8-aa14-df0ab9929f9b admin admin] PATH_INFO: `/v3/users/6c4c0c82448e40ba801c0b52ec44e74a` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:33:22.846226 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b8528-8ede-48b8-aa14-df0ab9929f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c4c0c82448e40ba801c0b52ec44e74a)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:33:22.848375 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b8528-8ede-48b8-aa14-df0ab9929f9b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:33:22.896364 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f64b8528-8ede-48b8-aa14-df0ab9929f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c4c0c82448e40ba801c0b52ec44e74a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:22.908261 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f64b8528-8ede-48b8-aa14-df0ab9929f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c4c0c82448e40ba801c0b52ec44e74a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:22.916066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f64b8528-8ede-48b8-aa14-df0ab9929f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c4c0c82448e40ba801c0b52ec44e74a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:22.916850 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f64b8528-8ede-48b8-aa14-df0ab9929f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c4c0c82448e40ba801c0b52ec44e74a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:22.917523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-f64b8528-8ede-48b8-aa14-df0ab9929f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c4c0c82448e40ba801c0b52ec44e74a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:22.930953 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1335/2662] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:33:22 2021] DELETE /identity/v3/users/6c4c0c82448e40ba801c0b52ec44e74a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:33:23.096900 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047e209-585a-4466-a1f6-11616d4f968e service placement] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:33:23.112261 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047e209-585a-4466-a1f6-11616d4f968e service placement] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:33:23.166561 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:33:23.167339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:33:23.167625 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:33:23.167899 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1 admin admin] PATH_INFO: `/v3/projects/5a093d0bf43046aaa845f3cc115f3f5f` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:33:23.169085 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a093d0bf43046aaa845f3cc115f3f5f)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:33:23.171080 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:33:23.215382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a093d0bf43046aaa845f3cc115f3f5f', 'request_id': 'req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:23.223401 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a093d0bf43046aaa845f3cc115f3f5f', 'request_id': 'req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:23.229691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a093d0bf43046aaa845f3cc115f3f5f', 'request_id': 'req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:23.240574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1 admin admin] The token cache is being invalidate because project 5a093d0bf43046aaa845f3cc115f3f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:33:23.240867 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:23.241496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:23.243061 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1328/2663] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:33:23 2021] DELETE /identity/v3/projects/5a093d0bf43046aaa845f3cc115f3f5f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:33:23.246990 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b8528-8ede-48b8-aa14-df0ab9929f9b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:33:23.248978 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f64b8528-8ede-48b8-aa14-df0ab9929f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:33:23.261434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b8528-8ede-48b8-aa14-df0ab9929f9b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:33:23.314679 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41261537-c6c7-408c-8266-0320b530e6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:33:23.315529 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41261537-c6c7-408c-8266-0320b530e6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:33:23.315811 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41261537-c6c7-408c-8266-0320b530e6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:33:23.316089 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41261537-c6c7-408c-8266-0320b530e6b0 admin admin] PATH_INFO: `/v3/users/353d8feb930d4eb8a9fd8efe3d5b2e21` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:33:23.328460 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41261537-c6c7-408c-8266-0320b530e6b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=353d8feb930d4eb8a9fd8efe3d5b2e21)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:33:23.330404 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41261537-c6c7-408c-8266-0320b530e6b0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:33:23.373058 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-41261537-c6c7-408c-8266-0320b530e6b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '353d8feb930d4eb8a9fd8efe3d5b2e21'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:23.384311 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-41261537-c6c7-408c-8266-0320b530e6b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '353d8feb930d4eb8a9fd8efe3d5b2e21'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:23.391248 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-41261537-c6c7-408c-8266-0320b530e6b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '353d8feb930d4eb8a9fd8efe3d5b2e21'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:23.391889 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-41261537-c6c7-408c-8266-0320b530e6b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '353d8feb930d4eb8a9fd8efe3d5b2e21'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:23.392498 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-41261537-c6c7-408c-8266-0320b530e6b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '353d8feb930d4eb8a9fd8efe3d5b2e21'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:23.404032 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1336/2664] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:33:23 2021] DELETE /identity/v3/users/353d8feb930d4eb8a9fd8efe3d5b2e21 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:33:23.574288 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:33:23.575925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:33:23.606707 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7e353-09b4-486c-82fd-7c8fc2fd25e1 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:33:23.662361 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960bd4b-3fa4-4968-959e-c09041ba99ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:33:23.663216 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960bd4b-3fa4-4968-959e-c09041ba99ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:33:23.663491 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960bd4b-3fa4-4968-959e-c09041ba99ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:33:23.663762 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960bd4b-3fa4-4968-959e-c09041ba99ef admin admin] PATH_INFO: `/v3/projects/4b6b61eaf5634e0c85cb4c3a5bf524e4` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:33:23.674664 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960bd4b-3fa4-4968-959e-c09041ba99ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b6b61eaf5634e0c85cb4c3a5bf524e4)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:33:23.676557 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960bd4b-3fa4-4968-959e-c09041ba99ef admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:33:23.721843 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-8960bd4b-3fa4-4968-959e-c09041ba99ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b6b61eaf5634e0c85cb4c3a5bf524e4', 'request_id': 'req-8960bd4b-3fa4-4968-959e-c09041ba99ef'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:23.729342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-8960bd4b-3fa4-4968-959e-c09041ba99ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b6b61eaf5634e0c85cb4c3a5bf524e4', 'request_id': 'req-8960bd4b-3fa4-4968-959e-c09041ba99ef'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:23.736498 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-8960bd4b-3fa4-4968-959e-c09041ba99ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b6b61eaf5634e0c85cb4c3a5bf524e4', 'request_id': 'req-8960bd4b-3fa4-4968-959e-c09041ba99ef'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:23.746572 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-8960bd4b-3fa4-4968-959e-c09041ba99ef admin admin] The token cache is being invalidate because project 4b6b61eaf5634e0c85cb4c3a5bf524e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:33:23.746860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-8960bd4b-3fa4-4968-959e-c09041ba99ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:23.747516 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-8960bd4b-3fa4-4968-959e-c09041ba99ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:33:23.749070 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1329/2665] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:33:23 2021] DELETE /identity/v3/projects/4b6b61eaf5634e0c85cb4c3a5bf524e4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:33:27.483461 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41261537-c6c7-408c-8266-0320b530e6b0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:33:27.484927 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-41261537-c6c7-408c-8266-0320b530e6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:33:27.556719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41261537-c6c7-408c-8266-0320b530e6b0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:33:27.616124 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63da0d-112a-4e5b-a99d-fdbd9dd45552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:33:27.616767 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63da0d-112a-4e5b-a99d-fdbd9dd45552 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:33:27.617053 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63da0d-112a-4e5b-a99d-fdbd9dd45552 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:33:27.617332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63da0d-112a-4e5b-a99d-fdbd9dd45552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:33:27.619148 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4e63da0d-112a-4e5b-a99d-fdbd9dd45552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:33:27.630506 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63da0d-112a-4e5b-a99d-fdbd9dd45552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:33:27.632073 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63da0d-112a-4e5b-a99d-fdbd9dd45552 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:33:27.642674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1337/2666] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:33:27 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:33:30.653796 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960bd4b-3fa4-4968-959e-c09041ba99ef admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:33:30.655278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8960bd4b-3fa4-4968-959e-c09041ba99ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:33:30.671451 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960bd4b-3fa4-4968-959e-c09041ba99ef admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:33:30.677285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33d80b-f270-4206-93db-8f9c7803595a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:33:30.677924 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33d80b-f270-4206-93db-8f9c7803595a service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:33:30.678232 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33d80b-f270-4206-93db-8f9c7803595a service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:33:30.678522 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33d80b-f270-4206-93db-8f9c7803595a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:33:30.680234 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0b33d80b-f270-4206-93db-8f9c7803595a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:33:30.693150 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33d80b-f270-4206-93db-8f9c7803595a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:33:30.694753 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33d80b-f270-4206-93db-8f9c7803595a service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:33:30.705795 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1330/2667] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:33:30 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:34:43.835631 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63da0d-112a-4e5b-a99d-fdbd9dd45552 service nova] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:34:43.837042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4e63da0d-112a-4e5b-a99d-fdbd9dd45552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:34:43.890147 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63da0d-112a-4e5b-a99d-fdbd9dd45552 service nova] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:34:43.894358 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5395e-7a18-4d26-a505-288b1dd0a3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:34:43.894978 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5395e-7a18-4d26-a505-288b1dd0a3ff service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:34:43.895256 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5395e-7a18-4d26-a505-288b1dd0a3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:34:43.895531 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5395e-7a18-4d26-a505-288b1dd0a3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:34:43.897471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-90e5395e-7a18-4d26-a505-288b1dd0a3ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:34:43.908634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5395e-7a18-4d26-a505-288b1dd0a3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:34:43.910327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5395e-7a18-4d26-a505-288b1dd0a3ff service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:34:43.918267 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1338/2668] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:34:43 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:35:09.747004 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33d80b-f270-4206-93db-8f9c7803595a service nova] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:35:09.760114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33d80b-f270-4206-93db-8f9c7803595a service nova] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:35:09.765067 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68174a-87f8-45f1-8535-bfc4546efea5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:35:09.765726 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68174a-87f8-45f1-8535-bfc4546efea5 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:35:09.766040 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68174a-87f8-45f1-8535-bfc4546efea5 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:35:09.766336 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68174a-87f8-45f1-8535-bfc4546efea5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:35:09.768139 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-bc68174a-87f8-45f1-8535-bfc4546efea5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:35:09.781886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68174a-87f8-45f1-8535-bfc4546efea5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:35:09.783580 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68174a-87f8-45f1-8535-bfc4546efea5 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:35:09.795283 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1331/2669] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:35:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:35:12.515153 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5395e-7a18-4d26-a505-288b1dd0a3ff service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:35:12.516573 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-90e5395e-7a18-4d26-a505-288b1dd0a3ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:35:12.570292 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5395e-7a18-4d26-a505-288b1dd0a3ff service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:35:12.573832 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842cc21-9516-4495-a650-47dda31922e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:35:12.574490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842cc21-9516-4495-a650-47dda31922e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:35:12.574770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842cc21-9516-4495-a650-47dda31922e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:35:12.575044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842cc21-9516-4495-a650-47dda31922e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:35:12.576779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-5842cc21-9516-4495-a650-47dda31922e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:35:12.643707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842cc21-9516-4495-a650-47dda31922e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:35:12.645734 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842cc21-9516-4495-a650-47dda31922e9 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:35:12.654476 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1339/2670] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:35:12 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:37:12.720771 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68174a-87f8-45f1-8535-bfc4546efea5 service nova] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:37:12.758027 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68174a-87f8-45f1-8535-bfc4546efea5 service nova] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:37:12.761618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd14837-029f-4bad-b4f6-4629becf0701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:37:12.762295 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd14837-029f-4bad-b4f6-4629becf0701 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:37:12.762570 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd14837-029f-4bad-b4f6-4629becf0701 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:37:12.762842 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd14837-029f-4bad-b4f6-4629becf0701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:37:12.764559 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0dd14837-029f-4bad-b4f6-4629becf0701 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:37:12.790978 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd14837-029f-4bad-b4f6-4629becf0701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:37:12.792401 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd14837-029f-4bad-b4f6-4629becf0701 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:37:12.803247 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1332/2671] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:37:12 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:37:12.810451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842cc21-9516-4495-a650-47dda31922e9 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:37:12.838335 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842cc21-9516-4495-a650-47dda31922e9 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:37:12.841900 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758c5c7-9bfc-4c44-ba9a-c4b42df2ea1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:37:12.842592 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758c5c7-9bfc-4c44-ba9a-c4b42df2ea1c service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:37:12.842870 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758c5c7-9bfc-4c44-ba9a-c4b42df2ea1c service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:37:12.843145 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758c5c7-9bfc-4c44-ba9a-c4b42df2ea1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:37:12.845178 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-2758c5c7-9bfc-4c44-ba9a-c4b42df2ea1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:37:12.902451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758c5c7-9bfc-4c44-ba9a-c4b42df2ea1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:37:12.903877 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758c5c7-9bfc-4c44-ba9a-c4b42df2ea1c service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:37:12.912982 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1340/2672] 10.222.0.18 () {60 vars in 1396 bytes} [Wed Dec 15 03:37:12 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:37:13.790700 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd14837-029f-4bad-b4f6-4629becf0701 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:37:13.792062 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-0dd14837-029f-4bad-b4f6-4629becf0701 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:37:13.802828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd14837-029f-4bad-b4f6-4629becf0701 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:37:13.806357 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc36f5e-544e-42fa-9473-6307228797c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:37:13.806974 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc36f5e-544e-42fa-9473-6307228797c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:37:13.807251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc36f5e-544e-42fa-9473-6307228797c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:37:13.807520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc36f5e-544e-42fa-9473-6307228797c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:37:13.809247 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-4bc36f5e-544e-42fa-9473-6307228797c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:37:13.876701 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc36f5e-544e-42fa-9473-6307228797c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:37:13.878165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc36f5e-544e-42fa-9473-6307228797c7 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:37:13.886826 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1333/2673] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:37:13 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:37:15.394966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758c5c7-9bfc-4c44-ba9a-c4b42df2ea1c service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:37:15.396439 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-2758c5c7-9bfc-4c44-ba9a-c4b42df2ea1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:37:15.407675 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758c5c7-9bfc-4c44-ba9a-c4b42df2ea1c service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:37:15.411199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3299d-9c93-420e-ab98-28940f86adb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:37:15.411823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3299d-9c93-420e-ab98-28940f86adb4 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:37:15.412104 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3299d-9c93-420e-ab98-28940f86adb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:37:15.412378 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3299d-9c93-420e-ab98-28940f86adb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:37:15.414084 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-31c3299d-9c93-420e-ab98-28940f86adb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:37:15.427045 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3299d-9c93-420e-ab98-28940f86adb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:37:15.428444 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3299d-9c93-420e-ab98-28940f86adb4 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:37:15.438866 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1341/2674] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:37:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:37:51.106395 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc36f5e-544e-42fa-9473-6307228797c7 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:37:51.107783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-4bc36f5e-544e-42fa-9473-6307228797c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:37:51.186757 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc36f5e-544e-42fa-9473-6307228797c7 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:37:51.191731 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296bc92-9d9f-4cd9-be39-d5504db2c377 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93762c21f03d44d5bf3881d17e14ef90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:37:51.192365 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296bc92-9d9f-4cd9-be39-d5504db2c377 service placement] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:37:51.192646 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296bc92-9d9f-4cd9-be39-d5504db2c377 service placement] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:37:51.192921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296bc92-9d9f-4cd9-be39-d5504db2c377 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:37:51.194673 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-3296bc92-9d9f-4cd9-be39-d5504db2c377 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:37:51.206269 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296bc92-9d9f-4cd9-be39-d5504db2c377 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:37:51.207847 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296bc92-9d9f-4cd9-be39-d5504db2c377 service placement] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:37:51.217417 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1334/2675] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:37:51 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:39:13.010454 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3299d-9c93-420e-ab98-28940f86adb4 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:39:13.019522 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3299d-9c93-420e-ab98-28940f86adb4 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:39:13.023744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac48d6f-9d13-47d7-9150-e301233f136e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:39:13.024364 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac48d6f-9d13-47d7-9150-e301233f136e service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:39:13.024644 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac48d6f-9d13-47d7-9150-e301233f136e service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:39:13.024918 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac48d6f-9d13-47d7-9150-e301233f136e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:39:13.026669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-1ac48d6f-9d13-47d7-9150-e301233f136e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:39:13.101285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac48d6f-9d13-47d7-9150-e301233f136e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:39:13.102697 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac48d6f-9d13-47d7-9150-e301233f136e service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:39:13.120164 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1342/2676] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:39:13 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:39:13.690193 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296bc92-9d9f-4cd9-be39-d5504db2c377 service placement] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:39:13.701198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296bc92-9d9f-4cd9-be39-d5504db2c377 service placement] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:39:13.705379 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef39c2-a3f3-4a2d-8f2b-096f34240dde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:39:13.706079 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef39c2-a3f3-4a2d-8f2b-096f34240dde service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:39:13.706369 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef39c2-a3f3-4a2d-8f2b-096f34240dde service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:39:13.706666 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef39c2-a3f3-4a2d-8f2b-096f34240dde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:39:13.708539 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-16ef39c2-a3f3-4a2d-8f2b-096f34240dde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:39:13.720847 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: WARNING keystone.server.flask.application [None req-16ef39c2-a3f3-4a2d-8f2b-096f34240dde service cinder] Could not find project: 5a093d0bf43046aaa845f3cc115f3f5f.: keystone.exception.ProjectNotFound: Could not find project: 5a093d0bf43046aaa845f3cc115f3f5f. Dec 15 03:39:13.722503 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1335/2677] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:39:13 2021] GET /identity/v3/auth/tokens => generated 113 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 15 03:39:26.435837 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc272b2-7770-4844-8327-bd8e153711f7 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:39:26.436335 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc272b2-7770-4844-8327-bd8e153711f7 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:39:26.436640 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc272b2-7770-4844-8327-bd8e153711f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:39:26.461528 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-ebc272b2-7770-4844-8327-bd8e153711f7 None None] MFA Rules not processed for user `e4ffcca165af40abbd93569e7f01acbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:39:26.462744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-ebc272b2-7770-4844-8327-bd8e153711f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:39:26.469711 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1343/2678] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:39:26 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:39:26.688755 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef39c2-a3f3-4a2d-8f2b-096f34240dde service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:39:26.698533 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef39c2-a3f3-4a2d-8f2b-096f34240dde service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:39:26.701962 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10cfb7-d8b3-4080-ade3-0a50de6eeb07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:39:26.702602 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10cfb7-d8b3-4080-ade3-0a50de6eeb07 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:39:26.702879 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10cfb7-d8b3-4080-ade3-0a50de6eeb07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:39:26.703150 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10cfb7-d8b3-4080-ade3-0a50de6eeb07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:39:26.704823 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-4a10cfb7-d8b3-4080-ade3-0a50de6eeb07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:39:26.714694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10cfb7-d8b3-4080-ade3-0a50de6eeb07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:39:26.716094 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10cfb7-d8b3-4080-ade3-0a50de6eeb07 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:39:26.723956 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1336/2679] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:39:26 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:39:27.021269 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc272b2-7770-4844-8327-bd8e153711f7 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:39:27.023229 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-ebc272b2-7770-4844-8327-bd8e153711f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:39:27.038505 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc272b2-7770-4844-8327-bd8e153711f7 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:39:27.043440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5df15-c121-4a95-a23b-d6914b7cd853 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93762c21f03d44d5bf3881d17e14ef90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:39:27.044083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5df15-c121-4a95-a23b-d6914b7cd853 service placement] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:39:27.044367 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5df15-c121-4a95-a23b-d6914b7cd853 service placement] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:39:27.044648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5df15-c121-4a95-a23b-d6914b7cd853 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:39:27.046455 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-92d5df15-c121-4a95-a23b-d6914b7cd853 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:39:27.058556 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5df15-c121-4a95-a23b-d6914b7cd853 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:39:27.060126 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5df15-c121-4a95-a23b-d6914b7cd853 service placement] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:39:27.070587 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1344/2680] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:39:27 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:39:35.229334 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10cfb7-d8b3-4080-ade3-0a50de6eeb07 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:39:35.230832 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-4a10cfb7-d8b3-4080-ade3-0a50de6eeb07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:39:35.284076 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10cfb7-d8b3-4080-ade3-0a50de6eeb07 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:39:35.295135 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fca2b-407b-433e-bc53-387ef19ccc45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:39:35.295382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fca2b-407b-433e-bc53-387ef19ccc45 service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:39:35.295690 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fca2b-407b-433e-bc53-387ef19ccc45 service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:39:35.295967 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fca2b-407b-433e-bc53-387ef19ccc45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:39:35.305308 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fca2b-407b-433e-bc53-387ef19ccc45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:39:35.306922 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fca2b-407b-433e-bc53-387ef19ccc45 service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:39:35.317025 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1337/2681] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:39:35 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:39:49.861772 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5df15-c121-4a95-a23b-d6914b7cd853 service placement] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:39:49.880381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5df15-c121-4a95-a23b-d6914b7cd853 service placement] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:39:49.883990 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e510828-f289-4061-b7c8-71e5c0782827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:39:49.884617 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510828-f289-4061-b7c8-71e5c0782827 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:39:49.884902 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510828-f289-4061-b7c8-71e5c0782827 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:39:49.885180 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510828-f289-4061-b7c8-71e5c0782827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:39:49.892240 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e510828-f289-4061-b7c8-71e5c0782827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:39:49.893867 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e510828-f289-4061-b7c8-71e5c0782827 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:39:49.901785 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1345/2682] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:39:49 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:40:12.658285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fca2b-407b-433e-bc53-387ef19ccc45 service nova] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:40:12.667364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fca2b-407b-433e-bc53-387ef19ccc45 service nova] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:40:12.670881 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ce9ec-573f-4970-998c-ede316b019f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:40:12.671497 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ce9ec-573f-4970-998c-ede316b019f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:12.671774 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ce9ec-573f-4970-998c-ede316b019f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:12.672046 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ce9ec-573f-4970-998c-ede316b019f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:12.681077 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ce9ec-573f-4970-998c-ede316b019f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:40:12.682537 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ce9ec-573f-4970-998c-ede316b019f9 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:40:12.710011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1338/2683] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:40:12 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:40:26.811218 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e510828-f289-4061-b7c8-71e5c0782827 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:40:26.819534 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e510828-f289-4061-b7c8-71e5c0782827 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:40:26.823556 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27e0e9-2864-41c2-89fe-6455feaaa3a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:40:26.824191 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27e0e9-2864-41c2-89fe-6455feaaa3a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:26.824468 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27e0e9-2864-41c2-89fe-6455feaaa3a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:26.824743 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27e0e9-2864-41c2-89fe-6455feaaa3a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:26.826538 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3f27e0e9-2864-41c2-89fe-6455feaaa3a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:40:26.886632 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27e0e9-2864-41c2-89fe-6455feaaa3a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:40:26.888048 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27e0e9-2864-41c2-89fe-6455feaaa3a3 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:40:26.897108 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1346/2684] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:40:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:40:27.374631 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ce9ec-573f-4970-998c-ede316b019f9 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:40:27.376125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b72ce9ec-573f-4970-998c-ede316b019f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:40:27.390550 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ce9ec-573f-4970-998c-ede316b019f9 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:40:27.395251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ff0b3-f887-418d-9057-54c24fc9a40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:40:27.396071 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ff0b3-f887-418d-9057-54c24fc9a40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:27.396805 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ff0b3-f887-418d-9057-54c24fc9a40d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:27.397160 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ff0b3-f887-418d-9057-54c24fc9a40d admin admin] PATH_INFO: `/v3/users/e4ffcca165af40abbd93569e7f01acbe` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:27.399292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ff0b3-f887-418d-9057-54c24fc9a40d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4ffcca165af40abbd93569e7f01acbe)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:40:27.402354 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ff0b3-f887-418d-9057-54c24fc9a40d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:40:27.451916 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-de2ff0b3-f887-418d-9057-54c24fc9a40d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4ffcca165af40abbd93569e7f01acbe'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:27.464123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-de2ff0b3-f887-418d-9057-54c24fc9a40d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4ffcca165af40abbd93569e7f01acbe'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:27.472726 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-de2ff0b3-f887-418d-9057-54c24fc9a40d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4ffcca165af40abbd93569e7f01acbe'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:27.479953 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-de2ff0b3-f887-418d-9057-54c24fc9a40d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4ffcca165af40abbd93569e7f01acbe'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:27.480599 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-de2ff0b3-f887-418d-9057-54c24fc9a40d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4ffcca165af40abbd93569e7f01acbe'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:27.486236 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1339/2685] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:40:27 2021] DELETE /identity/v3/users/e4ffcca165af40abbd93569e7f01acbe => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:40:27.650098 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27e0e9-2864-41c2-89fe-6455feaaa3a3 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:40:27.659528 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27e0e9-2864-41c2-89fe-6455feaaa3a3 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:40:27.719365 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1078013-24b1-44ab-96f4-41c5f79de4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:40:27.720203 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1078013-24b1-44ab-96f4-41c5f79de4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:27.720480 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1078013-24b1-44ab-96f4-41c5f79de4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:27.720752 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1078013-24b1-44ab-96f4-41c5f79de4dc admin admin] PATH_INFO: `/v3/projects/9ca6934bc24846ad82474c4ef7ba6323` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:27.721995 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1078013-24b1-44ab-96f4-41c5f79de4dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca6934bc24846ad82474c4ef7ba6323)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:40:27.723956 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1078013-24b1-44ab-96f4-41c5f79de4dc admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:40:27.768936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d1078013-24b1-44ab-96f4-41c5f79de4dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca6934bc24846ad82474c4ef7ba6323', 'request_id': 'req-d1078013-24b1-44ab-96f4-41c5f79de4dc'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:27.776174 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d1078013-24b1-44ab-96f4-41c5f79de4dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca6934bc24846ad82474c4ef7ba6323', 'request_id': 'req-d1078013-24b1-44ab-96f4-41c5f79de4dc'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:27.782089 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d1078013-24b1-44ab-96f4-41c5f79de4dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca6934bc24846ad82474c4ef7ba6323', 'request_id': 'req-d1078013-24b1-44ab-96f4-41c5f79de4dc'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:27.791652 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d1078013-24b1-44ab-96f4-41c5f79de4dc admin admin] The token cache is being invalidate because project 9ca6934bc24846ad82474c4ef7ba6323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:40:27.791942 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d1078013-24b1-44ab-96f4-41c5f79de4dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:27.792551 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d1078013-24b1-44ab-96f4-41c5f79de4dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:27.794170 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1347/2686] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:40:27 2021] DELETE /identity/v3/projects/9ca6934bc24846ad82474c4ef7ba6323 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:40:27.799812 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dabd9-ab57-4575-aed1-3f6da34b6ad6 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:27.800100 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dabd9-ab57-4575-aed1-3f6da34b6ad6 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:27.800383 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dabd9-ab57-4575-aed1-3f6da34b6ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:27.857333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-368dabd9-ab57-4575-aed1-3f6da34b6ad6 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:40:27.858567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-368dabd9-ab57-4575-aed1-3f6da34b6ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:40:27.915949 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1340/2687] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:40:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:40:27.923929 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a3620-e71c-4e94-967c-d5799f65448d None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:27.924407 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a3620-e71c-4e94-967c-d5799f65448d None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:27.924524 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a3620-e71c-4e94-967c-d5799f65448d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:27.942280 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-027a3620-e71c-4e94-967c-d5799f65448d None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:40:27.943440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-027a3620-e71c-4e94-967c-d5799f65448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:40:27.951563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1348/2688] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:40:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:40:27.955780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368dabd9-ab57-4575-aed1-3f6da34b6ad6 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:40:27.966254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368dabd9-ab57-4575-aed1-3f6da34b6ad6 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:40:27.970790 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea714d0-fd2e-42c6-b6a5-307c85044810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:40:27.971436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea714d0-fd2e-42c6-b6a5-307c85044810 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:27.971719 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea714d0-fd2e-42c6-b6a5-307c85044810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:27.971997 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea714d0-fd2e-42c6-b6a5-307c85044810 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:27.972727 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea714d0-fd2e-42c6-b6a5-307c85044810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:40:27.973034 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea714d0-fd2e-42c6-b6a5-307c85044810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:40:27.974697 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea714d0-fd2e-42c6-b6a5-307c85044810 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:40:27.985852 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1341/2689] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:40:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:40:27.989820 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a3620-e71c-4e94-967c-d5799f65448d None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:40:27.998718 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a3620-e71c-4e94-967c-d5799f65448d None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:40:28.003281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417af2f-5cf2-4db5-aeb3-9a9730b014ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:40:28.003917 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417af2f-5cf2-4db5-aeb3-9a9730b014ff admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:28.004192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417af2f-5cf2-4db5-aeb3-9a9730b014ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:28.004463 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417af2f-5cf2-4db5-aeb3-9a9730b014ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:28.005163 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417af2f-5cf2-4db5-aeb3-9a9730b014ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:40:28.007072 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417af2f-5cf2-4db5-aeb3-9a9730b014ff admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:40:28.044994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1349/2690] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:40:27 2021] POST /identity/v3/projects => generated 397 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:40:28.049122 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea714d0-fd2e-42c6-b6a5-307c85044810 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:40:28.059443 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea714d0-fd2e-42c6-b6a5-307c85044810 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:40:28.111258 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cc22f-baef-4752-b216-018181494761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:40:28.111909 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cc22f-baef-4752-b216-018181494761 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:28.112187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cc22f-baef-4752-b216-018181494761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:28.112461 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cc22f-baef-4752-b216-018181494761 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:28.113155 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cc22f-baef-4752-b216-018181494761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:40:28.115087 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cc22f-baef-4752-b216-018181494761 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:40:28.135549 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1342/2691] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:40:28 2021] POST /identity/v3/users => generated 299 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:40:28.139731 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417af2f-5cf2-4db5-aeb3-9a9730b014ff admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:40:28.150177 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417af2f-5cf2-4db5-aeb3-9a9730b014ff admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:40:28.154699 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b33638-9bad-4235-a771-45fedaa639f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:40:28.155345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b33638-9bad-4235-a771-45fedaa639f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:28.155625 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b33638-9bad-4235-a771-45fedaa639f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:28.155900 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b33638-9bad-4235-a771-45fedaa639f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:28.156629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b33638-9bad-4235-a771-45fedaa639f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:40:28.158236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b33638-9bad-4235-a771-45fedaa639f1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:40:28.171318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1350/2692] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:40:28 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:40:28.172359 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cc22f-baef-4752-b216-018181494761 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:40:28.182009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cc22f-baef-4752-b216-018181494761 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:40:28.186842 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc915ea-9a27-46f9-abdd-14f88edab902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:40:28.187496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc915ea-9a27-46f9-abdd-14f88edab902 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:28.187848 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc915ea-9a27-46f9-abdd-14f88edab902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:28.188039 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc915ea-9a27-46f9-abdd-14f88edab902 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:28.188770 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc915ea-9a27-46f9-abdd-14f88edab902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:40:28.190557 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc915ea-9a27-46f9-abdd-14f88edab902 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:40:28.204987 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1343/2693] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:40:28 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:40:28.208847 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b33638-9bad-4235-a771-45fedaa639f1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:40:28.219380 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b33638-9bad-4235-a771-45fedaa639f1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:40:28.223936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d70839-9b18-462a-ba13-ff878b78aff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:40:28.224800 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d70839-9b18-462a-ba13-ff878b78aff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:28.225079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d70839-9b18-462a-ba13-ff878b78aff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:28.225351 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d70839-9b18-462a-ba13-ff878b78aff1 admin admin] PATH_INFO: `/v3/projects/d45c9b388d4a41fdbb738ff0f9c497c9/users/bc2a50d1a5f84d048b4e3e9f185f75ee/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:28.239961 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d70839-9b18-462a-ba13-ff878b78aff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45c9b388d4a41fdbb738ff0f9c497c9, user_id=bc2a50d1a5f84d048b4e3e9f185f75ee, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:40:28.242630 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d70839-9b18-462a-ba13-ff878b78aff1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:40:28.254795 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1351/2694] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:40:28 2021] PUT /identity/v3/projects/d45c9b388d4a41fdbb738ff0f9c497c9/users/bc2a50d1a5f84d048b4e3e9f185f75ee/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:40:28.264709 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb5861-b2ee-4611-aff3-7e071f2ce0cc None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:28.264999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb5861-b2ee-4611-aff3-7e071f2ce0cc None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:28.265281 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb5861-b2ee-4611-aff3-7e071f2ce0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:28.292045 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-defb5861-b2ee-4611-aff3-7e071f2ce0cc None None] MFA Rules not processed for user `bc2a50d1a5f84d048b4e3e9f185f75ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:40:28.293254 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-defb5861-b2ee-4611-aff3-7e071f2ce0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:40:28.353532 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1344/2695] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:40:28 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:40:28.363860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d70839-9b18-462a-ba13-ff878b78aff1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:40:28.365562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f1d70839-9b18-462a-ba13-ff878b78aff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:40:28.420605 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d70839-9b18-462a-ba13-ff878b78aff1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:40:28.424249 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97df7f-4357-46f1-919d-eddd45ea53a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:40:28.424811 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97df7f-4357-46f1-919d-eddd45ea53a8 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:28.425107 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97df7f-4357-46f1-919d-eddd45ea53a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:28.425402 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97df7f-4357-46f1-919d-eddd45ea53a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:28.434061 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97df7f-4357-46f1-919d-eddd45ea53a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:40:28.435473 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97df7f-4357-46f1-919d-eddd45ea53a8 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:40:28.443901 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1352/2696] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:40:28 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:40:36.388942 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb5861-b2ee-4611-aff3-7e071f2ce0cc None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:40:36.447063 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb5861-b2ee-4611-aff3-7e071f2ce0cc None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:40:36.451447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9297084-2e7d-44c1-822c-a2a69bf8e6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:40:36.452285 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9297084-2e7d-44c1-822c-a2a69bf8e6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:36.452560 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9297084-2e7d-44c1-822c-a2a69bf8e6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:36.452827 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9297084-2e7d-44c1-822c-a2a69bf8e6ff admin admin] PATH_INFO: `/v3/users/bc2a50d1a5f84d048b4e3e9f185f75ee` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:36.454002 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9297084-2e7d-44c1-822c-a2a69bf8e6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc2a50d1a5f84d048b4e3e9f185f75ee)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:40:36.455900 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9297084-2e7d-44c1-822c-a2a69bf8e6ff admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:40:36.499779 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b9297084-2e7d-44c1-822c-a2a69bf8e6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc2a50d1a5f84d048b4e3e9f185f75ee'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:36.510953 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b9297084-2e7d-44c1-822c-a2a69bf8e6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc2a50d1a5f84d048b4e3e9f185f75ee'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:36.517642 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b9297084-2e7d-44c1-822c-a2a69bf8e6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc2a50d1a5f84d048b4e3e9f185f75ee'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:36.524694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b9297084-2e7d-44c1-822c-a2a69bf8e6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc2a50d1a5f84d048b4e3e9f185f75ee'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:36.525334 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b9297084-2e7d-44c1-822c-a2a69bf8e6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc2a50d1a5f84d048b4e3e9f185f75ee'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:36.531325 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1345/2697] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:40:36 2021] DELETE /identity/v3/users/bc2a50d1a5f84d048b4e3e9f185f75ee => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:40:36.535830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598e836-71f1-4fd6-9431-b52acb9b6730 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:36.536293 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598e836-71f1-4fd6-9431-b52acb9b6730 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:36.536402 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598e836-71f1-4fd6-9431-b52acb9b6730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:36.553719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-0598e836-71f1-4fd6-9431-b52acb9b6730 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:40:36.554961 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-0598e836-71f1-4fd6-9431-b52acb9b6730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:40:36.611131 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1353/2698] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:40:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:40:36.620774 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9297084-2e7d-44c1-822c-a2a69bf8e6ff admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:40:36.622179 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b9297084-2e7d-44c1-822c-a2a69bf8e6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:40:36.687222 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9297084-2e7d-44c1-822c-a2a69bf8e6ff admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:40:36.690875 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474d8b9-3ef2-4026-ac78-73a99c62d01a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:40:36.691535 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474d8b9-3ef2-4026-ac78-73a99c62d01a service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:36.691816 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474d8b9-3ef2-4026-ac78-73a99c62d01a service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:36.692091 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474d8b9-3ef2-4026-ac78-73a99c62d01a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:36.700897 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474d8b9-3ef2-4026-ac78-73a99c62d01a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:40:36.702349 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474d8b9-3ef2-4026-ac78-73a99c62d01a service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:40:36.711975 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1346/2699] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:40:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:40:36.971407 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598e836-71f1-4fd6-9431-b52acb9b6730 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:40:36.973040 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-0598e836-71f1-4fd6-9431-b52acb9b6730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:40:36.984613 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598e836-71f1-4fd6-9431-b52acb9b6730 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:40:36.989348 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944e292-4d29-4835-a390-99609656f335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:40:36.990221 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944e292-4d29-4835-a390-99609656f335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:40:36.990499 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944e292-4d29-4835-a390-99609656f335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:40:36.990767 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944e292-4d29-4835-a390-99609656f335 admin admin] PATH_INFO: `/v3/projects/d45c9b388d4a41fdbb738ff0f9c497c9` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:40:36.991965 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944e292-4d29-4835-a390-99609656f335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d45c9b388d4a41fdbb738ff0f9c497c9)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:40:36.993842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944e292-4d29-4835-a390-99609656f335 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:40:37.037960 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6944e292-4d29-4835-a390-99609656f335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd45c9b388d4a41fdbb738ff0f9c497c9', 'request_id': 'req-6944e292-4d29-4835-a390-99609656f335'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:37.045740 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6944e292-4d29-4835-a390-99609656f335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd45c9b388d4a41fdbb738ff0f9c497c9', 'request_id': 'req-6944e292-4d29-4835-a390-99609656f335'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:37.051603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6944e292-4d29-4835-a390-99609656f335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd45c9b388d4a41fdbb738ff0f9c497c9', 'request_id': 'req-6944e292-4d29-4835-a390-99609656f335'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:37.061481 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6944e292-4d29-4835-a390-99609656f335 admin admin] The token cache is being invalidate because project d45c9b388d4a41fdbb738ff0f9c497c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:40:37.061761 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6944e292-4d29-4835-a390-99609656f335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:37.062399 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6944e292-4d29-4835-a390-99609656f335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:40:37.063881 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1354/2700] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:40:36 2021] DELETE /identity/v3/projects/d45c9b388d4a41fdbb738ff0f9c497c9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:13.977928 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474d8b9-3ef2-4026-ac78-73a99c62d01a service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:13.979315 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-4474d8b9-3ef2-4026-ac78-73a99c62d01a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:13.990157 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474d8b9-3ef2-4026-ac78-73a99c62d01a service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:14.035694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a6691-f428-4e70-a343-47d9fe1e3f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:14.036330 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a6691-f428-4e70-a343-47d9fe1e3f56 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:14.036609 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a6691-f428-4e70-a343-47d9fe1e3f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:14.036884 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a6691-f428-4e70-a343-47d9fe1e3f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:14.038660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1e5a6691-f428-4e70-a343-47d9fe1e3f56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:14.097034 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a6691-f428-4e70-a343-47d9fe1e3f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:14.098483 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a6691-f428-4e70-a343-47d9fe1e3f56 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:14.107849 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1347/2701] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:41:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:41:16.010947 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944e292-4d29-4835-a390-99609656f335 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:16.012622 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6944e292-4d29-4835-a390-99609656f335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:16.176236 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944e292-4d29-4835-a390-99609656f335 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:16.182255 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711676b1-c2f7-4892-8789-05f3afd61a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:16.182912 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711676b1-c2f7-4892-8789-05f3afd61a85 service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:16.183191 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711676b1-c2f7-4892-8789-05f3afd61a85 service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:16.183940 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711676b1-c2f7-4892-8789-05f3afd61a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:16.185768 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-711676b1-c2f7-4892-8789-05f3afd61a85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:16.199066 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711676b1-c2f7-4892-8789-05f3afd61a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:16.203099 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711676b1-c2f7-4892-8789-05f3afd61a85 service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:16.251728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1355/2702] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:41:16 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:41:18.298783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a6691-f428-4e70-a343-47d9fe1e3f56 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:18.300944 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1e5a6691-f428-4e70-a343-47d9fe1e3f56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:18.321703 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a6691-f428-4e70-a343-47d9fe1e3f56 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:18.328765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10f7fb-99e4-45ed-916d-6bd9638844d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:18.329862 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10f7fb-99e4-45ed-916d-6bd9638844d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:18.330630 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10f7fb-99e4-45ed-916d-6bd9638844d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:18.331242 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10f7fb-99e4-45ed-916d-6bd9638844d9 admin admin] PATH_INFO: `/v3/users/fedc11e2dbd74b919982a0657222cca4` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:18.332931 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10f7fb-99e4-45ed-916d-6bd9638844d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fedc11e2dbd74b919982a0657222cca4)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:18.335491 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10f7fb-99e4-45ed-916d-6bd9638844d9 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:18.392304 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ce10f7fb-99e4-45ed-916d-6bd9638844d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fedc11e2dbd74b919982a0657222cca4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:18.410726 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ce10f7fb-99e4-45ed-916d-6bd9638844d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fedc11e2dbd74b919982a0657222cca4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:18.419317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ce10f7fb-99e4-45ed-916d-6bd9638844d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fedc11e2dbd74b919982a0657222cca4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:18.426079 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ce10f7fb-99e4-45ed-916d-6bd9638844d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fedc11e2dbd74b919982a0657222cca4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:18.426712 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ce10f7fb-99e4-45ed-916d-6bd9638844d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fedc11e2dbd74b919982a0657222cca4'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:18.433341 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1348/2703] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:41:18 2021] DELETE /identity/v3/users/fedc11e2dbd74b919982a0657222cca4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:18.611206 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711676b1-c2f7-4892-8789-05f3afd61a85 service nova] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:18.630297 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711676b1-c2f7-4892-8789-05f3afd61a85 service nova] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:18.705760 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e9f2b-8544-4476-8d65-c84a39e67ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:18.706669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e9f2b-8544-4476-8d65-c84a39e67ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:18.707835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e9f2b-8544-4476-8d65-c84a39e67ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:18.708126 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e9f2b-8544-4476-8d65-c84a39e67ad8 admin admin] PATH_INFO: `/v3/projects/9f16202549724b878f908d68384ec9c9` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:18.709396 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e9f2b-8544-4476-8d65-c84a39e67ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f16202549724b878f908d68384ec9c9)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:18.711420 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e9f2b-8544-4476-8d65-c84a39e67ad8 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:18.759093 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-539e9f2b-8544-4476-8d65-c84a39e67ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f16202549724b878f908d68384ec9c9', 'request_id': 'req-539e9f2b-8544-4476-8d65-c84a39e67ad8'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:18.766564 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-539e9f2b-8544-4476-8d65-c84a39e67ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f16202549724b878f908d68384ec9c9', 'request_id': 'req-539e9f2b-8544-4476-8d65-c84a39e67ad8'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:18.773318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-539e9f2b-8544-4476-8d65-c84a39e67ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f16202549724b878f908d68384ec9c9', 'request_id': 'req-539e9f2b-8544-4476-8d65-c84a39e67ad8'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:18.783674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-539e9f2b-8544-4476-8d65-c84a39e67ad8 admin admin] The token cache is being invalidate because project 9f16202549724b878f908d68384ec9c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:41:18.783970 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-539e9f2b-8544-4476-8d65-c84a39e67ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:18.784699 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-539e9f2b-8544-4476-8d65-c84a39e67ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:18.786260 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1356/2704] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:41:18 2021] DELETE /identity/v3/projects/9f16202549724b878f908d68384ec9c9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:18.794188 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bcbe5-b59d-40c0-9059-1fea3e50ba63 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:18.794480 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bcbe5-b59d-40c0-9059-1fea3e50ba63 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:18.794767 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bcbe5-b59d-40c0-9059-1fea3e50ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:18.814930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-cf0bcbe5-b59d-40c0-9059-1fea3e50ba63 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:18.816115 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-cf0bcbe5-b59d-40c0-9059-1fea3e50ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:18.875822 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1349/2705] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:18.883573 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a8c84-118d-4728-89a9-1076ba682d35 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:18.883862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a8c84-118d-4728-89a9-1076ba682d35 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:18.884142 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a8c84-118d-4728-89a9-1076ba682d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:18.901786 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-7d5a8c84-118d-4728-89a9-1076ba682d35 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:18.903145 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7d5a8c84-118d-4728-89a9-1076ba682d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:18.910999 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1357/2706] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:18.915904 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bcbe5-b59d-40c0-9059-1fea3e50ba63 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:18.925229 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bcbe5-b59d-40c0-9059-1fea3e50ba63 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:18.931342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30010-e444-42d3-a8ad-1de3a436b093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:18.931999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30010-e444-42d3-a8ad-1de3a436b093 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:18.932281 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30010-e444-42d3-a8ad-1de3a436b093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:18.932543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30010-e444-42d3-a8ad-1de3a436b093 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:18.933310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a30010-e444-42d3-a8ad-1de3a436b093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:41:18.933618 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a30010-e444-42d3-a8ad-1de3a436b093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:18.935264 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a30010-e444-42d3-a8ad-1de3a436b093 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:18.947382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1350/2707] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:41:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:41:18.951985 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a8c84-118d-4728-89a9-1076ba682d35 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:18.962691 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a8c84-118d-4728-89a9-1076ba682d35 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:18.967769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00d87b-6741-4c2c-815b-da4e4e655bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:18.968421 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00d87b-6741-4c2c-815b-da4e4e655bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:18.968702 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00d87b-6741-4c2c-815b-da4e4e655bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:18.968977 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00d87b-6741-4c2c-815b-da4e4e655bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:18.969734 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00d87b-6741-4c2c-815b-da4e4e655bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:18.971652 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00d87b-6741-4c2c-815b-da4e4e655bc5 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:18.999191 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1358/2708] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:41:18 2021] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:41:19.007722 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30010-e444-42d3-a8ad-1de3a436b093 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:19.017819 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30010-e444-42d3-a8ad-1de3a436b093 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:19.074171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1d120-1e9d-4d36-9c9e-68e62ba27179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:19.074837 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1d120-1e9d-4d36-9c9e-68e62ba27179 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:19.075117 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1d120-1e9d-4d36-9c9e-68e62ba27179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:19.075389 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1d120-1e9d-4d36-9c9e-68e62ba27179 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:19.076092 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1d120-1e9d-4d36-9c9e-68e62ba27179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:19.078029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1d120-1e9d-4d36-9c9e-68e62ba27179 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:19.099219 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1351/2709] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:41:19 2021] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:41:19.103390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00d87b-6741-4c2c-815b-da4e4e655bc5 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:19.113654 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00d87b-6741-4c2c-815b-da4e4e655bc5 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:19.118875 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef58c96-715e-4e47-b4e8-cf87206a878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:19.119523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef58c96-715e-4e47-b4e8-cf87206a878c admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:19.119801 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef58c96-715e-4e47-b4e8-cf87206a878c admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:19.120076 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef58c96-715e-4e47-b4e8-cf87206a878c admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:19.120829 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef58c96-715e-4e47-b4e8-cf87206a878c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:19.122442 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef58c96-715e-4e47-b4e8-cf87206a878c admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:19.133608 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1359/2710] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:41:19 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:41:19.137658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1d120-1e9d-4d36-9c9e-68e62ba27179 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:19.148040 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1d120-1e9d-4d36-9c9e-68e62ba27179 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:19.152794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8bc9a-c2bc-4834-ab11-d39e53ebdf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:19.153505 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8bc9a-c2bc-4834-ab11-d39e53ebdf2c admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:19.153815 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8bc9a-c2bc-4834-ab11-d39e53ebdf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:19.154045 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8bc9a-c2bc-4834-ab11-d39e53ebdf2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:19.154894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8bc9a-c2bc-4834-ab11-d39e53ebdf2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:19.156592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8bc9a-c2bc-4834-ab11-d39e53ebdf2c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:19.166617 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1352/2711] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:41:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:41:19.170898 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef58c96-715e-4e47-b4e8-cf87206a878c admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:19.182078 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef58c96-715e-4e47-b4e8-cf87206a878c admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:19.186741 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b2529-e7be-4c14-a6b2-e231d122f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:19.187620 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b2529-e7be-4c14-a6b2-e231d122f1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:19.187902 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b2529-e7be-4c14-a6b2-e231d122f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:19.188185 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b2529-e7be-4c14-a6b2-e231d122f1a8 admin admin] PATH_INFO: `/v3/projects/01b00be88b5047079b1804dd9487710e/users/a0d41a082acf4c71980d108539f80780/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:19.205478 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b2529-e7be-4c14-a6b2-e231d122f1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b00be88b5047079b1804dd9487710e, user_id=a0d41a082acf4c71980d108539f80780, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:19.208425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b2529-e7be-4c14-a6b2-e231d122f1a8 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:19.222711 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1360/2712] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:41:19 2021] PUT /identity/v3/projects/01b00be88b5047079b1804dd9487710e/users/a0d41a082acf4c71980d108539f80780/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:41:19.233558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ea68-8de8-4965-b58c-ffa1ccdf5309 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:19.233851 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ea68-8de8-4965-b58c-ffa1ccdf5309 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:19.234162 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ea68-8de8-4965-b58c-ffa1ccdf5309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:19.261635 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-2b45ea68-8de8-4965-b58c-ffa1ccdf5309 None None] MFA Rules not processed for user `a0d41a082acf4c71980d108539f80780`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:19.263123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-2b45ea68-8de8-4965-b58c-ffa1ccdf5309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:19.329934 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1353/2713] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:19 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:19.341440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b2529-e7be-4c14-a6b2-e231d122f1a8 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:19.343199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6d6b2529-e7be-4c14-a6b2-e231d122f1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:19.417634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b2529-e7be-4c14-a6b2-e231d122f1a8 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:19.423410 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca31a29-2afd-4712-baea-53034f0faa0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:19.424047 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca31a29-2afd-4712-baea-53034f0faa0e service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:19.424323 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca31a29-2afd-4712-baea-53034f0faa0e service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:19.424590 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca31a29-2afd-4712-baea-53034f0faa0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:19.432678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca31a29-2afd-4712-baea-53034f0faa0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:19.434263 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca31a29-2afd-4712-baea-53034f0faa0e service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:19.443023 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1361/2714] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:41:19 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:41:19.625382 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8395c7d-f9bf-45be-bc7c-3bfc8976e3fc None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:19.625677 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8395c7d-f9bf-45be-bc7c-3bfc8976e3fc None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:19.625956 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8395c7d-f9bf-45be-bc7c-3bfc8976e3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:19.631393 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca31a29-2afd-4712-baea-53034f0faa0e service nova] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:19.661204 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-e8395c7d-f9bf-45be-bc7c-3bfc8976e3fc None None] MFA Rules not processed for user `a5fb31c3d4874e13ba22e0242d4aaa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:19.663096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e8395c7d-f9bf-45be-bc7c-3bfc8976e3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:19.691764 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca31a29-2afd-4712-baea-53034f0faa0e service nova] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:19.696403 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a983b-ba59-4e3b-b148-d8d5f0281dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:19.697259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a983b-ba59-4e3b-b148-d8d5f0281dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:19.697541 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a983b-ba59-4e3b-b148-d8d5f0281dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:19.697813 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a983b-ba59-4e3b-b148-d8d5f0281dae admin admin] PATH_INFO: `/v3/users/a0d41a082acf4c71980d108539f80780` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:19.699045 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a983b-ba59-4e3b-b148-d8d5f0281dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d41a082acf4c71980d108539f80780)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:19.701040 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a983b-ba59-4e3b-b148-d8d5f0281dae admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:19.724671 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1354/2715] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:19 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:19.745227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-792a983b-ba59-4e3b-b148-d8d5f0281dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d41a082acf4c71980d108539f80780'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:19.756988 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-792a983b-ba59-4e3b-b148-d8d5f0281dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d41a082acf4c71980d108539f80780'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:19.764392 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-792a983b-ba59-4e3b-b148-d8d5f0281dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d41a082acf4c71980d108539f80780'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:19.765266 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-792a983b-ba59-4e3b-b148-d8d5f0281dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d41a082acf4c71980d108539f80780'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:19.765953 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-792a983b-ba59-4e3b-b148-d8d5f0281dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d41a082acf4c71980d108539f80780'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:19.778480 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1362/2716] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:41:19 2021] DELETE /identity/v3/users/a0d41a082acf4c71980d108539f80780 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:41:19.783148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46a873-fb25-41b1-bd96-c390c506cdf6 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:19.783438 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46a873-fb25-41b1-bd96-c390c506cdf6 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:19.783715 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46a873-fb25-41b1-bd96-c390c506cdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:19.801639 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-6e46a873-fb25-41b1-bd96-c390c506cdf6 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:19.802852 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6e46a873-fb25-41b1-bd96-c390c506cdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:19.860469 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1355/2717] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:19.871042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a983b-ba59-4e3b-b148-d8d5f0281dae admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:19.872501 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-792a983b-ba59-4e3b-b148-d8d5f0281dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:19.929087 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a983b-ba59-4e3b-b148-d8d5f0281dae admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:19.934518 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ed1c1-8753-44e1-a159-8b318fa1cb6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:19.935160 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ed1c1-8753-44e1-a159-8b318fa1cb6d service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:19.935437 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ed1c1-8753-44e1-a159-8b318fa1cb6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:19.935707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ed1c1-8753-44e1-a159-8b318fa1cb6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:19.945376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ed1c1-8753-44e1-a159-8b318fa1cb6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:19.946815 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ed1c1-8753-44e1-a159-8b318fa1cb6d service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:19.956704 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1363/2718] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:41:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:41:20.307840 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46a873-fb25-41b1-bd96-c390c506cdf6 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:20.309412 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6e46a873-fb25-41b1-bd96-c390c506cdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:20.322147 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46a873-fb25-41b1-bd96-c390c506cdf6 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:20.327987 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce07dd-4b43-494d-84c2-70c4a96d503d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:20.329171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce07dd-4b43-494d-84c2-70c4a96d503d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:20.329665 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce07dd-4b43-494d-84c2-70c4a96d503d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:20.330197 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce07dd-4b43-494d-84c2-70c4a96d503d admin admin] PATH_INFO: `/v3/projects/01b00be88b5047079b1804dd9487710e` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:20.332432 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce07dd-4b43-494d-84c2-70c4a96d503d admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b00be88b5047079b1804dd9487710e)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:20.335493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce07dd-4b43-494d-84c2-70c4a96d503d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:20.393870 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-17ce07dd-4b43-494d-84c2-70c4a96d503d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b00be88b5047079b1804dd9487710e', 'request_id': 'req-17ce07dd-4b43-494d-84c2-70c4a96d503d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:20.402684 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-17ce07dd-4b43-494d-84c2-70c4a96d503d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b00be88b5047079b1804dd9487710e', 'request_id': 'req-17ce07dd-4b43-494d-84c2-70c4a96d503d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:20.409323 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-17ce07dd-4b43-494d-84c2-70c4a96d503d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b00be88b5047079b1804dd9487710e', 'request_id': 'req-17ce07dd-4b43-494d-84c2-70c4a96d503d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:20.426508 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-17ce07dd-4b43-494d-84c2-70c4a96d503d admin admin] The token cache is being invalidate because project 01b00be88b5047079b1804dd9487710e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:41:20.427111 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-17ce07dd-4b43-494d-84c2-70c4a96d503d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:20.428585 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-17ce07dd-4b43-494d-84c2-70c4a96d503d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:20.430543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1356/2719] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:41:20 2021] DELETE /identity/v3/projects/01b00be88b5047079b1804dd9487710e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:20.436508 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626a66e-82a8-4e78-a4f3-29e329577b3a None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:20.436823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626a66e-82a8-4e78-a4f3-29e329577b3a None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:20.437114 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626a66e-82a8-4e78-a4f3-29e329577b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:20.463098 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a626a66e-82a8-4e78-a4f3-29e329577b3a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:20.464333 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a626a66e-82a8-4e78-a4f3-29e329577b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:20.523118 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1364/2720] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:20.531087 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745b030-6a5c-4da4-a849-0296dbccb583 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:20.531369 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745b030-6a5c-4da4-a849-0296dbccb583 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:20.531644 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745b030-6a5c-4da4-a849-0296dbccb583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:20.550348 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-8745b030-6a5c-4da4-a849-0296dbccb583 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:20.551549 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8745b030-6a5c-4da4-a849-0296dbccb583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:20.560690 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1357/2721] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:41:20.565067 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626a66e-82a8-4e78-a4f3-29e329577b3a None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:20.587243 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626a66e-82a8-4e78-a4f3-29e329577b3a None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:20.592224 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90816bf-eeda-410e-a336-40b8768089ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:20.592942 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90816bf-eeda-410e-a336-40b8768089ec admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:20.593225 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90816bf-eeda-410e-a336-40b8768089ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:20.593501 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90816bf-eeda-410e-a336-40b8768089ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:20.594275 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90816bf-eeda-410e-a336-40b8768089ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:41:20.594583 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90816bf-eeda-410e-a336-40b8768089ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:20.596170 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90816bf-eeda-410e-a336-40b8768089ec admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:20.611086 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1365/2722] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:41:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:41:20.612247 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745b030-6a5c-4da4-a849-0296dbccb583 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:20.622593 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745b030-6a5c-4da4-a849-0296dbccb583 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:20.627671 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52fe08-e73c-4ea5-9a21-9f0529840a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:20.628521 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52fe08-e73c-4ea5-9a21-9f0529840a5b admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:20.628989 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52fe08-e73c-4ea5-9a21-9f0529840a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:20.629267 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52fe08-e73c-4ea5-9a21-9f0529840a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:20.629999 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52fe08-e73c-4ea5-9a21-9f0529840a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:20.632644 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52fe08-e73c-4ea5-9a21-9f0529840a5b admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:20.657621 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1358/2723] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:41:20 2021] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:41:20.661429 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90816bf-eeda-410e-a336-40b8768089ec admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:20.671842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90816bf-eeda-410e-a336-40b8768089ec admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:20.730627 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ba21d-02e2-4e21-9c81-6256b2cbd177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:20.731291 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ba21d-02e2-4e21-9c81-6256b2cbd177 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:20.731571 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ba21d-02e2-4e21-9c81-6256b2cbd177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:20.731869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ba21d-02e2-4e21-9c81-6256b2cbd177 admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:20.732532 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ba21d-02e2-4e21-9c81-6256b2cbd177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:20.734442 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ba21d-02e2-4e21-9c81-6256b2cbd177 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:20.753561 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1366/2724] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:41:20 2021] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:41:20.757890 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52fe08-e73c-4ea5-9a21-9f0529840a5b admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:20.768135 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52fe08-e73c-4ea5-9a21-9f0529840a5b admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:20.773278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebcd54-3938-4197-b9af-a5c332c7c0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:20.773926 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebcd54-3938-4197-b9af-a5c332c7c0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:20.774236 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebcd54-3938-4197-b9af-a5c332c7c0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:20.774507 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebcd54-3938-4197-b9af-a5c332c7c0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:20.775236 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebcd54-3938-4197-b9af-a5c332c7c0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:20.776813 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebcd54-3938-4197-b9af-a5c332c7c0b2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:20.786953 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1359/2725] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:41:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:41:20.791707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ba21d-02e2-4e21-9c81-6256b2cbd177 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:20.801613 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ba21d-02e2-4e21-9c81-6256b2cbd177 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:20.806286 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ae91a-25b3-44ac-a513-40a9002d1032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:20.806945 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ae91a-25b3-44ac-a513-40a9002d1032 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:20.807232 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ae91a-25b3-44ac-a513-40a9002d1032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:20.807512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ae91a-25b3-44ac-a513-40a9002d1032 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:20.808251 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ae91a-25b3-44ac-a513-40a9002d1032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:20.809840 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ae91a-25b3-44ac-a513-40a9002d1032 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:20.820153 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1367/2726] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:41:20 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:41:20.824304 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebcd54-3938-4197-b9af-a5c332c7c0b2 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:20.835205 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebcd54-3938-4197-b9af-a5c332c7c0b2 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:20.841126 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde9c20-98a0-4392-b6a3-8839507371ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:20.841998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde9c20-98a0-4392-b6a3-8839507371ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:20.842303 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde9c20-98a0-4392-b6a3-8839507371ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:20.842604 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde9c20-98a0-4392-b6a3-8839507371ea admin admin] PATH_INFO: `/v3/projects/6e871c464fc8468fbbc4a29c67ddf83e/users/d7bcf2527de14688b1a9e639da0c85f7/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:20.858224 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde9c20-98a0-4392-b6a3-8839507371ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e871c464fc8468fbbc4a29c67ddf83e, user_id=d7bcf2527de14688b1a9e639da0c85f7, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:20.860833 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde9c20-98a0-4392-b6a3-8839507371ea admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:20.872819 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1360/2727] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:41:20 2021] PUT /identity/v3/projects/6e871c464fc8468fbbc4a29c67ddf83e/users/d7bcf2527de14688b1a9e639da0c85f7/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:41:20.883410 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f0e93-5ee4-4ede-ae4c-f9eab38371ce None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:20.883633 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f0e93-5ee4-4ede-ae4c-f9eab38371ce None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:20.884019 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f0e93-5ee4-4ede-ae4c-f9eab38371ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:20.911090 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-d02f0e93-5ee4-4ede-ae4c-f9eab38371ce None None] MFA Rules not processed for user `d7bcf2527de14688b1a9e639da0c85f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:20.912321 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d02f0e93-5ee4-4ede-ae4c-f9eab38371ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:20.978427 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1368/2728] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:20 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:41:20.982996 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde9c20-98a0-4392-b6a3-8839507371ea admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:21.041305 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde9c20-98a0-4392-b6a3-8839507371ea admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:21.045899 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37a0a9-d50d-4122-bc93-61adbdbfaa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:21.046566 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37a0a9-d50d-4122-bc93-61adbdbfaa27 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:21.046848 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37a0a9-d50d-4122-bc93-61adbdbfaa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:21.047125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37a0a9-d50d-4122-bc93-61adbdbfaa27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:21.047813 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37a0a9-d50d-4122-bc93-61adbdbfaa27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:21.049698 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37a0a9-d50d-4122-bc93-61adbdbfaa27 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:21.074211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1361/2729] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:41:20 2021] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:41:21.078228 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f0e93-5ee4-4ede-ae4c-f9eab38371ce None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:21.088600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f0e93-5ee4-4ede-ae4c-f9eab38371ce None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:21.143238 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03f3a7-6bba-4f33-896b-3eba3aab4bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:21.143824 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03f3a7-6bba-4f33-896b-3eba3aab4bbe admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:21.144130 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03f3a7-6bba-4f33-896b-3eba3aab4bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:21.144407 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03f3a7-6bba-4f33-896b-3eba3aab4bbe admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:21.145104 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03f3a7-6bba-4f33-896b-3eba3aab4bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:21.147070 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03f3a7-6bba-4f33-896b-3eba3aab4bbe admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:21.166045 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1369/2730] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:41:21 2021] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:41:21.170097 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37a0a9-d50d-4122-bc93-61adbdbfaa27 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:21.180700 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37a0a9-d50d-4122-bc93-61adbdbfaa27 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:21.185344 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e6a50-6379-4ce3-88fc-a6a9ef4ffc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:21.186006 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e6a50-6379-4ce3-88fc-a6a9ef4ffc67 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:21.186302 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e6a50-6379-4ce3-88fc-a6a9ef4ffc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:21.186578 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e6a50-6379-4ce3-88fc-a6a9ef4ffc67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:21.187306 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e6a50-6379-4ce3-88fc-a6a9ef4ffc67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:21.188893 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e6a50-6379-4ce3-88fc-a6a9ef4ffc67 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:21.200718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1362/2731] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:41:21 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:41:21.204859 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03f3a7-6bba-4f33-896b-3eba3aab4bbe admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:21.215127 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03f3a7-6bba-4f33-896b-3eba3aab4bbe admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:21.219707 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472b759-e664-4c9e-9a6f-0a45aaefd547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:21.220579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472b759-e664-4c9e-9a6f-0a45aaefd547 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:21.220858 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472b759-e664-4c9e-9a6f-0a45aaefd547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:21.221133 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472b759-e664-4c9e-9a6f-0a45aaefd547 admin admin] PATH_INFO: `/v3/projects/31a66513cc124739aa027ea046a25b33/users/4c3c30db96d34b7cbc838e969812d6f3/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:21.236354 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472b759-e664-4c9e-9a6f-0a45aaefd547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a66513cc124739aa027ea046a25b33, user_id=4c3c30db96d34b7cbc838e969812d6f3, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:21.239035 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472b759-e664-4c9e-9a6f-0a45aaefd547 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:21.253682 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1370/2732] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:41:21 2021] PUT /identity/v3/projects/31a66513cc124739aa027ea046a25b33/users/4c3c30db96d34b7cbc838e969812d6f3/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:41:21.257625 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e6a50-6379-4ce3-88fc-a6a9ef4ffc67 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:21.267901 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e6a50-6379-4ce3-88fc-a6a9ef4ffc67 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:21.323686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fc26e-7104-4755-baa4-bd21108adefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:21.324604 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fc26e-7104-4755-baa4-bd21108adefb admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:21.324953 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fc26e-7104-4755-baa4-bd21108adefb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:21.326116 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fc26e-7104-4755-baa4-bd21108adefb admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:21.326865 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fc26e-7104-4755-baa4-bd21108adefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:21.328462 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fc26e-7104-4755-baa4-bd21108adefb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:21.343641 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1363/2733] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:41:21 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:41:21.344715 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472b759-e664-4c9e-9a6f-0a45aaefd547 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:21.355334 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472b759-e664-4c9e-9a6f-0a45aaefd547 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:21.360600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc7212-88c6-4a24-8fd3-38efd9dc8edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:21.361485 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc7212-88c6-4a24-8fd3-38efd9dc8edd admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:21.361769 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc7212-88c6-4a24-8fd3-38efd9dc8edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:21.362067 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc7212-88c6-4a24-8fd3-38efd9dc8edd admin admin] PATH_INFO: `/v3/projects/31a66513cc124739aa027ea046a25b33/users/4c3c30db96d34b7cbc838e969812d6f3/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:21.364067 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc7212-88c6-4a24-8fd3-38efd9dc8edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a66513cc124739aa027ea046a25b33, user_id=4c3c30db96d34b7cbc838e969812d6f3, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:21.367402 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc7212-88c6-4a24-8fd3-38efd9dc8edd admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:21.378064 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1371/2734] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:41:21 2021] PUT /identity/v3/projects/31a66513cc124739aa027ea046a25b33/users/4c3c30db96d34b7cbc838e969812d6f3/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:21.390299 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391ed9d-cd4c-40d7-b8c6-4644ecb50cbb None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:21.390583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391ed9d-cd4c-40d7-b8c6-4644ecb50cbb None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:21.391060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391ed9d-cd4c-40d7-b8c6-4644ecb50cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:21.422302 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-8391ed9d-cd4c-40d7-b8c6-4644ecb50cbb None None] MFA Rules not processed for user `4c3c30db96d34b7cbc838e969812d6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:21.422995 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8391ed9d-cd4c-40d7-b8c6-4644ecb50cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:21.496832 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1364/2735] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:21 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:21.507352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc7212-88c6-4a24-8fd3-38efd9dc8edd admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:21.509430 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-33fc7212-88c6-4a24-8fd3-38efd9dc8edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:21.583798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc7212-88c6-4a24-8fd3-38efd9dc8edd admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:21.587856 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5edfb-81ad-4c01-ae72-292be5053792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:21.588501 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5edfb-81ad-4c01-ae72-292be5053792 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:21.588779 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5edfb-81ad-4c01-ae72-292be5053792 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:21.589052 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5edfb-81ad-4c01-ae72-292be5053792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:21.598675 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5edfb-81ad-4c01-ae72-292be5053792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:21.600674 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5edfb-81ad-4c01-ae72-292be5053792 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:21.610129 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1372/2736] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:41:21 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:41:23.003392 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391ed9d-cd4c-40d7-b8c6-4644ecb50cbb None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:23.062493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391ed9d-cd4c-40d7-b8c6-4644ecb50cbb None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:23.067029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5372b7-2cd6-4960-9b7b-23ccdba3a862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:23.067888 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5372b7-2cd6-4960-9b7b-23ccdba3a862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:23.068165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5372b7-2cd6-4960-9b7b-23ccdba3a862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:23.068436 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5372b7-2cd6-4960-9b7b-23ccdba3a862 admin admin] PATH_INFO: `/v3/users/d7bcf2527de14688b1a9e639da0c85f7` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:23.070214 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5372b7-2cd6-4960-9b7b-23ccdba3a862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7bcf2527de14688b1a9e639da0c85f7)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:23.072120 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5372b7-2cd6-4960-9b7b-23ccdba3a862 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:23.121856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-df5372b7-2cd6-4960-9b7b-23ccdba3a862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7bcf2527de14688b1a9e639da0c85f7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:23.134188 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-df5372b7-2cd6-4960-9b7b-23ccdba3a862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7bcf2527de14688b1a9e639da0c85f7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:23.141665 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-df5372b7-2cd6-4960-9b7b-23ccdba3a862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7bcf2527de14688b1a9e639da0c85f7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:23.148986 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-df5372b7-2cd6-4960-9b7b-23ccdba3a862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7bcf2527de14688b1a9e639da0c85f7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:23.149632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-df5372b7-2cd6-4960-9b7b-23ccdba3a862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7bcf2527de14688b1a9e639da0c85f7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:23.155800 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1365/2737] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:41:23 2021] DELETE /identity/v3/users/d7bcf2527de14688b1a9e639da0c85f7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:23.160299 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f423e-3997-4768-9cd5-62530c97d118 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:23.160791 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f423e-3997-4768-9cd5-62530c97d118 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:23.160911 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f423e-3997-4768-9cd5-62530c97d118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:23.178682 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-c57f423e-3997-4768-9cd5-62530c97d118 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:23.179863 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c57f423e-3997-4768-9cd5-62530c97d118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:23.249892 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1373/2738] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:23.260360 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5372b7-2cd6-4960-9b7b-23ccdba3a862 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:23.261758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-df5372b7-2cd6-4960-9b7b-23ccdba3a862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:23.316948 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5372b7-2cd6-4960-9b7b-23ccdba3a862 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:23.321066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef055f-5822-45b3-91dc-382869ae7e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:23.321746 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef055f-5822-45b3-91dc-382869ae7e11 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:23.322045 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef055f-5822-45b3-91dc-382869ae7e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:23.322329 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef055f-5822-45b3-91dc-382869ae7e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:23.332158 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef055f-5822-45b3-91dc-382869ae7e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:23.333581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef055f-5822-45b3-91dc-382869ae7e11 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:23.343156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1366/2739] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:41:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:41:23.602799 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f423e-3997-4768-9cd5-62530c97d118 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:23.604957 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c57f423e-3997-4768-9cd5-62530c97d118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:23.630967 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f423e-3997-4768-9cd5-62530c97d118 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:23.635667 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae719a-769a-4798-b732-e840b46fa654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:23.636745 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae719a-769a-4798-b732-e840b46fa654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:23.637008 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae719a-769a-4798-b732-e840b46fa654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:23.637281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae719a-769a-4798-b732-e840b46fa654 admin admin] PATH_INFO: `/v3/projects/6e871c464fc8468fbbc4a29c67ddf83e` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:23.638527 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae719a-769a-4798-b732-e840b46fa654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e871c464fc8468fbbc4a29c67ddf83e)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:23.640444 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae719a-769a-4798-b732-e840b46fa654 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:23.686445 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b7ae719a-769a-4798-b732-e840b46fa654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e871c464fc8468fbbc4a29c67ddf83e', 'request_id': 'req-b7ae719a-769a-4798-b732-e840b46fa654'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:23.693560 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b7ae719a-769a-4798-b732-e840b46fa654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e871c464fc8468fbbc4a29c67ddf83e', 'request_id': 'req-b7ae719a-769a-4798-b732-e840b46fa654'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:23.700129 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b7ae719a-769a-4798-b732-e840b46fa654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e871c464fc8468fbbc4a29c67ddf83e', 'request_id': 'req-b7ae719a-769a-4798-b732-e840b46fa654'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:23.710828 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b7ae719a-769a-4798-b732-e840b46fa654 admin admin] The token cache is being invalidate because project 6e871c464fc8468fbbc4a29c67ddf83e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:41:23.711115 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b7ae719a-769a-4798-b732-e840b46fa654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:23.711755 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-b7ae719a-769a-4798-b732-e840b46fa654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:23.713314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1374/2740] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:41:23 2021] DELETE /identity/v3/projects/6e871c464fc8468fbbc4a29c67ddf83e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:23.717620 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef055f-5822-45b3-91dc-382869ae7e11 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:23.727814 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef055f-5822-45b3-91dc-382869ae7e11 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:23.782200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c67069-0cce-48a6-bc0f-61b8b5ff94eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:23.783060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c67069-0cce-48a6-bc0f-61b8b5ff94eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:23.783336 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c67069-0cce-48a6-bc0f-61b8b5ff94eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:23.783603 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c67069-0cce-48a6-bc0f-61b8b5ff94eb admin admin] PATH_INFO: `/v3/users/4c3c30db96d34b7cbc838e969812d6f3` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:23.784776 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c67069-0cce-48a6-bc0f-61b8b5ff94eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c3c30db96d34b7cbc838e969812d6f3)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:23.786704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c67069-0cce-48a6-bc0f-61b8b5ff94eb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:23.831982 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97c67069-0cce-48a6-bc0f-61b8b5ff94eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c3c30db96d34b7cbc838e969812d6f3'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:23.844442 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97c67069-0cce-48a6-bc0f-61b8b5ff94eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c3c30db96d34b7cbc838e969812d6f3'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:23.853477 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97c67069-0cce-48a6-bc0f-61b8b5ff94eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c3c30db96d34b7cbc838e969812d6f3'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:23.860356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97c67069-0cce-48a6-bc0f-61b8b5ff94eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c3c30db96d34b7cbc838e969812d6f3'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:23.860993 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-97c67069-0cce-48a6-bc0f-61b8b5ff94eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c3c30db96d34b7cbc838e969812d6f3'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:23.867374 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1367/2741] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:41:23 2021] DELETE /identity/v3/users/4c3c30db96d34b7cbc838e969812d6f3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:24.133694 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae719a-769a-4798-b732-e840b46fa654 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:24.135300 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b7ae719a-769a-4798-b732-e840b46fa654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:24.152734 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae719a-769a-4798-b732-e840b46fa654 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:24.207661 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb941aff-3e31-4da2-b0dc-b2d2a7c6346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:24.208516 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941aff-3e31-4da2-b0dc-b2d2a7c6346d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:24.208795 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941aff-3e31-4da2-b0dc-b2d2a7c6346d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:24.209067 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941aff-3e31-4da2-b0dc-b2d2a7c6346d admin admin] PATH_INFO: `/v3/projects/31a66513cc124739aa027ea046a25b33` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:24.210978 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb941aff-3e31-4da2-b0dc-b2d2a7c6346d admin admin] RBAC: Authorizing `identity:delete_project(project_id=31a66513cc124739aa027ea046a25b33)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:24.212863 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb941aff-3e31-4da2-b0dc-b2d2a7c6346d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:24.257965 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-bb941aff-3e31-4da2-b0dc-b2d2a7c6346d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31a66513cc124739aa027ea046a25b33', 'request_id': 'req-bb941aff-3e31-4da2-b0dc-b2d2a7c6346d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:24.265231 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-bb941aff-3e31-4da2-b0dc-b2d2a7c6346d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31a66513cc124739aa027ea046a25b33', 'request_id': 'req-bb941aff-3e31-4da2-b0dc-b2d2a7c6346d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:24.271695 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-bb941aff-3e31-4da2-b0dc-b2d2a7c6346d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31a66513cc124739aa027ea046a25b33', 'request_id': 'req-bb941aff-3e31-4da2-b0dc-b2d2a7c6346d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:24.282817 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-bb941aff-3e31-4da2-b0dc-b2d2a7c6346d admin admin] The token cache is being invalidate because project 31a66513cc124739aa027ea046a25b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:41:24.283104 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-bb941aff-3e31-4da2-b0dc-b2d2a7c6346d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:24.283723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-bb941aff-3e31-4da2-b0dc-b2d2a7c6346d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:24.285285 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1375/2742] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:41:24 2021] DELETE /identity/v3/projects/31a66513cc124739aa027ea046a25b33 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:24.291730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b24120-e1ec-4c1f-863d-a1725e13864a None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:24.292202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b24120-e1ec-4c1f-863d-a1725e13864a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:24.292405 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b24120-e1ec-4c1f-863d-a1725e13864a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:24.309398 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-17b24120-e1ec-4c1f-863d-a1725e13864a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:24.310672 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-17b24120-e1ec-4c1f-863d-a1725e13864a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:24.366821 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1368/2743] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:41:24.374799 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadb969-dfc1-464d-b0e2-c79ee732e2cb None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:24.375091 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadb969-dfc1-464d-b0e2-c79ee732e2cb None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:24.375378 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadb969-dfc1-464d-b0e2-c79ee732e2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:24.393775 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-abadb969-dfc1-464d-b0e2-c79ee732e2cb None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:24.394997 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-abadb969-dfc1-464d-b0e2-c79ee732e2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:24.402830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1376/2744] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:24.406952 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b24120-e1ec-4c1f-863d-a1725e13864a None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:24.416418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b24120-e1ec-4c1f-863d-a1725e13864a None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:24.420946 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2abad-d941-4e8f-add0-953fca36a28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:24.421591 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2abad-d941-4e8f-add0-953fca36a28e admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:24.421872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2abad-d941-4e8f-add0-953fca36a28e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:24.422173 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2abad-d941-4e8f-add0-953fca36a28e admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:24.422901 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2abad-d941-4e8f-add0-953fca36a28e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:41:24.423204 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2abad-d941-4e8f-add0-953fca36a28e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:24.424821 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2abad-d941-4e8f-add0-953fca36a28e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:24.436449 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1369/2745] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:41:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:41:24.440634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadb969-dfc1-464d-b0e2-c79ee732e2cb None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:24.450434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadb969-dfc1-464d-b0e2-c79ee732e2cb None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:24.455062 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c5777-a891-4c36-991d-62e046a03a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:24.455710 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c5777-a891-4c36-991d-62e046a03a34 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:24.455994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c5777-a891-4c36-991d-62e046a03a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:24.456272 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c5777-a891-4c36-991d-62e046a03a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:24.456980 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c5777-a891-4c36-991d-62e046a03a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:24.458926 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c5777-a891-4c36-991d-62e046a03a34 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:24.484501 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1377/2746] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:41:24 2021] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:41:24.488652 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2abad-d941-4e8f-add0-953fca36a28e admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:24.498669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2abad-d941-4e8f-add0-953fca36a28e admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:24.551095 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529206f4-daef-4ff0-bdce-0cf4106d0b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:24.551736 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529206f4-daef-4ff0-bdce-0cf4106d0b41 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:24.552013 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529206f4-daef-4ff0-bdce-0cf4106d0b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:24.552284 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529206f4-daef-4ff0-bdce-0cf4106d0b41 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:24.552960 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529206f4-daef-4ff0-bdce-0cf4106d0b41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:24.555366 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529206f4-daef-4ff0-bdce-0cf4106d0b41 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:24.574126 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1370/2747] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:41:24 2021] POST /identity/v3/users => generated 283 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:41:24.578667 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c5777-a891-4c36-991d-62e046a03a34 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:24.589038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c5777-a891-4c36-991d-62e046a03a34 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:24.593918 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90820bff-b82f-4fe9-8c79-a36872fd53fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:24.594612 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90820bff-b82f-4fe9-8c79-a36872fd53fd admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:24.594893 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90820bff-b82f-4fe9-8c79-a36872fd53fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:24.595170 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90820bff-b82f-4fe9-8c79-a36872fd53fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:24.595903 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90820bff-b82f-4fe9-8c79-a36872fd53fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:24.597487 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90820bff-b82f-4fe9-8c79-a36872fd53fd admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:24.607746 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1378/2748] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:41:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:41:24.611448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529206f4-daef-4ff0-bdce-0cf4106d0b41 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:24.621558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529206f4-daef-4ff0-bdce-0cf4106d0b41 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:24.626118 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734e8df-9906-422f-9612-8a7f38d76040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:24.626760 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734e8df-9906-422f-9612-8a7f38d76040 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:24.627037 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734e8df-9906-422f-9612-8a7f38d76040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:24.627309 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734e8df-9906-422f-9612-8a7f38d76040 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:24.628032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734e8df-9906-422f-9612-8a7f38d76040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:24.629633 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734e8df-9906-422f-9612-8a7f38d76040 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:24.639829 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1371/2749] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:41:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:41:24.643493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90820bff-b82f-4fe9-8c79-a36872fd53fd admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:24.652989 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90820bff-b82f-4fe9-8c79-a36872fd53fd admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:24.657579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b17847-2b54-4475-8206-867fd481f374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:24.658461 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b17847-2b54-4475-8206-867fd481f374 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:24.658742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b17847-2b54-4475-8206-867fd481f374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:24.659013 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b17847-2b54-4475-8206-867fd481f374 admin admin] PATH_INFO: `/v3/projects/6af58749050742399229d69dbaa1e9da/users/13d6ac56127d47fb9591a79904f3ec28/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:24.672849 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b17847-2b54-4475-8206-867fd481f374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af58749050742399229d69dbaa1e9da, user_id=13d6ac56127d47fb9591a79904f3ec28, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:24.675478 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b17847-2b54-4475-8206-867fd481f374 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:24.688213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1379/2750] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:41:24 2021] PUT /identity/v3/projects/6af58749050742399229d69dbaa1e9da/users/13d6ac56127d47fb9591a79904f3ec28/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:41:24.700153 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3530e-6cbc-47fe-aafd-9b7fff899c3d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:24.700438 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3530e-6cbc-47fe-aafd-9b7fff899c3d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:24.700712 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3530e-6cbc-47fe-aafd-9b7fff899c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:24.726724 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-89a3530e-6cbc-47fe-aafd-9b7fff899c3d None None] MFA Rules not processed for user `13d6ac56127d47fb9591a79904f3ec28`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:24.727905 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-89a3530e-6cbc-47fe-aafd-9b7fff899c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:24.789852 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1372/2751] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:24 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:24.794257 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b17847-2b54-4475-8206-867fd481f374 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:24.853376 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b17847-2b54-4475-8206-867fd481f374 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:24.857789 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6870e-074b-4167-b882-832d6e1c3d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:24.858462 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6870e-074b-4167-b882-832d6e1c3d73 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:24.858744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6870e-074b-4167-b882-832d6e1c3d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:24.859016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6870e-074b-4167-b882-832d6e1c3d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:24.859712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6870e-074b-4167-b882-832d6e1c3d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:24.861573 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6870e-074b-4167-b882-832d6e1c3d73 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:24.885823 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1380/2752] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:41:24 2021] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:41:24.889961 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3530e-6cbc-47fe-aafd-9b7fff899c3d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:24.900660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3530e-6cbc-47fe-aafd-9b7fff899c3d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:24.954027 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0390cbb-569c-4944-9f5b-a10dfa1aa7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:24.954688 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0390cbb-569c-4944-9f5b-a10dfa1aa7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:24.954970 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0390cbb-569c-4944-9f5b-a10dfa1aa7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:24.955251 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0390cbb-569c-4944-9f5b-a10dfa1aa7b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:24.956001 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0390cbb-569c-4944-9f5b-a10dfa1aa7b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:24.957904 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0390cbb-569c-4944-9f5b-a10dfa1aa7b6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:24.977458 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1373/2753] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:41:24 2021] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:41:24.981339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6870e-074b-4167-b882-832d6e1c3d73 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:24.991855 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6870e-074b-4167-b882-832d6e1c3d73 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:24.996420 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e9459-97fc-4450-aeeb-85f3c95b6c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:24.997064 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e9459-97fc-4450-aeeb-85f3c95b6c9d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:24.997347 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e9459-97fc-4450-aeeb-85f3c95b6c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:24.997630 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e9459-97fc-4450-aeeb-85f3c95b6c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:24.998394 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e9459-97fc-4450-aeeb-85f3c95b6c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:24.999963 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e9459-97fc-4450-aeeb-85f3c95b6c9d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:25.010047 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1381/2754] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:41:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:41:25.013686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0390cbb-569c-4944-9f5b-a10dfa1aa7b6 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:25.023387 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0390cbb-569c-4944-9f5b-a10dfa1aa7b6 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:25.028566 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9764cc-c965-47ef-be4b-05cf967c5c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:25.029421 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9764cc-c965-47ef-be4b-05cf967c5c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:25.029705 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9764cc-c965-47ef-be4b-05cf967c5c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:25.029993 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9764cc-c965-47ef-be4b-05cf967c5c49 admin admin] PATH_INFO: `/v3/projects/546ef0a8e94a40708219162e57a30701/users/2aad71f00f5f4d53b48ec1199cf40148/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:25.045564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9764cc-c965-47ef-be4b-05cf967c5c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=546ef0a8e94a40708219162e57a30701, user_id=2aad71f00f5f4d53b48ec1199cf40148, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:25.048322 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9764cc-c965-47ef-be4b-05cf967c5c49 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:25.062052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1374/2755] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:41:25 2021] PUT /identity/v3/projects/546ef0a8e94a40708219162e57a30701/users/2aad71f00f5f4d53b48ec1199cf40148/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:41:25.066401 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e9459-97fc-4450-aeeb-85f3c95b6c9d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:25.077501 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e9459-97fc-4450-aeeb-85f3c95b6c9d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:25.132570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf95ee-599e-451c-935c-ac9729de4953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:25.133230 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf95ee-599e-451c-935c-ac9729de4953 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:25.133572 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf95ee-599e-451c-935c-ac9729de4953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:25.133807 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf95ee-599e-451c-935c-ac9729de4953 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:25.134568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf95ee-599e-451c-935c-ac9729de4953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:25.136161 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf95ee-599e-451c-935c-ac9729de4953 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:25.146467 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1382/2756] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:41:25 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:41:25.150728 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9764cc-c965-47ef-be4b-05cf967c5c49 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:25.160728 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9764cc-c965-47ef-be4b-05cf967c5c49 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:25.165339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3aee0d-3952-4427-8831-e043f30e1db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:25.166235 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3aee0d-3952-4427-8831-e043f30e1db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:25.166516 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3aee0d-3952-4427-8831-e043f30e1db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:25.166788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3aee0d-3952-4427-8831-e043f30e1db6 admin admin] PATH_INFO: `/v3/projects/546ef0a8e94a40708219162e57a30701/users/2aad71f00f5f4d53b48ec1199cf40148/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:25.168738 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3aee0d-3952-4427-8831-e043f30e1db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=546ef0a8e94a40708219162e57a30701, user_id=2aad71f00f5f4d53b48ec1199cf40148, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:25.171385 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3aee0d-3952-4427-8831-e043f30e1db6 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:25.183506 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1375/2757] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:41:25 2021] PUT /identity/v3/projects/546ef0a8e94a40708219162e57a30701/users/2aad71f00f5f4d53b48ec1199cf40148/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:25.193516 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911fd01-c81f-4932-b2b3-8e6f8be1fee2 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:25.193871 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911fd01-c81f-4932-b2b3-8e6f8be1fee2 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:25.194803 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911fd01-c81f-4932-b2b3-8e6f8be1fee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:25.223912 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-1911fd01-c81f-4932-b2b3-8e6f8be1fee2 None None] MFA Rules not processed for user `2aad71f00f5f4d53b48ec1199cf40148`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:25.225116 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-1911fd01-c81f-4932-b2b3-8e6f8be1fee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:25.292540 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1383/2758] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:25 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:25.302896 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3aee0d-3952-4427-8831-e043f30e1db6 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:25.304599 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-cb3aee0d-3952-4427-8831-e043f30e1db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:25.359463 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3aee0d-3952-4427-8831-e043f30e1db6 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:25.363114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f98c85-eeb1-4422-9ada-8d5959c76379 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:25.363746 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f98c85-eeb1-4422-9ada-8d5959c76379 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:25.364030 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f98c85-eeb1-4422-9ada-8d5959c76379 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:25.364302 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f98c85-eeb1-4422-9ada-8d5959c76379 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:25.373457 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f98c85-eeb1-4422-9ada-8d5959c76379 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:25.374910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f98c85-eeb1-4422-9ada-8d5959c76379 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:25.384623 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1376/2759] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:41:25 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:41:25.460642 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911fd01-c81f-4932-b2b3-8e6f8be1fee2 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:25.470461 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911fd01-c81f-4932-b2b3-8e6f8be1fee2 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:25.474052 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f880ef2-7ed7-44a6-8d88-07ebc23ceadc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:25.474679 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f880ef2-7ed7-44a6-8d88-07ebc23ceadc service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:25.475572 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f880ef2-7ed7-44a6-8d88-07ebc23ceadc service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:25.475854 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f880ef2-7ed7-44a6-8d88-07ebc23ceadc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:25.530031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f880ef2-7ed7-44a6-8d88-07ebc23ceadc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:25.531452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f880ef2-7ed7-44a6-8d88-07ebc23ceadc service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:25.540085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1384/2760] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:41:25 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:41:30.076935 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f98c85-eeb1-4422-9ada-8d5959c76379 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:30.137665 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f98c85-eeb1-4422-9ada-8d5959c76379 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:30.142991 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa15a47-abff-46a8-807f-1475a0269c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:30.143987 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15a47-abff-46a8-807f-1475a0269c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:30.144276 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15a47-abff-46a8-807f-1475a0269c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:30.144555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15a47-abff-46a8-807f-1475a0269c53 admin admin] PATH_INFO: `/v3/users/13d6ac56127d47fb9591a79904f3ec28` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:30.145909 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa15a47-abff-46a8-807f-1475a0269c53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d6ac56127d47fb9591a79904f3ec28)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:30.147992 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa15a47-abff-46a8-807f-1475a0269c53 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:30.193860 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-5fa15a47-abff-46a8-807f-1475a0269c53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d6ac56127d47fb9591a79904f3ec28'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:30.206280 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-5fa15a47-abff-46a8-807f-1475a0269c53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d6ac56127d47fb9591a79904f3ec28'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:30.213814 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-5fa15a47-abff-46a8-807f-1475a0269c53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d6ac56127d47fb9591a79904f3ec28'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:30.220936 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-5fa15a47-abff-46a8-807f-1475a0269c53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d6ac56127d47fb9591a79904f3ec28'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:30.221556 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-5fa15a47-abff-46a8-807f-1475a0269c53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d6ac56127d47fb9591a79904f3ec28'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:30.228008 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1377/2761] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:41:30 2021] DELETE /identity/v3/users/13d6ac56127d47fb9591a79904f3ec28 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:30.232692 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011b77d-0ccb-4068-9f47-299f78002640 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:30.233220 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011b77d-0ccb-4068-9f47-299f78002640 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:30.233327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011b77d-0ccb-4068-9f47-299f78002640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:30.251226 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-6011b77d-0ccb-4068-9f47-299f78002640 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:30.252514 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6011b77d-0ccb-4068-9f47-299f78002640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:30.315907 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1385/2762] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:30.325740 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa15a47-abff-46a8-807f-1475a0269c53 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:30.327171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-5fa15a47-abff-46a8-807f-1475a0269c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:30.384542 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa15a47-abff-46a8-807f-1475a0269c53 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:30.388276 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79956eb4-5a3d-48df-8c07-2bbfdfabd79b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:30.388913 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79956eb4-5a3d-48df-8c07-2bbfdfabd79b service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:30.389190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79956eb4-5a3d-48df-8c07-2bbfdfabd79b service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:30.389462 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79956eb4-5a3d-48df-8c07-2bbfdfabd79b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:30.398855 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79956eb4-5a3d-48df-8c07-2bbfdfabd79b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:30.400278 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79956eb4-5a3d-48df-8c07-2bbfdfabd79b service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:30.409463 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1378/2763] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:41:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:41:30.707718 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011b77d-0ccb-4068-9f47-299f78002640 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:30.710027 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6011b77d-0ccb-4068-9f47-299f78002640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:30.735451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011b77d-0ccb-4068-9f47-299f78002640 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:30.740377 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cf203-2277-4ab5-973d-8dce08e28333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:30.741233 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cf203-2277-4ab5-973d-8dce08e28333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:30.741511 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cf203-2277-4ab5-973d-8dce08e28333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:30.743132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cf203-2277-4ab5-973d-8dce08e28333 admin admin] PATH_INFO: `/v3/projects/6af58749050742399229d69dbaa1e9da` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:30.744113 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cf203-2277-4ab5-973d-8dce08e28333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af58749050742399229d69dbaa1e9da)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:30.746676 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cf203-2277-4ab5-973d-8dce08e28333 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:30.797988 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3b0cf203-2277-4ab5-973d-8dce08e28333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af58749050742399229d69dbaa1e9da', 'request_id': 'req-3b0cf203-2277-4ab5-973d-8dce08e28333'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:30.806179 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3b0cf203-2277-4ab5-973d-8dce08e28333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af58749050742399229d69dbaa1e9da', 'request_id': 'req-3b0cf203-2277-4ab5-973d-8dce08e28333'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:30.812481 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3b0cf203-2277-4ab5-973d-8dce08e28333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af58749050742399229d69dbaa1e9da', 'request_id': 'req-3b0cf203-2277-4ab5-973d-8dce08e28333'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:30.823036 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3b0cf203-2277-4ab5-973d-8dce08e28333 admin admin] The token cache is being invalidate because project 6af58749050742399229d69dbaa1e9da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:41:30.823414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3b0cf203-2277-4ab5-973d-8dce08e28333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:30.824063 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-3b0cf203-2277-4ab5-973d-8dce08e28333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:30.825600 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1386/2764] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:41:30 2021] DELETE /identity/v3/projects/6af58749050742399229d69dbaa1e9da => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:30.829617 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79956eb4-5a3d-48df-8c07-2bbfdfabd79b service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:30.840032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79956eb4-5a3d-48df-8c07-2bbfdfabd79b service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:30.894230 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8e896-a0ed-41b7-89c5-67e3436e002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:30.895084 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8e896-a0ed-41b7-89c5-67e3436e002c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:30.895364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8e896-a0ed-41b7-89c5-67e3436e002c admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:30.895635 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8e896-a0ed-41b7-89c5-67e3436e002c admin admin] PATH_INFO: `/v3/users/2aad71f00f5f4d53b48ec1199cf40148` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:30.896866 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8e896-a0ed-41b7-89c5-67e3436e002c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aad71f00f5f4d53b48ec1199cf40148)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:30.899279 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8e896-a0ed-41b7-89c5-67e3436e002c admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:30.944478 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-dfe8e896-a0ed-41b7-89c5-67e3436e002c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aad71f00f5f4d53b48ec1199cf40148'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:30.955795 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-dfe8e896-a0ed-41b7-89c5-67e3436e002c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aad71f00f5f4d53b48ec1199cf40148'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:30.964097 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-dfe8e896-a0ed-41b7-89c5-67e3436e002c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aad71f00f5f4d53b48ec1199cf40148'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:30.971935 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-dfe8e896-a0ed-41b7-89c5-67e3436e002c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aad71f00f5f4d53b48ec1199cf40148'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:30.972643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-dfe8e896-a0ed-41b7-89c5-67e3436e002c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aad71f00f5f4d53b48ec1199cf40148'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:30.978476 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1379/2765] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:41:30 2021] DELETE /identity/v3/users/2aad71f00f5f4d53b48ec1199cf40148 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:31.238724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cf203-2277-4ab5-973d-8dce08e28333 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:31.241290 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-3b0cf203-2277-4ab5-973d-8dce08e28333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:31.267336 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8e896-a0ed-41b7-89c5-67e3436e002c admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:31.268923 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-dfe8e896-a0ed-41b7-89c5-67e3436e002c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:31.340765 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8e896-a0ed-41b7-89c5-67e3436e002c admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:31.345400 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78822e-3813-4132-8907-d065f465b569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:31.346282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78822e-3813-4132-8907-d065f465b569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:31.346566 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78822e-3813-4132-8907-d065f465b569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:31.346844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78822e-3813-4132-8907-d065f465b569 admin admin] PATH_INFO: `/v3/projects/546ef0a8e94a40708219162e57a30701` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:31.348036 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78822e-3813-4132-8907-d065f465b569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=546ef0a8e94a40708219162e57a30701)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:31.349972 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78822e-3813-4132-8907-d065f465b569 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:31.357668 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cf203-2277-4ab5-973d-8dce08e28333 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:31.398566 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-bf78822e-3813-4132-8907-d065f465b569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546ef0a8e94a40708219162e57a30701', 'request_id': 'req-bf78822e-3813-4132-8907-d065f465b569'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:31.407554 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-bf78822e-3813-4132-8907-d065f465b569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546ef0a8e94a40708219162e57a30701', 'request_id': 'req-bf78822e-3813-4132-8907-d065f465b569'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:31.414210 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-bf78822e-3813-4132-8907-d065f465b569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546ef0a8e94a40708219162e57a30701', 'request_id': 'req-bf78822e-3813-4132-8907-d065f465b569'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:31.422450 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7341dc-515d-4c3f-872a-9aa0ea8f0e0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:31.423227 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7341dc-515d-4c3f-872a-9aa0ea8f0e0d service nova] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:31.423607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7341dc-515d-4c3f-872a-9aa0ea8f0e0d service nova] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:31.423978 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7341dc-515d-4c3f-872a-9aa0ea8f0e0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:31.424661 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-bf78822e-3813-4132-8907-d065f465b569 admin admin] The token cache is being invalidate because project 546ef0a8e94a40708219162e57a30701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:41:31.424949 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-bf78822e-3813-4132-8907-d065f465b569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:31.425564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-bf78822e-3813-4132-8907-d065f465b569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:41:31.426147 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-ee7341dc-515d-4c3f-872a-9aa0ea8f0e0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:31.433914 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1380/2766] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:41:31 2021] DELETE /identity/v3/projects/546ef0a8e94a40708219162e57a30701 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:31.436085 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd70e8-1114-474b-957c-90aa2b6cc430 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:31.436085 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd70e8-1114-474b-957c-90aa2b6cc430 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:31.436085 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd70e8-1114-474b-957c-90aa2b6cc430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:31.442617 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7341dc-515d-4c3f-872a-9aa0ea8f0e0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:31.444872 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7341dc-515d-4c3f-872a-9aa0ea8f0e0d service nova] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:31.455665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1387/2767] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:41:31 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:41:31.457695 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-acdd70e8-1114-474b-957c-90aa2b6cc430 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:31.459009 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-acdd70e8-1114-474b-957c-90aa2b6cc430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:31.522391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1381/2768] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:41:31.530536 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743c7fa-b87b-449c-a307-77d911f9e595 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:31.530919 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743c7fa-b87b-449c-a307-77d911f9e595 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:31.531273 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743c7fa-b87b-449c-a307-77d911f9e595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:31.553515 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-d743c7fa-b87b-449c-a307-77d911f9e595 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:31.555050 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d743c7fa-b87b-449c-a307-77d911f9e595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:31.566864 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1388/2769] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:41:31.568366 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd70e8-1114-474b-957c-90aa2b6cc430 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:31.580083 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd70e8-1114-474b-957c-90aa2b6cc430 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:31.586029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e75ec0-861b-4913-80a4-b334da9aca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:31.586819 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e75ec0-861b-4913-80a4-b334da9aca93 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:31.587174 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e75ec0-861b-4913-80a4-b334da9aca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:31.587589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e75ec0-861b-4913-80a4-b334da9aca93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:31.588375 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e75ec0-861b-4913-80a4-b334da9aca93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:41:31.588756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e75ec0-861b-4913-80a4-b334da9aca93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:31.590849 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e75ec0-861b-4913-80a4-b334da9aca93 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:31.607325 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1382/2770] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:41:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 03:41:31.611523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743c7fa-b87b-449c-a307-77d911f9e595 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:31.621140 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743c7fa-b87b-449c-a307-77d911f9e595 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:31.627493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1292f-409c-4ba9-86d9-c8bde36c2dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:31.628298 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1292f-409c-4ba9-86d9-c8bde36c2dfe admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:31.628680 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1292f-409c-4ba9-86d9-c8bde36c2dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:31.629211 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1292f-409c-4ba9-86d9-c8bde36c2dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:31.630030 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1292f-409c-4ba9-86d9-c8bde36c2dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:31.633869 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1292f-409c-4ba9-86d9-c8bde36c2dfe admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:31.670028 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1389/2771] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:41:31 2021] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:41:31.671541 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e75ec0-861b-4913-80a4-b334da9aca93 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:31.681449 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e75ec0-861b-4913-80a4-b334da9aca93 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:31.743832 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b037f2b-c262-4021-9e0a-6db9ae2e6aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:31.744509 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b037f2b-c262-4021-9e0a-6db9ae2e6aef admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:31.744791 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b037f2b-c262-4021-9e0a-6db9ae2e6aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:31.745071 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b037f2b-c262-4021-9e0a-6db9ae2e6aef admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:31.745793 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b037f2b-c262-4021-9e0a-6db9ae2e6aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:31.747792 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b037f2b-c262-4021-9e0a-6db9ae2e6aef admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:31.769595 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1383/2772] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:41:31 2021] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:41:31.774833 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1292f-409c-4ba9-86d9-c8bde36c2dfe admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:31.785579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1292f-409c-4ba9-86d9-c8bde36c2dfe admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:31.792056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead720e9-9655-4635-bb1b-2c9383ffd174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:31.792726 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead720e9-9655-4635-bb1b-2c9383ffd174 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:31.793011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead720e9-9655-4635-bb1b-2c9383ffd174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:31.793291 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead720e9-9655-4635-bb1b-2c9383ffd174 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:31.794058 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead720e9-9655-4635-bb1b-2c9383ffd174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:31.795664 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead720e9-9655-4635-bb1b-2c9383ffd174 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:31.809225 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1390/2773] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:41:31 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:41:31.813100 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b037f2b-c262-4021-9e0a-6db9ae2e6aef admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:31.824816 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b037f2b-c262-4021-9e0a-6db9ae2e6aef admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:31.829957 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645c6ed-b033-4982-8106-6062c7406a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:31.830723 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645c6ed-b033-4982-8106-6062c7406a48 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:31.831075 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645c6ed-b033-4982-8106-6062c7406a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:31.831520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645c6ed-b033-4982-8106-6062c7406a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:31.832332 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645c6ed-b033-4982-8106-6062c7406a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:31.834017 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645c6ed-b033-4982-8106-6062c7406a48 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:31.846103 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1384/2774] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:41:31 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:41:31.850341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead720e9-9655-4635-bb1b-2c9383ffd174 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:31.860565 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead720e9-9655-4635-bb1b-2c9383ffd174 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:31.865971 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cabb6-4ba2-49ea-aa32-302bb1c09b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:31.867112 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cabb6-4ba2-49ea-aa32-302bb1c09b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:31.867693 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cabb6-4ba2-49ea-aa32-302bb1c09b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:31.868063 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cabb6-4ba2-49ea-aa32-302bb1c09b61 admin admin] PATH_INFO: `/v3/projects/0f9dcbfd69bc450691e2b036e864f7d9/users/478d1c76208642f89d96afdf22f79829/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:31.883764 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cabb6-4ba2-49ea-aa32-302bb1c09b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f9dcbfd69bc450691e2b036e864f7d9, user_id=478d1c76208642f89d96afdf22f79829, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:31.887017 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cabb6-4ba2-49ea-aa32-302bb1c09b61 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:31.901574 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1391/2775] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:41:31 2021] PUT /identity/v3/projects/0f9dcbfd69bc450691e2b036e864f7d9/users/478d1c76208642f89d96afdf22f79829/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:31.907700 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd192edd-1ad0-4925-ba58-6a6854c72060 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:31.907986 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd192edd-1ad0-4925-ba58-6a6854c72060 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:31.908260 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd192edd-1ad0-4925-ba58-6a6854c72060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:31.930043 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-bd192edd-1ad0-4925-ba58-6a6854c72060 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:31.931243 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-bd192edd-1ad0-4925-ba58-6a6854c72060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:31.992445 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1385/2776] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:32.002124 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cabb6-4ba2-49ea-aa32-302bb1c09b61 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:32.003994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-760cabb6-4ba2-49ea-aa32-302bb1c09b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:32.063209 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cabb6-4ba2-49ea-aa32-302bb1c09b61 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:32.066913 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e42de3-e510-4eb6-8042-1265d11f1d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:32.067553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e42de3-e510-4eb6-8042-1265d11f1d40 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:32.067834 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e42de3-e510-4eb6-8042-1265d11f1d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:32.068114 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e42de3-e510-4eb6-8042-1265d11f1d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:32.080057 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e42de3-e510-4eb6-8042-1265d11f1d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:32.081545 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e42de3-e510-4eb6-8042-1265d11f1d40 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:32.092452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1392/2777] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:41:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:41:36.082668 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365edff-604d-4294-a794-6664ad7727eb None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:36.083249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365edff-604d-4294-a794-6664ad7727eb None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:36.083249 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365edff-604d-4294-a794-6664ad7727eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:36.112303 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-1365edff-604d-4294-a794-6664ad7727eb None None] MFA Rules not processed for user `478d1c76208642f89d96afdf22f79829`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:36.113679 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1365edff-604d-4294-a794-6664ad7727eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:36.196077 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1386/2778] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:36 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:36.200280 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e42de3-e510-4eb6-8042-1265d11f1d40 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:36.216124 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e42de3-e510-4eb6-8042-1265d11f1d40 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:36.222888 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbf27f-401b-4d8e-a89a-355787587a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:36.223838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbf27f-401b-4d8e-a89a-355787587a1b admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:36.224287 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbf27f-401b-4d8e-a89a-355787587a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:36.224407 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbf27f-401b-4d8e-a89a-355787587a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:36.225150 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbf27f-401b-4d8e-a89a-355787587a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:36.227121 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbf27f-401b-4d8e-a89a-355787587a1b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:36.258704 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1393/2779] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:41:36 2021] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:41:36.260125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365edff-604d-4294-a794-6664ad7727eb None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:36.274466 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365edff-604d-4294-a794-6664ad7727eb None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:36.335044 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078b907-3333-4947-be77-4cda76df74ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:36.335957 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078b907-3333-4947-be77-4cda76df74ca admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:36.336311 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078b907-3333-4947-be77-4cda76df74ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:36.336682 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078b907-3333-4947-be77-4cda76df74ca admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:36.337458 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078b907-3333-4947-be77-4cda76df74ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:36.339731 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078b907-3333-4947-be77-4cda76df74ca admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:36.363456 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1387/2780] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:41:36 2021] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:41:36.368101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbf27f-401b-4d8e-a89a-355787587a1b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:36.379019 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbf27f-401b-4d8e-a89a-355787587a1b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:36.386591 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb835519-4a19-4ac1-9049-b134218e321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:36.387262 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835519-4a19-4ac1-9049-b134218e321e admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:36.387555 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835519-4a19-4ac1-9049-b134218e321e admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:36.387828 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835519-4a19-4ac1-9049-b134218e321e admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:36.388575 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb835519-4a19-4ac1-9049-b134218e321e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:36.390268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb835519-4a19-4ac1-9049-b134218e321e admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:36.402818 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1394/2781] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:41:36 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:41:36.406647 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078b907-3333-4947-be77-4cda76df74ca admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:36.417240 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078b907-3333-4947-be77-4cda76df74ca admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:36.422790 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245c6a5-e59a-49ea-9829-a0350a7f7f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:36.423502 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245c6a5-e59a-49ea-9829-a0350a7f7f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:36.423787 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245c6a5-e59a-49ea-9829-a0350a7f7f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:36.424066 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245c6a5-e59a-49ea-9829-a0350a7f7f56 admin admin] PATH_INFO: `/v3/projects/a566d81b2d144447ac54b70262069910/users/63e50784ef8f4998abc53643bfc7240a/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:36.442911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245c6a5-e59a-49ea-9829-a0350a7f7f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a566d81b2d144447ac54b70262069910, user_id=63e50784ef8f4998abc53643bfc7240a, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:36.446212 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245c6a5-e59a-49ea-9829-a0350a7f7f56 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:36.463632 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1388/2782] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:41:36 2021] PUT /identity/v3/projects/a566d81b2d144447ac54b70262069910/users/63e50784ef8f4998abc53643bfc7240a/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:36.467799 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb835519-4a19-4ac1-9049-b134218e321e admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:36.478624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb835519-4a19-4ac1-9049-b134218e321e admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:36.545876 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19748efd-c892-43bb-9784-a28ed47c0bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:36.546614 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19748efd-c892-43bb-9784-a28ed47c0bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:36.546891 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19748efd-c892-43bb-9784-a28ed47c0bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:36.547160 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19748efd-c892-43bb-9784-a28ed47c0bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:36.547901 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19748efd-c892-43bb-9784-a28ed47c0bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:36.549543 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19748efd-c892-43bb-9784-a28ed47c0bd4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:36.560634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1395/2783] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:41:36 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:41:36.564679 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245c6a5-e59a-49ea-9829-a0350a7f7f56 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:36.575979 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245c6a5-e59a-49ea-9829-a0350a7f7f56 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:36.581558 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dddff-1e64-43f9-b8e5-d4cd9c029034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:36.582788 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dddff-1e64-43f9-b8e5-d4cd9c029034 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:36.583068 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dddff-1e64-43f9-b8e5-d4cd9c029034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:36.583742 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dddff-1e64-43f9-b8e5-d4cd9c029034 admin admin] PATH_INFO: `/v3/projects/a566d81b2d144447ac54b70262069910/users/63e50784ef8f4998abc53643bfc7240a/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:36.585504 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dddff-1e64-43f9-b8e5-d4cd9c029034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a566d81b2d144447ac54b70262069910, user_id=63e50784ef8f4998abc53643bfc7240a, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:36.588181 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dddff-1e64-43f9-b8e5-d4cd9c029034 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:36.601747 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1389/2784] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:41:36 2021] PUT /identity/v3/projects/a566d81b2d144447ac54b70262069910/users/63e50784ef8f4998abc53643bfc7240a/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:41:41.474266 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1e21f-68a2-4f41-bd50-604fd978a14e None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:41.475265 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1e21f-68a2-4f41-bd50-604fd978a14e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:41.475384 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1e21f-68a2-4f41-bd50-604fd978a14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:41.507352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a1b1e21f-68a2-4f41-bd50-604fd978a14e None None] MFA Rules not processed for user `63e50784ef8f4998abc53643bfc7240a`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:41.508820 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a1b1e21f-68a2-4f41-bd50-604fd978a14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:41.591354 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1396/2785] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:41 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:41.604423 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dddff-1e64-43f9-b8e5-d4cd9c029034 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:41.606174 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-e95dddff-1e64-43f9-b8e5-d4cd9c029034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:41.682589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dddff-1e64-43f9-b8e5-d4cd9c029034 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:41.686416 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ba674-08d3-425f-a828-85060933aeec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48dcc22c7df4aed8fa6cf32e3c2ec51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:41.687166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ba674-08d3-425f-a828-85060933aeec service glance] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:41.687455 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ba674-08d3-425f-a828-85060933aeec service glance] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:41.687735 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ba674-08d3-425f-a828-85060933aeec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:41.744991 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ba674-08d3-425f-a828-85060933aeec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:41.746472 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ba674-08d3-425f-a828-85060933aeec service glance] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:41.755552 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1390/2786] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:41:41 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:41:41.852053 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb057aef-579c-42b0-a82f-b6c8e63b6085 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:41.852344 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb057aef-579c-42b0-a82f-b6c8e63b6085 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:41.852624 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb057aef-579c-42b0-a82f-b6c8e63b6085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:41.908500 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-eb057aef-579c-42b0-a82f-b6c8e63b6085 None None] MFA Rules not processed for user `39cddc4e2ea943cd882b6a1addd98e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:41.909704 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-eb057aef-579c-42b0-a82f-b6c8e63b6085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:41.972760 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1397/2787] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Dec 15 03:41:41 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:42.019250 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ba674-08d3-425f-a828-85060933aeec service glance] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:42.020687 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-5d0ba674-08d3-425f-a828-85060933aeec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:42.106329 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ba674-08d3-425f-a828-85060933aeec service glance] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:42.111459 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3221df1-c00a-4366-b0a9-dc3b5d16504b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb0af7ac70d48989852c022c9f83848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:42.112091 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3221df1-c00a-4366-b0a9-dc3b5d16504b service swift] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:42.112372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3221df1-c00a-4366-b0a9-dc3b5d16504b service swift] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:42.112645 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3221df1-c00a-4366-b0a9-dc3b5d16504b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:42.120443 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3221df1-c00a-4366-b0a9-dc3b5d16504b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:42.122038 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3221df1-c00a-4366-b0a9-dc3b5d16504b service swift] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:42.130084 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1391/2788] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Dec 15 03:41:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 03:41:51.389846 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e8653-9283-4273-bf3c-4905c701a855 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:51.390597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e8653-9283-4273-bf3c-4905c701a855 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:51.390597 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e8653-9283-4273-bf3c-4905c701a855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:51.408480 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-e34e8653-9283-4273-bf3c-4905c701a855 None None] MFA Rules not processed for user `478d1c76208642f89d96afdf22f79829`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:51.409390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e34e8653-9283-4273-bf3c-4905c701a855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:51.416923 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1398/2789] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:41:51 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:53.239935 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60d7bc-5557-47b8-8c76-455ea8a36c38 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:53.240400 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60d7bc-5557-47b8-8c76-455ea8a36c38 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:53.240503 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60d7bc-5557-47b8-8c76-455ea8a36c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:53.258339 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-6f60d7bc-5557-47b8-8c76-455ea8a36c38 None None] MFA Rules not processed for user `39cddc4e2ea943cd882b6a1addd98e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:41:53.259514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6f60d7bc-5557-47b8-8c76-455ea8a36c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:41:53.266543 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1392/2790] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Dec 15 03:41:53 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:41:53.279941 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e8653-9283-4273-bf3c-4905c701a855 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:41:53.291652 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e8653-9283-4273-bf3c-4905c701a855 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:41:53.296567 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a42bf-f333-4614-892e-6a844f5e9ab3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb0af7ac70d48989852c022c9f83848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:41:53.297210 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a42bf-f333-4614-892e-6a844f5e9ab3 service swift] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:41:53.297522 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a42bf-f333-4614-892e-6a844f5e9ab3 service swift] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:41:53.297918 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a42bf-f333-4614-892e-6a844f5e9ab3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:41:53.306068 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a42bf-f333-4614-892e-6a844f5e9ab3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:41:53.307662 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a42bf-f333-4614-892e-6a844f5e9ab3 service swift] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:41:53.316061 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1399/2791] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Dec 15 03:41:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 03:42:14.340148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60d7bc-5557-47b8-8c76-455ea8a36c38 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:14.341594 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6f60d7bc-5557-47b8-8c76-455ea8a36c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:14.396342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60d7bc-5557-47b8-8c76-455ea8a36c38 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:14.399768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4ae0b-1a60-4f4e-85e6-513ca5ceba09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:14.400389 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4ae0b-1a60-4f4e-85e6-513ca5ceba09 service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:14.400664 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4ae0b-1a60-4f4e-85e6-513ca5ceba09 service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:14.400935 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4ae0b-1a60-4f4e-85e6-513ca5ceba09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:14.402620 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-85a4ae0b-1a60-4f4e-85e6-513ca5ceba09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:14.457680 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4ae0b-1a60-4f4e-85e6-513ca5ceba09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:14.459156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4ae0b-1a60-4f4e-85e6-513ca5ceba09 service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:14.468001 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1393/2792] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:42:14 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:42:20.186685 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a42bf-f333-4614-892e-6a844f5e9ab3 service swift] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:20.188126 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-2c7a42bf-f333-4614-892e-6a844f5e9ab3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:20.200117 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a42bf-f333-4614-892e-6a844f5e9ab3 service swift] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:20.203631 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d41ad-90e4-4f95-b2f7-8e1ec1ae73b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:20.204259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d41ad-90e4-4f95-b2f7-8e1ec1ae73b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:20.204536 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d41ad-90e4-4f95-b2f7-8e1ec1ae73b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:20.204815 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d41ad-90e4-4f95-b2f7-8e1ec1ae73b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:20.206544 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-700d41ad-90e4-4f95-b2f7-8e1ec1ae73b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:20.275586 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d41ad-90e4-4f95-b2f7-8e1ec1ae73b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:20.277010 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d41ad-90e4-4f95-b2f7-8e1ec1ae73b3 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:20.287588 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1400/2793] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:42:20 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:42:24.768694 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4ae0b-1a60-4f4e-85e6-513ca5ceba09 service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:24.819708 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4ae0b-1a60-4f4e-85e6-513ca5ceba09 service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:24.823283 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d816a36-5741-475e-b06e-cf8c97f64214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:24.823911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d816a36-5741-475e-b06e-cf8c97f64214 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:24.824193 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d816a36-5741-475e-b06e-cf8c97f64214 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:24.824467 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d816a36-5741-475e-b06e-cf8c97f64214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:24.826228 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-4d816a36-5741-475e-b06e-cf8c97f64214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:24.839308 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d816a36-5741-475e-b06e-cf8c97f64214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:24.840715 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d816a36-5741-475e-b06e-cf8c97f64214 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:24.851686 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1394/2794] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:42:24 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:42:24.977051 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d41ad-90e4-4f95-b2f7-8e1ec1ae73b3 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:24.985966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d41ad-90e4-4f95-b2f7-8e1ec1ae73b3 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:24.989449 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba97815-9d6d-480b-bf52-9e3ba60cf1ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:24.990716 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba97815-9d6d-480b-bf52-9e3ba60cf1ba service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:24.990994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba97815-9d6d-480b-bf52-9e3ba60cf1ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:24.991265 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba97815-9d6d-480b-bf52-9e3ba60cf1ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:24.999801 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba97815-9d6d-480b-bf52-9e3ba60cf1ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:25.001199 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba97815-9d6d-480b-bf52-9e3ba60cf1ba service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:25.010450 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1401/2795] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:42:24 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:42:43.244547 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d816a36-5741-475e-b06e-cf8c97f64214 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:43.245921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-4d816a36-5741-475e-b06e-cf8c97f64214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:43.256386 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d816a36-5741-475e-b06e-cf8c97f64214 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:43.259910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b67b6b-371c-47c1-b372-946fd46f38a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:43.260526 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b67b6b-371c-47c1-b372-946fd46f38a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:43.260804 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b67b6b-371c-47c1-b372-946fd46f38a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:43.261075 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b67b6b-371c-47c1-b372-946fd46f38a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:43.262767 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-a9b67b6b-371c-47c1-b372-946fd46f38a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:43.321444 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b67b6b-371c-47c1-b372-946fd46f38a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:43.322894 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b67b6b-371c-47c1-b372-946fd46f38a2 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:43.332302 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1395/2796] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:42:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:42:46.453096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba97815-9d6d-480b-bf52-9e3ba60cf1ba service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:46.454587 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7ba97815-9d6d-480b-bf52-9e3ba60cf1ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:46.469353 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba97815-9d6d-480b-bf52-9e3ba60cf1ba service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:46.474555 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124b4b8-4a9e-4b3f-bcf4-ddc8b28977f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:46.475427 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124b4b8-4a9e-4b3f-bcf4-ddc8b28977f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:46.475710 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124b4b8-4a9e-4b3f-bcf4-ddc8b28977f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:46.475990 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124b4b8-4a9e-4b3f-bcf4-ddc8b28977f9 admin admin] PATH_INFO: `/v3/users/a5fb31c3d4874e13ba22e0242d4aaa58` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:46.477214 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124b4b8-4a9e-4b3f-bcf4-ddc8b28977f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fb31c3d4874e13ba22e0242d4aaa58)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:46.479183 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124b4b8-4a9e-4b3f-bcf4-ddc8b28977f9 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:46.526969 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d124b4b8-4a9e-4b3f-bcf4-ddc8b28977f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fb31c3d4874e13ba22e0242d4aaa58'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:46.538829 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d124b4b8-4a9e-4b3f-bcf4-ddc8b28977f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fb31c3d4874e13ba22e0242d4aaa58'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:46.546585 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d124b4b8-4a9e-4b3f-bcf4-ddc8b28977f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fb31c3d4874e13ba22e0242d4aaa58'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:46.547288 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d124b4b8-4a9e-4b3f-bcf4-ddc8b28977f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fb31c3d4874e13ba22e0242d4aaa58'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:46.547936 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-d124b4b8-4a9e-4b3f-bcf4-ddc8b28977f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fb31c3d4874e13ba22e0242d4aaa58'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:46.563203 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1402/2797] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:42:46 2021] DELETE /identity/v3/users/a5fb31c3d4874e13ba22e0242d4aaa58 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:42:46.729726 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b67b6b-371c-47c1-b372-946fd46f38a2 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:46.740813 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b67b6b-371c-47c1-b372-946fd46f38a2 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:46.807509 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460aee5-85be-4e9a-86fd-2db64898386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:46.808363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460aee5-85be-4e9a-86fd-2db64898386d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:46.808647 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460aee5-85be-4e9a-86fd-2db64898386d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:46.808928 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460aee5-85be-4e9a-86fd-2db64898386d admin admin] PATH_INFO: `/v3/projects/00e76c2a092544e1a51928f1d84879b2` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:46.810156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460aee5-85be-4e9a-86fd-2db64898386d admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e76c2a092544e1a51928f1d84879b2)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:46.812050 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460aee5-85be-4e9a-86fd-2db64898386d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:46.856491 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3460aee5-85be-4e9a-86fd-2db64898386d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e76c2a092544e1a51928f1d84879b2', 'request_id': 'req-3460aee5-85be-4e9a-86fd-2db64898386d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:46.863517 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3460aee5-85be-4e9a-86fd-2db64898386d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e76c2a092544e1a51928f1d84879b2', 'request_id': 'req-3460aee5-85be-4e9a-86fd-2db64898386d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:46.870074 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3460aee5-85be-4e9a-86fd-2db64898386d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e76c2a092544e1a51928f1d84879b2', 'request_id': 'req-3460aee5-85be-4e9a-86fd-2db64898386d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:46.880525 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3460aee5-85be-4e9a-86fd-2db64898386d admin admin] The token cache is being invalidate because project 00e76c2a092544e1a51928f1d84879b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:42:46.880816 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3460aee5-85be-4e9a-86fd-2db64898386d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:46.881457 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-3460aee5-85be-4e9a-86fd-2db64898386d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:46.883051 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1396/2798] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:42:46 2021] DELETE /identity/v3/projects/00e76c2a092544e1a51928f1d84879b2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:42:46.888747 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc56c2d-e085-441f-bc0f-0b7a15a0dd83 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:46.889046 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc56c2d-e085-441f-bc0f-0b7a15a0dd83 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:46.889331 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc56c2d-e085-441f-bc0f-0b7a15a0dd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:46.907023 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-fbc56c2d-e085-441f-bc0f-0b7a15a0dd83 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:42:46.908144 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-fbc56c2d-e085-441f-bc0f-0b7a15a0dd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:46.966777 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1403/2799] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:42:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:42:46.975161 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dea41-41c3-4844-aa56-99fd5366283e None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:46.975545 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dea41-41c3-4844-aa56-99fd5366283e None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:46.975887 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dea41-41c3-4844-aa56-99fd5366283e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:46.994708 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-de0dea41-41c3-4844-aa56-99fd5366283e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:42:46.995978 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-de0dea41-41c3-4844-aa56-99fd5366283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:47.005080 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1397/2800] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:42:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:42:47.009055 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc56c2d-e085-441f-bc0f-0b7a15a0dd83 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:47.018383 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc56c2d-e085-441f-bc0f-0b7a15a0dd83 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:47.023417 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad60ad7-4fa8-44f8-a709-6f56ccd150e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:47.024058 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad60ad7-4fa8-44f8-a709-6f56ccd150e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:47.024340 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad60ad7-4fa8-44f8-a709-6f56ccd150e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:47.024616 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad60ad7-4fa8-44f8-a709-6f56ccd150e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:47.025341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad60ad7-4fa8-44f8-a709-6f56ccd150e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:42:47.025646 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad60ad7-4fa8-44f8-a709-6f56ccd150e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:47.027252 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad60ad7-4fa8-44f8-a709-6f56ccd150e6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:47.039451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1404/2801] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:42:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:42:47.043820 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dea41-41c3-4844-aa56-99fd5366283e None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:47.053405 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dea41-41c3-4844-aa56-99fd5366283e None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:47.058045 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9e138-70a6-47ba-879b-3c97cdf28e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:47.058685 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9e138-70a6-47ba-879b-3c97cdf28e59 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:47.058963 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9e138-70a6-47ba-879b-3c97cdf28e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:47.059234 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9e138-70a6-47ba-879b-3c97cdf28e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:47.059943 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9e138-70a6-47ba-879b-3c97cdf28e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:47.061813 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9e138-70a6-47ba-879b-3c97cdf28e59 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:47.087620 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1398/2802] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:42:47 2021] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:42:47.092152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad60ad7-4fa8-44f8-a709-6f56ccd150e6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:47.102374 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad60ad7-4fa8-44f8-a709-6f56ccd150e6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:47.155828 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357ccfb-8c8d-4438-b4a4-cb1ac16700af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:47.156472 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357ccfb-8c8d-4438-b4a4-cb1ac16700af admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:47.156752 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357ccfb-8c8d-4438-b4a4-cb1ac16700af admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:47.157078 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357ccfb-8c8d-4438-b4a4-cb1ac16700af admin admin] PATH_INFO: `/v3/users` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:47.157717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357ccfb-8c8d-4438-b4a4-cb1ac16700af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:47.159627 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357ccfb-8c8d-4438-b4a4-cb1ac16700af admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:47.178854 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1405/2803] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:42:47 2021] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:42:47.183166 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9e138-70a6-47ba-879b-3c97cdf28e59 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:47.193749 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9e138-70a6-47ba-879b-3c97cdf28e59 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:47.198367 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807f160-225b-41a2-a1c7-c48b354ea9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:47.199037 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807f160-225b-41a2-a1c7-c48b354ea9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:47.199363 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807f160-225b-41a2-a1c7-c48b354ea9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:47.199651 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807f160-225b-41a2-a1c7-c48b354ea9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:47.200388 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807f160-225b-41a2-a1c7-c48b354ea9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:47.202002 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807f160-225b-41a2-a1c7-c48b354ea9f1 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:47.212705 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1399/2804] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:42:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:42:47.216822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357ccfb-8c8d-4438-b4a4-cb1ac16700af admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:47.227284 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357ccfb-8c8d-4438-b4a4-cb1ac16700af admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:47.231917 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a4bfd-ddc4-43a4-9e61-a2d2371c405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:47.232639 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4bfd-ddc4-43a4-9e61-a2d2371c405d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:47.232920 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4bfd-ddc4-43a4-9e61-a2d2371c405d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:47.233196 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4bfd-ddc4-43a4-9e61-a2d2371c405d admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:47.233932 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a4bfd-ddc4-43a4-9e61-a2d2371c405d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:47.235535 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a4bfd-ddc4-43a4-9e61-a2d2371c405d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:47.245764 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1406/2805] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:42:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:42:47.249538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807f160-225b-41a2-a1c7-c48b354ea9f1 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:47.259187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807f160-225b-41a2-a1c7-c48b354ea9f1 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:47.263754 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee8fa9-68a6-422b-9633-febf5dae7327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:47.264608 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee8fa9-68a6-422b-9633-febf5dae7327 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:47.264886 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee8fa9-68a6-422b-9633-febf5dae7327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:47.265160 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee8fa9-68a6-422b-9633-febf5dae7327 admin admin] PATH_INFO: `/v3/projects/4c5b4bfb1b404c2c9a7bb3bfe589da50/users/c2cb9f6facc241368b05563ea0957f94/roles/69edf382652b443c97811919233bb991` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:47.279685 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee8fa9-68a6-422b-9633-febf5dae7327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5b4bfb1b404c2c9a7bb3bfe589da50, user_id=c2cb9f6facc241368b05563ea0957f94, role_id=69edf382652b443c97811919233bb991)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:47.282342 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee8fa9-68a6-422b-9633-febf5dae7327 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:47.295120 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1400/2806] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:42:47 2021] PUT /identity/v3/projects/4c5b4bfb1b404c2c9a7bb3bfe589da50/users/c2cb9f6facc241368b05563ea0957f94/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:42:47.305697 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad93742-7ea8-4a28-be2b-fd458e3ec20d None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:47.306011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad93742-7ea8-4a28-be2b-fd458e3ec20d None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:47.306296 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad93742-7ea8-4a28-be2b-fd458e3ec20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:47.331421 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-dad93742-7ea8-4a28-be2b-fd458e3ec20d None None] MFA Rules not processed for user `c2cb9f6facc241368b05563ea0957f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:42:47.332596 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-dad93742-7ea8-4a28-be2b-fd458e3ec20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:47.397154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1407/2807] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:42:47 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:42:47.408270 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee8fa9-68a6-422b-9633-febf5dae7327 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:47.409881 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-44ee8fa9-68a6-422b-9633-febf5dae7327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:47.480073 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee8fa9-68a6-422b-9633-febf5dae7327 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:47.485576 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf6dfd-b576-497a-bf67-e7936f22a3ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd50adcd390465ea6fc8582e1524909', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:47.486243 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6dfd-b576-497a-bf67-e7936f22a3ee service nova] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:47.486529 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6dfd-b576-497a-bf67-e7936f22a3ee service nova] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:47.486809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6dfd-b576-497a-bf67-e7936f22a3ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:47.494945 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf6dfd-b576-497a-bf67-e7936f22a3ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:47.496567 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf6dfd-b576-497a-bf67-e7936f22a3ee service nova] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:47.505209 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1401/2808] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:42:47 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:42:54.097332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad93742-7ea8-4a28-be2b-fd458e3ec20d None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:54.099253 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-dad93742-7ea8-4a28-be2b-fd458e3ec20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:54.178002 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad93742-7ea8-4a28-be2b-fd458e3ec20d None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:54.182918 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa262a4-7163-4a88-a82d-da404e30407e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93762c21f03d44d5bf3881d17e14ef90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:54.183550 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa262a4-7163-4a88-a82d-da404e30407e service placement] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:54.183831 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa262a4-7163-4a88-a82d-da404e30407e service placement] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:54.184106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa262a4-7163-4a88-a82d-da404e30407e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:54.185822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-0aa262a4-7163-4a88-a82d-da404e30407e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:54.196747 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa262a4-7163-4a88-a82d-da404e30407e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:54.198352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa262a4-7163-4a88-a82d-da404e30407e service placement] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:54.208127 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1408/2809] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:42:54 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:42:55.693386 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf6dfd-b576-497a-bf67-e7936f22a3ee service nova] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:55.751685 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf6dfd-b576-497a-bf67-e7936f22a3ee service nova] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:55.756838 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e41a84-5e48-4f2a-91e4-2c66925284f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:55.757678 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e41a84-5e48-4f2a-91e4-2c66925284f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:55.757955 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e41a84-5e48-4f2a-91e4-2c66925284f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:55.758280 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e41a84-5e48-4f2a-91e4-2c66925284f5 admin admin] PATH_INFO: `/v3/users/c2cb9f6facc241368b05563ea0957f94` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:55.759500 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e41a84-5e48-4f2a-91e4-2c66925284f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2cb9f6facc241368b05563ea0957f94)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:55.761398 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e41a84-5e48-4f2a-91e4-2c66925284f5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:55.805766 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-96e41a84-5e48-4f2a-91e4-2c66925284f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2cb9f6facc241368b05563ea0957f94'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:55.817379 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-96e41a84-5e48-4f2a-91e4-2c66925284f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2cb9f6facc241368b05563ea0957f94'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:55.825086 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-96e41a84-5e48-4f2a-91e4-2c66925284f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2cb9f6facc241368b05563ea0957f94'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:55.831681 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-96e41a84-5e48-4f2a-91e4-2c66925284f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2cb9f6facc241368b05563ea0957f94'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:55.832333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-96e41a84-5e48-4f2a-91e4-2c66925284f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2cb9f6facc241368b05563ea0957f94'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:55.838353 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1402/2810] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:42:55 2021] DELETE /identity/v3/users/c2cb9f6facc241368b05563ea0957f94 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:42:55.842765 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82f91a-3592-4cf7-b7ff-ce92deeed8ab None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:55.843251 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82f91a-3592-4cf7-b7ff-ce92deeed8ab None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:55.843356 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82f91a-3592-4cf7-b7ff-ce92deeed8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:55.860723 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-7a82f91a-3592-4cf7-b7ff-ce92deeed8ab None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:42:55.861890 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7a82f91a-3592-4cf7-b7ff-ce92deeed8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:55.916898 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1409/2811] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:42:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:42:55.926651 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e41a84-5e48-4f2a-91e4-2c66925284f5 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:55.928637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-96e41a84-5e48-4f2a-91e4-2c66925284f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:55.983703 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e41a84-5e48-4f2a-91e4-2c66925284f5 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:55.987310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a609db0-37d7-4a1a-94ac-089b7095337a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:55.987967 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a609db0-37d7-4a1a-94ac-089b7095337a service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:55.988247 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a609db0-37d7-4a1a-94ac-089b7095337a service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:55.988521 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a609db0-37d7-4a1a-94ac-089b7095337a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:55.997797 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a609db0-37d7-4a1a-94ac-089b7095337a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:55.999312 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a609db0-37d7-4a1a-94ac-089b7095337a service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:56.008288 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1403/2812] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:42:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:42:56.265525 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82f91a-3592-4cf7-b7ff-ce92deeed8ab None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:56.266959 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-7a82f91a-3592-4cf7-b7ff-ce92deeed8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:56.281691 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82f91a-3592-4cf7-b7ff-ce92deeed8ab None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:56.287482 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3189e-2e82-4dad-9187-89155593d586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:56.288504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3189e-2e82-4dad-9187-89155593d586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:56.288813 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3189e-2e82-4dad-9187-89155593d586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:56.289049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3189e-2e82-4dad-9187-89155593d586 admin admin] PATH_INFO: `/v3/projects/4c5b4bfb1b404c2c9a7bb3bfe589da50` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:56.290266 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3189e-2e82-4dad-9187-89155593d586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5b4bfb1b404c2c9a7bb3bfe589da50)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:56.292154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3189e-2e82-4dad-9187-89155593d586 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:56.338683 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ecc3189e-2e82-4dad-9187-89155593d586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5b4bfb1b404c2c9a7bb3bfe589da50', 'request_id': 'req-ecc3189e-2e82-4dad-9187-89155593d586'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:56.348493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ecc3189e-2e82-4dad-9187-89155593d586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5b4bfb1b404c2c9a7bb3bfe589da50', 'request_id': 'req-ecc3189e-2e82-4dad-9187-89155593d586'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:56.356919 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ecc3189e-2e82-4dad-9187-89155593d586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5b4bfb1b404c2c9a7bb3bfe589da50', 'request_id': 'req-ecc3189e-2e82-4dad-9187-89155593d586'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:56.367682 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ecc3189e-2e82-4dad-9187-89155593d586 admin admin] The token cache is being invalidate because project 4c5b4bfb1b404c2c9a7bb3bfe589da50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:42:56.367968 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ecc3189e-2e82-4dad-9187-89155593d586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:56.368678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-ecc3189e-2e82-4dad-9187-89155593d586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:56.370315 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1410/2813] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:42:56 2021] DELETE /identity/v3/projects/4c5b4bfb1b404c2c9a7bb3bfe589da50 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:42:56.375903 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95362bb0-11e8-4c4f-875e-9a1746433efc None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:56.376191 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95362bb0-11e8-4c4f-875e-9a1746433efc None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:56.376467 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95362bb0-11e8-4c4f-875e-9a1746433efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:56.394035 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-95362bb0-11e8-4c4f-875e-9a1746433efc None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:42:56.395268 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-95362bb0-11e8-4c4f-875e-9a1746433efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:56.452263 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1404/2814] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:42:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:42:56.460774 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0b12a-c12e-4d3a-afa8-76d382a715ac None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:56.461129 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0b12a-c12e-4d3a-afa8-76d382a715ac None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:56.461479 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0b12a-c12e-4d3a-afa8-76d382a715ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:56.480522 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-53c0b12a-c12e-4d3a-afa8-76d382a715ac None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:42:56.481724 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-53c0b12a-c12e-4d3a-afa8-76d382a715ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:56.489648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1411/2815] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:42:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:42:56.493706 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95362bb0-11e8-4c4f-875e-9a1746433efc None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:56.503306 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95362bb0-11e8-4c4f-875e-9a1746433efc None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:56.507791 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8c85a-d056-4eb3-a07d-1b7659b931e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:56.508418 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8c85a-d056-4eb3-a07d-1b7659b931e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:56.508691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8c85a-d056-4eb3-a07d-1b7659b931e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:56.508960 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8c85a-d056-4eb3-a07d-1b7659b931e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:56.509677 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8c85a-d056-4eb3-a07d-1b7659b931e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:42:56.509996 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8c85a-d056-4eb3-a07d-1b7659b931e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:56.511602 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8c85a-d056-4eb3-a07d-1b7659b931e2 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:56.523412 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1405/2816] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:42:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:42:56.527459 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0b12a-c12e-4d3a-afa8-76d382a715ac None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:56.536204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0b12a-c12e-4d3a-afa8-76d382a715ac None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:56.541435 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6307d-6187-408c-9b10-c237a94c1821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:56.542165 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6307d-6187-408c-9b10-c237a94c1821 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:56.542446 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6307d-6187-408c-9b10-c237a94c1821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:56.542719 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6307d-6187-408c-9b10-c237a94c1821 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:56.543413 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6307d-6187-408c-9b10-c237a94c1821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:56.545270 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6307d-6187-408c-9b10-c237a94c1821 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:56.568762 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1412/2817] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:42:56 2021] POST /identity/v3/projects => generated 379 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:42:56.572810 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8c85a-d056-4eb3-a07d-1b7659b931e2 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:56.582710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8c85a-d056-4eb3-a07d-1b7659b931e2 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:56.636195 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a34687-070a-4f52-afac-8e7084316272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:56.636753 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a34687-070a-4f52-afac-8e7084316272 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:56.637033 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a34687-070a-4f52-afac-8e7084316272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:56.637304 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a34687-070a-4f52-afac-8e7084316272 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:56.638029 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a34687-070a-4f52-afac-8e7084316272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:56.639917 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a34687-070a-4f52-afac-8e7084316272 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:56.659649 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1406/2818] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:42:56 2021] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:42:56.663504 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6307d-6187-408c-9b10-c237a94c1821 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:56.673763 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6307d-6187-408c-9b10-c237a94c1821 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:56.678341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f8b73-e90d-46ef-a7e5-c2a84157adbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:56.678981 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f8b73-e90d-46ef-a7e5-c2a84157adbf admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:56.679259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f8b73-e90d-46ef-a7e5-c2a84157adbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:56.679534 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f8b73-e90d-46ef-a7e5-c2a84157adbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:56.680255 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f8b73-e90d-46ef-a7e5-c2a84157adbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:56.681828 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f8b73-e90d-46ef-a7e5-c2a84157adbf admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:56.691849 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1413/2819] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:42:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:42:56.696187 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a34687-070a-4f52-afac-8e7084316272 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:56.705748 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a34687-070a-4f52-afac-8e7084316272 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:56.711123 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1e55e-9784-4794-93d3-7e135940a753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:56.711758 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1e55e-9784-4794-93d3-7e135940a753 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:56.712035 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1e55e-9784-4794-93d3-7e135940a753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:56.712304 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1e55e-9784-4794-93d3-7e135940a753 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:56.713282 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1e55e-9784-4794-93d3-7e135940a753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:56.714918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1e55e-9784-4794-93d3-7e135940a753 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:56.724538 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1407/2820] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:42:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:42:56.728310 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f8b73-e90d-46ef-a7e5-c2a84157adbf admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:56.737645 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f8b73-e90d-46ef-a7e5-c2a84157adbf admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:56.742449 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16da90-2a7b-442d-ada0-ed50d29c8725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:56.743317 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16da90-2a7b-442d-ada0-ed50d29c8725 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:56.743601 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16da90-2a7b-442d-ada0-ed50d29c8725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:56.743879 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16da90-2a7b-442d-ada0-ed50d29c8725 admin admin] PATH_INFO: `/v3/projects/42d8e8b379474964981ab242093a89b6/users/99c521d2a13145938b9807275dddadc7/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:56.758301 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16da90-2a7b-442d-ada0-ed50d29c8725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d8e8b379474964981ab242093a89b6, user_id=99c521d2a13145938b9807275dddadc7, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:56.760916 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16da90-2a7b-442d-ada0-ed50d29c8725 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:56.774332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1414/2821] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:42:56 2021] PUT /identity/v3/projects/42d8e8b379474964981ab242093a89b6/users/99c521d2a13145938b9807275dddadc7/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:42:56.785564 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93d84-262c-45ec-8ad9-6f4394208dcc None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:56.785858 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93d84-262c-45ec-8ad9-6f4394208dcc None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:56.786174 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93d84-262c-45ec-8ad9-6f4394208dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:56.812056 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-ecb93d84-262c-45ec-8ad9-6f4394208dcc None None] MFA Rules not processed for user `99c521d2a13145938b9807275dddadc7`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:42:56.813239 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-ecb93d84-262c-45ec-8ad9-6f4394208dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:56.874056 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1408/2822] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:42:56 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:42:56.878459 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16da90-2a7b-442d-ada0-ed50d29c8725 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:56.938131 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16da90-2a7b-442d-ada0-ed50d29c8725 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:56.942676 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd861fa1-32ff-4639-8929-b237470efd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:56.943845 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd861fa1-32ff-4639-8929-b237470efd83 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:56.944124 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd861fa1-32ff-4639-8929-b237470efd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:56.944398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd861fa1-32ff-4639-8929-b237470efd83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:56.945099 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd861fa1-32ff-4639-8929-b237470efd83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:56.947049 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd861fa1-32ff-4639-8929-b237470efd83 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:56.971690 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1415/2823] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:42:56 2021] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:42:56.975838 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb93d84-262c-45ec-8ad9-6f4394208dcc None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:56.986070 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb93d84-262c-45ec-8ad9-6f4394208dcc None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:57.039652 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c83485-7f18-40da-ad53-2a85106831b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:57.040297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c83485-7f18-40da-ad53-2a85106831b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:57.040574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c83485-7f18-40da-ad53-2a85106831b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:57.040844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c83485-7f18-40da-ad53-2a85106831b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:57.041530 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c83485-7f18-40da-ad53-2a85106831b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:57.043443 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c83485-7f18-40da-ad53-2a85106831b5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:57.062325 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1409/2824] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:42:56 2021] POST /identity/v3/users => generated 297 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:42:57.066324 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd861fa1-32ff-4639-8929-b237470efd83 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:57.077288 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd861fa1-32ff-4639-8929-b237470efd83 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:57.081871 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c4621-3a95-483f-93e4-464e5ed89580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:57.082587 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c4621-3a95-483f-93e4-464e5ed89580 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:57.082866 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c4621-3a95-483f-93e4-464e5ed89580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:57.083137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c4621-3a95-483f-93e4-464e5ed89580 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:57.083862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c4621-3a95-483f-93e4-464e5ed89580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:57.085457 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c4621-3a95-483f-93e4-464e5ed89580 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:57.096553 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1416/2825] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:42:57 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:42:57.100448 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c83485-7f18-40da-ad53-2a85106831b5 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:57.110222 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c83485-7f18-40da-ad53-2a85106831b5 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:57.115345 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25f15c-6601-45b4-b5e2-c2a8c65851da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:57.116200 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25f15c-6601-45b4-b5e2-c2a8c65851da admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:57.116481 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25f15c-6601-45b4-b5e2-c2a8c65851da admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:57.116761 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25f15c-6601-45b4-b5e2-c2a8c65851da admin admin] PATH_INFO: `/v3/projects/5ae725398f8d49d49591091a35fa3cac/users/bf6b7b09a48f4d569c2ff9ab8d37808d/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:57.131494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25f15c-6601-45b4-b5e2-c2a8c65851da admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae725398f8d49d49591091a35fa3cac, user_id=bf6b7b09a48f4d569c2ff9ab8d37808d, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:57.134175 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25f15c-6601-45b4-b5e2-c2a8c65851da admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:57.146461 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1410/2826] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:42:57 2021] PUT /identity/v3/projects/5ae725398f8d49d49591091a35fa3cac/users/bf6b7b09a48f4d569c2ff9ab8d37808d/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:42:57.150245 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c4621-3a95-483f-93e4-464e5ed89580 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:57.160009 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c4621-3a95-483f-93e4-464e5ed89580 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:57.216338 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9ec18-f63e-4965-a0bf-830371e96607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:57.217064 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9ec18-f63e-4965-a0bf-830371e96607 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:57.217346 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9ec18-f63e-4965-a0bf-830371e96607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:57.217622 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9ec18-f63e-4965-a0bf-830371e96607 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:57.218398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9ec18-f63e-4965-a0bf-830371e96607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:57.219984 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9ec18-f63e-4965-a0bf-830371e96607 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:57.229467 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1417/2827] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:42:57 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:42:57.233590 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25f15c-6601-45b4-b5e2-c2a8c65851da admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:57.243975 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25f15c-6601-45b4-b5e2-c2a8c65851da admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:57.248514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813583f-118b-4945-be8e-ae8acb2c0096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:57.249372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813583f-118b-4945-be8e-ae8acb2c0096 admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:57.249652 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813583f-118b-4945-be8e-ae8acb2c0096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:57.249928 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813583f-118b-4945-be8e-ae8acb2c0096 admin admin] PATH_INFO: `/v3/projects/5ae725398f8d49d49591091a35fa3cac/users/bf6b7b09a48f4d569c2ff9ab8d37808d/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:57.251929 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813583f-118b-4945-be8e-ae8acb2c0096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae725398f8d49d49591091a35fa3cac, user_id=bf6b7b09a48f4d569c2ff9ab8d37808d, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:57.254572 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813583f-118b-4945-be8e-ae8acb2c0096 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:57.264773 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1411/2828] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:42:57 2021] PUT /identity/v3/projects/5ae725398f8d49d49591091a35fa3cac/users/bf6b7b09a48f4d569c2ff9ab8d37808d/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:42:57.274618 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b56545-9339-4ed4-9ee0-334e527673c0 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:57.274909 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b56545-9339-4ed4-9ee0-334e527673c0 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:57.275192 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b56545-9339-4ed4-9ee0-334e527673c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:57.303949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-d4b56545-9339-4ed4-9ee0-334e527673c0 None None] MFA Rules not processed for user `bf6b7b09a48f4d569c2ff9ab8d37808d`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:42:57.305160 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d4b56545-9339-4ed4-9ee0-334e527673c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:57.369360 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1418/2829] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:42:57 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:42:57.375218 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813583f-118b-4945-be8e-ae8acb2c0096 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:57.433419 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813583f-118b-4945-be8e-ae8acb2c0096 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:57.437949 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0e373-f113-4a70-9b90-3286060b09bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:57.438852 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0e373-f113-4a70-9b90-3286060b09bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:57.439125 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0e373-f113-4a70-9b90-3286060b09bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:57.439391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0e373-f113-4a70-9b90-3286060b09bb admin admin] PATH_INFO: `/v3/users/99c521d2a13145938b9807275dddadc7` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:57.440570 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0e373-f113-4a70-9b90-3286060b09bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c521d2a13145938b9807275dddadc7)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:57.442583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0e373-f113-4a70-9b90-3286060b09bb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:57.485769 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-14a0e373-f113-4a70-9b90-3286060b09bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c521d2a13145938b9807275dddadc7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:57.497658 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-14a0e373-f113-4a70-9b90-3286060b09bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c521d2a13145938b9807275dddadc7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:57.504710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-14a0e373-f113-4a70-9b90-3286060b09bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c521d2a13145938b9807275dddadc7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:57.511711 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-14a0e373-f113-4a70-9b90-3286060b09bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c521d2a13145938b9807275dddadc7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:57.512435 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-14a0e373-f113-4a70-9b90-3286060b09bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c521d2a13145938b9807275dddadc7'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:57.518346 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1412/2830] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:42:57 2021] DELETE /identity/v3/users/99c521d2a13145938b9807275dddadc7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:42:57.523035 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63584378-f025-4d04-a8bb-6427475817bd None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:57.523327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63584378-f025-4d04-a8bb-6427475817bd None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:57.523607 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63584378-f025-4d04-a8bb-6427475817bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:57.541443 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-63584378-f025-4d04-a8bb-6427475817bd None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:42:57.542672 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-63584378-f025-4d04-a8bb-6427475817bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:57.603033 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1419/2831] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:42:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:42:57.613735 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0e373-f113-4a70-9b90-3286060b09bb admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:57.615743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-14a0e373-f113-4a70-9b90-3286060b09bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:57.673704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0e373-f113-4a70-9b90-3286060b09bb admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:57.677964 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf4436-494e-455d-b5d5-ed38f839be21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:57.678640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf4436-494e-455d-b5d5-ed38f839be21 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:57.678921 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf4436-494e-455d-b5d5-ed38f839be21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:57.679194 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf4436-494e-455d-b5d5-ed38f839be21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:57.688559 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf4436-494e-455d-b5d5-ed38f839be21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:57.690003 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf4436-494e-455d-b5d5-ed38f839be21 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:57.699210 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1413/2832] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:42:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:42:57.953106 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63584378-f025-4d04-a8bb-6427475817bd None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:57.954561 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-63584378-f025-4d04-a8bb-6427475817bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:57.967819 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63584378-f025-4d04-a8bb-6427475817bd None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:57.972441 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c913a04-8e29-4700-bca6-0e570b9b42e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:57.973377 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c913a04-8e29-4700-bca6-0e570b9b42e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:57.973662 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c913a04-8e29-4700-bca6-0e570b9b42e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:57.974094 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c913a04-8e29-4700-bca6-0e570b9b42e1 admin admin] PATH_INFO: `/v3/projects/42d8e8b379474964981ab242093a89b6` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:57.976281 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c913a04-8e29-4700-bca6-0e570b9b42e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d8e8b379474964981ab242093a89b6)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:57.978419 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c913a04-8e29-4700-bca6-0e570b9b42e1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:58.023120 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-9c913a04-8e29-4700-bca6-0e570b9b42e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d8e8b379474964981ab242093a89b6', 'request_id': 'req-9c913a04-8e29-4700-bca6-0e570b9b42e1'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:58.029830 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-9c913a04-8e29-4700-bca6-0e570b9b42e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d8e8b379474964981ab242093a89b6', 'request_id': 'req-9c913a04-8e29-4700-bca6-0e570b9b42e1'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:58.035715 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-9c913a04-8e29-4700-bca6-0e570b9b42e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d8e8b379474964981ab242093a89b6', 'request_id': 'req-9c913a04-8e29-4700-bca6-0e570b9b42e1'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:58.049530 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-9c913a04-8e29-4700-bca6-0e570b9b42e1 admin admin] The token cache is being invalidate because project 42d8e8b379474964981ab242093a89b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:42:58.049860 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-9c913a04-8e29-4700-bca6-0e570b9b42e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:58.050786 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-9c913a04-8e29-4700-bca6-0e570b9b42e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:58.052627 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1420/2833] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:42:57 2021] DELETE /identity/v3/projects/42d8e8b379474964981ab242093a89b6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:42:58.056659 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf4436-494e-455d-b5d5-ed38f839be21 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:58.065932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf4436-494e-455d-b5d5-ed38f839be21 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:58.118462 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5ef2d-a493-4f39-86eb-ed8dd92e9b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:58.119307 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5ef2d-a493-4f39-86eb-ed8dd92e9b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:58.119579 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5ef2d-a493-4f39-86eb-ed8dd92e9b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:58.119844 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5ef2d-a493-4f39-86eb-ed8dd92e9b41 admin admin] PATH_INFO: `/v3/users/bf6b7b09a48f4d569c2ff9ab8d37808d` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:58.121015 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5ef2d-a493-4f39-86eb-ed8dd92e9b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf6b7b09a48f4d569c2ff9ab8d37808d)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:58.122940 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5ef2d-a493-4f39-86eb-ed8dd92e9b41 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:58.165078 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-54b5ef2d-a493-4f39-86eb-ed8dd92e9b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf6b7b09a48f4d569c2ff9ab8d37808d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:58.176071 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-54b5ef2d-a493-4f39-86eb-ed8dd92e9b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf6b7b09a48f4d569c2ff9ab8d37808d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:58.182132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-54b5ef2d-a493-4f39-86eb-ed8dd92e9b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf6b7b09a48f4d569c2ff9ab8d37808d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:58.188495 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-54b5ef2d-a493-4f39-86eb-ed8dd92e9b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf6b7b09a48f4d569c2ff9ab8d37808d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:58.189104 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-54b5ef2d-a493-4f39-86eb-ed8dd92e9b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf6b7b09a48f4d569c2ff9ab8d37808d'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:58.195190 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1414/2834] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:42:58 2021] DELETE /identity/v3/users/bf6b7b09a48f4d569c2ff9ab8d37808d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:42:58.453788 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c913a04-8e29-4700-bca6-0e570b9b42e1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:58.455265 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-9c913a04-8e29-4700-bca6-0e570b9b42e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:58.470309 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c913a04-8e29-4700-bca6-0e570b9b42e1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:58.525966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b5cb0-253b-4a61-95c6-2c1bed69b860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:58.526839 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b5cb0-253b-4a61-95c6-2c1bed69b860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:58.527124 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b5cb0-253b-4a61-95c6-2c1bed69b860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:58.527397 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b5cb0-253b-4a61-95c6-2c1bed69b860 admin admin] PATH_INFO: `/v3/projects/5ae725398f8d49d49591091a35fa3cac` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:58.528568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b5cb0-253b-4a61-95c6-2c1bed69b860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae725398f8d49d49591091a35fa3cac)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:58.530492 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b5cb0-253b-4a61-95c6-2c1bed69b860 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:58.575341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-693b5cb0-253b-4a61-95c6-2c1bed69b860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae725398f8d49d49591091a35fa3cac', 'request_id': 'req-693b5cb0-253b-4a61-95c6-2c1bed69b860'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:58.583339 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-693b5cb0-253b-4a61-95c6-2c1bed69b860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae725398f8d49d49591091a35fa3cac', 'request_id': 'req-693b5cb0-253b-4a61-95c6-2c1bed69b860'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:58.589923 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-693b5cb0-253b-4a61-95c6-2c1bed69b860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae725398f8d49d49591091a35fa3cac', 'request_id': 'req-693b5cb0-253b-4a61-95c6-2c1bed69b860'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:58.599759 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-693b5cb0-253b-4a61-95c6-2c1bed69b860 admin admin] The token cache is being invalidate because project 5ae725398f8d49d49591091a35fa3cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:42:58.600042 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-693b5cb0-253b-4a61-95c6-2c1bed69b860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:58.600648 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-693b5cb0-253b-4a61-95c6-2c1bed69b860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:42:58.602229 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1421/2835] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:42:58 2021] DELETE /identity/v3/projects/5ae725398f8d49d49591091a35fa3cac => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:42:58.608098 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202ebb4-3c83-4a4f-849c-ed6c4c082c7a None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:58.608380 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202ebb4-3c83-4a4f-849c-ed6c4c082c7a None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:58.608650 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202ebb4-3c83-4a4f-849c-ed6c4c082c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:58.628063 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-2202ebb4-3c83-4a4f-849c-ed6c4c082c7a None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:42:58.629221 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-2202ebb4-3c83-4a4f-849c-ed6c4c082c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:58.685599 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1415/2836] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:42:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:42:58.694037 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbeadac-ffb4-4c88-a0b6-2fa650e6aa6b None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:58.694317 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbeadac-ffb4-4c88-a0b6-2fa650e6aa6b None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:58.694591 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbeadac-ffb4-4c88-a0b6-2fa650e6aa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:58.712452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-4dbeadac-ffb4-4c88-a0b6-2fa650e6aa6b None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:42:58.713930 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4dbeadac-ffb4-4c88-a0b6-2fa650e6aa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:58.721780 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1422/2837] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:42:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:42:58.726150 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202ebb4-3c83-4a4f-849c-ed6c4c082c7a None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:58.735858 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202ebb4-3c83-4a4f-849c-ed6c4c082c7a None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:58.740930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a489617-d868-4753-8f09-f365c3eb9333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:58.741581 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a489617-d868-4753-8f09-f365c3eb9333 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:58.741863 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a489617-d868-4753-8f09-f365c3eb9333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:58.742168 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a489617-d868-4753-8f09-f365c3eb9333 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:58.742901 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a489617-d868-4753-8f09-f365c3eb9333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:42:58.743204 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a489617-d868-4753-8f09-f365c3eb9333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:58.744789 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a489617-d868-4753-8f09-f365c3eb9333 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:58.760219 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1416/2838] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:42:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:42:58.761644 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbeadac-ffb4-4c88-a0b6-2fa650e6aa6b None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:58.774728 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbeadac-ffb4-4c88-a0b6-2fa650e6aa6b None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:58.779805 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d9d0e-3cd2-4c82-b935-685a92b74aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:58.780518 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d9d0e-3cd2-4c82-b935-685a92b74aed admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:58.780868 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d9d0e-3cd2-4c82-b935-685a92b74aed admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:58.781207 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d9d0e-3cd2-4c82-b935-685a92b74aed admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:58.782075 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d9d0e-3cd2-4c82-b935-685a92b74aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:58.783962 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d9d0e-3cd2-4c82-b935-685a92b74aed admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:58.813469 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1423/2839] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:42:58 2021] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:42:58.814945 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a489617-d868-4753-8f09-f365c3eb9333 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:58.825224 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a489617-d868-4753-8f09-f365c3eb9333 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:58.879560 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcedb81-e065-4a6b-8b06-ff9ca8f194f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:58.880226 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcedb81-e065-4a6b-8b06-ff9ca8f194f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:58.880709 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcedb81-e065-4a6b-8b06-ff9ca8f194f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:58.880986 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcedb81-e065-4a6b-8b06-ff9ca8f194f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:58.881682 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcedb81-e065-4a6b-8b06-ff9ca8f194f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:58.883636 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcedb81-e065-4a6b-8b06-ff9ca8f194f5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:58.903648 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1417/2840] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:42:58 2021] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:42:58.906535 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d9d0e-3cd2-4c82-b935-685a92b74aed admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:58.917158 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d9d0e-3cd2-4c82-b935-685a92b74aed admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:58.921778 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad7dd8-b3dd-441c-8814-77165ee1f7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:58.922521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad7dd8-b3dd-441c-8814-77165ee1f7fc admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:58.922800 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad7dd8-b3dd-441c-8814-77165ee1f7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:58.923101 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad7dd8-b3dd-441c-8814-77165ee1f7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:58.923835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad7dd8-b3dd-441c-8814-77165ee1f7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:58.925414 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad7dd8-b3dd-441c-8814-77165ee1f7fc admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:58.936314 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1424/2841] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:42:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:42:58.940243 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcedb81-e065-4a6b-8b06-ff9ca8f194f5 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:58.949864 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcedb81-e065-4a6b-8b06-ff9ca8f194f5 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:58.954426 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b77ed6-439a-4c5c-8f0c-9dc0d07bcdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:58.955077 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b77ed6-439a-4c5c-8f0c-9dc0d07bcdeb admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:58.955360 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b77ed6-439a-4c5c-8f0c-9dc0d07bcdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:58.955637 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b77ed6-439a-4c5c-8f0c-9dc0d07bcdeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:58.956364 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b77ed6-439a-4c5c-8f0c-9dc0d07bcdeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:58.957956 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b77ed6-439a-4c5c-8f0c-9dc0d07bcdeb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:58.967856 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1418/2842] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:42:58 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:42:58.971768 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad7dd8-b3dd-441c-8814-77165ee1f7fc admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:58.981861 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad7dd8-b3dd-441c-8814-77165ee1f7fc admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:58.986439 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4f1a7-303d-4648-98fb-bbc9398d1dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:58.987301 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4f1a7-303d-4648-98fb-bbc9398d1dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:58.987581 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4f1a7-303d-4648-98fb-bbc9398d1dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:58.987956 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4f1a7-303d-4648-98fb-bbc9398d1dfb admin admin] PATH_INFO: `/v3/projects/1db277f31d6d4e089cfc83bcb81a28f0/users/881f2738d4974f95a70ee9842883931c/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:59.002583 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4f1a7-303d-4648-98fb-bbc9398d1dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db277f31d6d4e089cfc83bcb81a28f0, user_id=881f2738d4974f95a70ee9842883931c, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:59.005222 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4f1a7-303d-4648-98fb-bbc9398d1dfb admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:59.017396 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1425/2843] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:42:58 2021] PUT /identity/v3/projects/1db277f31d6d4e089cfc83bcb81a28f0/users/881f2738d4974f95a70ee9842883931c/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:42:59.028722 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a80e1-9660-4959-8f5b-9fce5e04176d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:59.029016 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a80e1-9660-4959-8f5b-9fce5e04176d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:59.029324 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a80e1-9660-4959-8f5b-9fce5e04176d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:59.059450 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-cd2a80e1-9660-4959-8f5b-9fce5e04176d None None] MFA Rules not processed for user `881f2738d4974f95a70ee9842883931c`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:42:59.060663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-cd2a80e1-9660-4959-8f5b-9fce5e04176d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:59.122172 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1419/2844] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:42:59 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:42:59.126616 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4f1a7-303d-4648-98fb-bbc9398d1dfb admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:59.189080 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4f1a7-303d-4648-98fb-bbc9398d1dfb admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:59.193664 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bc0f9-7378-46c5-ba84-392b00b24463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:59.194408 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bc0f9-7378-46c5-ba84-392b00b24463 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:59.194740 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bc0f9-7378-46c5-ba84-392b00b24463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:59.195014 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bc0f9-7378-46c5-ba84-392b00b24463 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:59.195727 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bc0f9-7378-46c5-ba84-392b00b24463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:59.198123 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bc0f9-7378-46c5-ba84-392b00b24463 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:59.225513 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1426/2845] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:42:59 2021] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:42:59.229461 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a80e1-9660-4959-8f5b-9fce5e04176d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:59.239925 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a80e1-9660-4959-8f5b-9fce5e04176d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:59.295610 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24616052-3ba4-406d-bddc-c335c68ebc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:59.296297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24616052-3ba4-406d-bddc-c335c68ebc2f admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:59.296547 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24616052-3ba4-406d-bddc-c335c68ebc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:59.296828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24616052-3ba4-406d-bddc-c335c68ebc2f admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:59.297535 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24616052-3ba4-406d-bddc-c335c68ebc2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:59.299464 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24616052-3ba4-406d-bddc-c335c68ebc2f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:59.322474 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1420/2846] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:42:59 2021] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:42:59.323717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bc0f9-7378-46c5-ba84-392b00b24463 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:59.334373 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bc0f9-7378-46c5-ba84-392b00b24463 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:59.339332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4fd40-0b5b-4c20-868f-8ebf139f5d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:59.340280 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4fd40-0b5b-4c20-868f-8ebf139f5d62 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:59.340562 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4fd40-0b5b-4c20-868f-8ebf139f5d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:59.340841 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4fd40-0b5b-4c20-868f-8ebf139f5d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:59.341566 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4fd40-0b5b-4c20-868f-8ebf139f5d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:59.343184 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4fd40-0b5b-4c20-868f-8ebf139f5d62 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:59.353991 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1427/2847] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:42:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:42:59.358493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24616052-3ba4-406d-bddc-c335c68ebc2f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:59.367996 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24616052-3ba4-406d-bddc-c335c68ebc2f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:59.372465 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24632405-608c-4a27-b356-81dc167944bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:59.373313 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24632405-608c-4a27-b356-81dc167944bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:59.373589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24632405-608c-4a27-b356-81dc167944bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:59.373857 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24632405-608c-4a27-b356-81dc167944bf admin admin] PATH_INFO: `/v3/projects/ad770435538d4c4a8cd0c6f7ff684644/users/cf05bd7c372142878c5ebba7adc0a8d3/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:59.388496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24632405-608c-4a27-b356-81dc167944bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad770435538d4c4a8cd0c6f7ff684644, user_id=cf05bd7c372142878c5ebba7adc0a8d3, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:59.391148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24632405-608c-4a27-b356-81dc167944bf admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:59.404660 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1421/2848] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:42:59 2021] PUT /identity/v3/projects/ad770435538d4c4a8cd0c6f7ff684644/users/cf05bd7c372142878c5ebba7adc0a8d3/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:42:59.408490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4fd40-0b5b-4c20-868f-8ebf139f5d62 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:59.419052 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4fd40-0b5b-4c20-868f-8ebf139f5d62 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:59.472792 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07b2fc-e97b-4138-8006-2d67a392850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:59.473451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07b2fc-e97b-4138-8006-2d67a392850d admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:59.473733 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07b2fc-e97b-4138-8006-2d67a392850d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:59.474043 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07b2fc-e97b-4138-8006-2d67a392850d admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:59.475375 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07b2fc-e97b-4138-8006-2d67a392850d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:59.477081 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07b2fc-e97b-4138-8006-2d67a392850d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:59.486750 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1428/2849] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:42:59 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:42:59.490902 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24632405-608c-4a27-b356-81dc167944bf admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:59.500900 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24632405-608c-4a27-b356-81dc167944bf admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:59.505530 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bc046-df0b-47d0-a40a-b8b91ca1e7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:59.506427 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bc046-df0b-47d0-a40a-b8b91ca1e7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:59.506710 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bc046-df0b-47d0-a40a-b8b91ca1e7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:59.506989 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bc046-df0b-47d0-a40a-b8b91ca1e7cc admin admin] PATH_INFO: `/v3/projects/ad770435538d4c4a8cd0c6f7ff684644/users/cf05bd7c372142878c5ebba7adc0a8d3/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:59.509027 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bc046-df0b-47d0-a40a-b8b91ca1e7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad770435538d4c4a8cd0c6f7ff684644, user_id=cf05bd7c372142878c5ebba7adc0a8d3, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:59.511676 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bc046-df0b-47d0-a40a-b8b91ca1e7cc admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:59.522541 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1422/2850] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:42:59 2021] PUT /identity/v3/projects/ad770435538d4c4a8cd0c6f7ff684644/users/cf05bd7c372142878c5ebba7adc0a8d3/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:42:59.532482 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c819d1-c9b0-4748-b3a4-7f5ec37906b4 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:59.532851 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c819d1-c9b0-4748-b3a4-7f5ec37906b4 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:59.533213 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c819d1-c9b0-4748-b3a4-7f5ec37906b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:59.559429 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-05c819d1-c9b0-4748-b3a4-7f5ec37906b4 None None] MFA Rules not processed for user `cf05bd7c372142878c5ebba7adc0a8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:42:59.560625 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-05c819d1-c9b0-4748-b3a4-7f5ec37906b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:59.627023 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1429/2851] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:42:59 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:42:59.637595 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bc046-df0b-47d0-a40a-b8b91ca1e7cc admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:59.639407 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d60bc046-df0b-47d0-a40a-b8b91ca1e7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:42:59.693494 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bc046-df0b-47d0-a40a-b8b91ca1e7cc admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:59.697149 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc6297-b8c4-4b08-880b-3d45f101cfcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:59.697778 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc6297-b8c4-4b08-880b-3d45f101cfcf service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:59.698087 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc6297-b8c4-4b08-880b-3d45f101cfcf service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:59.698369 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc6297-b8c4-4b08-880b-3d45f101cfcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:59.707085 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc6297-b8c4-4b08-880b-3d45f101cfcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:59.708517 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc6297-b8c4-4b08-880b-3d45f101cfcf service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:59.718429 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1423/2852] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:42:59 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:42:59.786308 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c819d1-c9b0-4748-b3a4-7f5ec37906b4 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:42:59.795824 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c819d1-c9b0-4748-b3a4-7f5ec37906b4 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:42:59.799388 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98106b03-0a4e-4f33-9693-750fe649ec88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:42:59.800011 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106b03-0a4e-4f33-9693-750fe649ec88 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:42:59.800289 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106b03-0a4e-4f33-9693-750fe649ec88 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:42:59.800558 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106b03-0a4e-4f33-9693-750fe649ec88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:42:59.857068 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98106b03-0a4e-4f33-9693-750fe649ec88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:42:59.858548 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98106b03-0a4e-4f33-9693-750fe649ec88 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:42:59.867044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1430/2853] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:42:59 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:43:02.500516 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc6297-b8c4-4b08-880b-3d45f101cfcf service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:02.561918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc6297-b8c4-4b08-880b-3d45f101cfcf service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:02.566353 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab38183-b28f-4ccf-a824-62ec15888673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:02.567222 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab38183-b28f-4ccf-a824-62ec15888673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:02.567501 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab38183-b28f-4ccf-a824-62ec15888673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:02.567790 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab38183-b28f-4ccf-a824-62ec15888673 admin admin] PATH_INFO: `/v3/users/881f2738d4974f95a70ee9842883931c` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:02.568980 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab38183-b28f-4ccf-a824-62ec15888673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=881f2738d4974f95a70ee9842883931c)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:02.570910 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab38183-b28f-4ccf-a824-62ec15888673 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:02.615043 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cab38183-b28f-4ccf-a824-62ec15888673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '881f2738d4974f95a70ee9842883931c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:02.625906 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cab38183-b28f-4ccf-a824-62ec15888673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '881f2738d4974f95a70ee9842883931c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:02.633035 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cab38183-b28f-4ccf-a824-62ec15888673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '881f2738d4974f95a70ee9842883931c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:02.639514 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cab38183-b28f-4ccf-a824-62ec15888673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '881f2738d4974f95a70ee9842883931c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:02.640145 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-cab38183-b28f-4ccf-a824-62ec15888673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '881f2738d4974f95a70ee9842883931c'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:02.645669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1424/2854] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:43:02 2021] DELETE /identity/v3/users/881f2738d4974f95a70ee9842883931c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:02.650824 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640351a-92b8-40e8-a84d-956d7459f09e None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:02.651318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640351a-92b8-40e8-a84d-956d7459f09e None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:02.651429 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640351a-92b8-40e8-a84d-956d7459f09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:02.668096 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-e640351a-92b8-40e8-a84d-956d7459f09e None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:43:02.669257 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e640351a-92b8-40e8-a84d-956d7459f09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:02.725379 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1431/2855] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:43:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:43:02.735156 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab38183-b28f-4ccf-a824-62ec15888673 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:02.736539 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-cab38183-b28f-4ccf-a824-62ec15888673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:02.790986 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab38183-b28f-4ccf-a824-62ec15888673 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:02.794647 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0b584-6eda-47c1-a4f3-753268d0cec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:02.795273 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0b584-6eda-47c1-a4f3-753268d0cec7 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:02.795551 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0b584-6eda-47c1-a4f3-753268d0cec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:02.795828 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0b584-6eda-47c1-a4f3-753268d0cec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:02.804343 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0b584-6eda-47c1-a4f3-753268d0cec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:02.805756 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0b584-6eda-47c1-a4f3-753268d0cec7 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:02.814862 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1425/2856] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:43:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:43:03.073224 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640351a-92b8-40e8-a84d-956d7459f09e None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:03.074663 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e640351a-92b8-40e8-a84d-956d7459f09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:03.086576 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640351a-92b8-40e8-a84d-956d7459f09e None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:03.091352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:03.092198 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:03.092476 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:03.092747 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4 admin admin] PATH_INFO: `/v3/projects/1db277f31d6d4e089cfc83bcb81a28f0` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:03.093909 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db277f31d6d4e089cfc83bcb81a28f0)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:03.095831 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:03.142268 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db277f31d6d4e089cfc83bcb81a28f0', 'request_id': 'req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:03.149341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db277f31d6d4e089cfc83bcb81a28f0', 'request_id': 'req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:03.155324 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db277f31d6d4e089cfc83bcb81a28f0', 'request_id': 'req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:03.165182 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4 admin admin] The token cache is being invalidate because project 1db277f31d6d4e089cfc83bcb81a28f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:43:03.165471 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:03.166160 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:03.167718 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1432/2857] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:43:03 2021] DELETE /identity/v3/projects/1db277f31d6d4e089cfc83bcb81a28f0 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:03.171730 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0b584-6eda-47c1-a4f3-753268d0cec7 service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:03.181517 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0b584-6eda-47c1-a4f3-753268d0cec7 service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:03.235134 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0cb12-b4d8-47cf-9ed3-a45a02639c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:03.235994 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0cb12-b4d8-47cf-9ed3-a45a02639c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:03.236277 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0cb12-b4d8-47cf-9ed3-a45a02639c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:03.236554 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0cb12-b4d8-47cf-9ed3-a45a02639c2e admin admin] PATH_INFO: `/v3/users/cf05bd7c372142878c5ebba7adc0a8d3` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:03.237743 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0cb12-b4d8-47cf-9ed3-a45a02639c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf05bd7c372142878c5ebba7adc0a8d3)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:03.240265 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0cb12-b4d8-47cf-9ed3-a45a02639c2e admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:03.285049 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-13e0cb12-b4d8-47cf-9ed3-a45a02639c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf05bd7c372142878c5ebba7adc0a8d3'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:03.296780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-13e0cb12-b4d8-47cf-9ed3-a45a02639c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf05bd7c372142878c5ebba7adc0a8d3'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:03.303664 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-13e0cb12-b4d8-47cf-9ed3-a45a02639c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf05bd7c372142878c5ebba7adc0a8d3'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:03.310175 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-13e0cb12-b4d8-47cf-9ed3-a45a02639c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf05bd7c372142878c5ebba7adc0a8d3'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:03.310786 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-13e0cb12-b4d8-47cf-9ed3-a45a02639c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf05bd7c372142878c5ebba7adc0a8d3'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:03.316362 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1426/2858] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:43:03 2021] DELETE /identity/v3/users/cf05bd7c372142878c5ebba7adc0a8d3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:03.575440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:03.576835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:03.590847 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b22d56-4b89-4d27-b31c-dad0040dbdb4 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:03.644734 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6bcf9-367c-41a9-a909-2f98fcba36b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:03.645576 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6bcf9-367c-41a9-a909-2f98fcba36b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:03.645854 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6bcf9-367c-41a9-a909-2f98fcba36b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:03.646727 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6bcf9-367c-41a9-a909-2f98fcba36b2 admin admin] PATH_INFO: `/v3/projects/ad770435538d4c4a8cd0c6f7ff684644` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:03.647922 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6bcf9-367c-41a9-a909-2f98fcba36b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad770435538d4c4a8cd0c6f7ff684644)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:03.649816 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6bcf9-367c-41a9-a909-2f98fcba36b2 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:03.692605 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5db6bcf9-367c-41a9-a909-2f98fcba36b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad770435538d4c4a8cd0c6f7ff684644', 'request_id': 'req-5db6bcf9-367c-41a9-a909-2f98fcba36b2'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:03.700110 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5db6bcf9-367c-41a9-a909-2f98fcba36b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad770435538d4c4a8cd0c6f7ff684644', 'request_id': 'req-5db6bcf9-367c-41a9-a909-2f98fcba36b2'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:03.706085 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5db6bcf9-367c-41a9-a909-2f98fcba36b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad770435538d4c4a8cd0c6f7ff684644', 'request_id': 'req-5db6bcf9-367c-41a9-a909-2f98fcba36b2'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:03.716029 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5db6bcf9-367c-41a9-a909-2f98fcba36b2 admin admin] The token cache is being invalidate because project ad770435538d4c4a8cd0c6f7ff684644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:43:03.716315 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5db6bcf9-367c-41a9-a909-2f98fcba36b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:03.716924 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-5db6bcf9-367c-41a9-a909-2f98fcba36b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:03.718440 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1433/2859] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:43:03 2021] DELETE /identity/v3/projects/ad770435538d4c4a8cd0c6f7ff684644 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:03.724052 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecbcc6-8670-4569-860e-cc0adc563ca3 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:03.724573 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecbcc6-8670-4569-860e-cc0adc563ca3 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:03.724573 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecbcc6-8670-4569-860e-cc0adc563ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:03.741973 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-88ecbcc6-8670-4569-860e-cc0adc563ca3 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:43:03.743171 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-88ecbcc6-8670-4569-860e-cc0adc563ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:03.798377 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1427/2860] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:43:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:43:03.807798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18d5a0-44ea-462c-8465-2e3dcf878a31 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:03.808108 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18d5a0-44ea-462c-8465-2e3dcf878a31 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:03.808490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18d5a0-44ea-462c-8465-2e3dcf878a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:03.826685 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-6c18d5a0-44ea-462c-8465-2e3dcf878a31 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:43:03.827791 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6c18d5a0-44ea-462c-8465-2e3dcf878a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:03.835490 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1434/2861] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:43:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:43:03.840431 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecbcc6-8670-4569-860e-cc0adc563ca3 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:03.851032 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecbcc6-8670-4569-860e-cc0adc563ca3 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:03.855574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245dab6-4097-46aa-a40c-0bb93d2c4580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:03.856211 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245dab6-4097-46aa-a40c-0bb93d2c4580 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:03.856491 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245dab6-4097-46aa-a40c-0bb93d2c4580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:03.856763 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245dab6-4097-46aa-a40c-0bb93d2c4580 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:03.857481 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245dab6-4097-46aa-a40c-0bb93d2c4580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:43:03.857781 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245dab6-4097-46aa-a40c-0bb93d2c4580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:03.859386 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245dab6-4097-46aa-a40c-0bb93d2c4580 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:03.870855 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1428/2862] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:43:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:43:03.876712 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18d5a0-44ea-462c-8465-2e3dcf878a31 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:03.887744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18d5a0-44ea-462c-8465-2e3dcf878a31 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:03.892391 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aa6aa-909e-4ab3-bfec-d759f736d051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:03.893023 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa6aa-909e-4ab3-bfec-d759f736d051 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:03.893303 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa6aa-909e-4ab3-bfec-d759f736d051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:03.893579 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa6aa-909e-4ab3-bfec-d759f736d051 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:03.894324 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482aa6aa-909e-4ab3-bfec-d759f736d051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:03.896259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482aa6aa-909e-4ab3-bfec-d759f736d051 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:03.924377 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1435/2863] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:43:03 2021] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:43:03.925547 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245dab6-4097-46aa-a40c-0bb93d2c4580 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:03.935985 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245dab6-4097-46aa-a40c-0bb93d2c4580 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:03.987689 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b6806-8052-4f26-bc3a-7a63824dd3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:03.988337 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b6806-8052-4f26-bc3a-7a63824dd3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:03.988614 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b6806-8052-4f26-bc3a-7a63824dd3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:03.988884 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b6806-8052-4f26-bc3a-7a63824dd3a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:03.989560 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b6806-8052-4f26-bc3a-7a63824dd3a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:03.991968 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b6806-8052-4f26-bc3a-7a63824dd3a5 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:04.013189 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1429/2864] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:43:03 2021] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:43:04.017182 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aa6aa-909e-4ab3-bfec-d759f736d051 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:04.029390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aa6aa-909e-4ab3-bfec-d759f736d051 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:04.033909 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca0d6f-e6eb-4074-adb1-a57bc7463731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:04.034576 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca0d6f-e6eb-4074-adb1-a57bc7463731 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:04.034852 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca0d6f-e6eb-4074-adb1-a57bc7463731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:04.035123 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca0d6f-e6eb-4074-adb1-a57bc7463731 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:04.035844 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca0d6f-e6eb-4074-adb1-a57bc7463731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:04.037715 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca0d6f-e6eb-4074-adb1-a57bc7463731 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:04.049260 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1436/2865] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:43:04 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:43:04.053749 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b6806-8052-4f26-bc3a-7a63824dd3a5 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:04.063361 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b6806-8052-4f26-bc3a-7a63824dd3a5 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:04.068798 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48599bce-acc1-4313-bc09-a0b41ab40f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:04.069431 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48599bce-acc1-4313-bc09-a0b41ab40f05 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:04.069708 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48599bce-acc1-4313-bc09-a0b41ab40f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:04.069998 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48599bce-acc1-4313-bc09-a0b41ab40f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:04.070733 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48599bce-acc1-4313-bc09-a0b41ab40f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:04.072310 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48599bce-acc1-4313-bc09-a0b41ab40f05 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:04.081897 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1430/2866] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:43:04 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:43:04.086110 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca0d6f-e6eb-4074-adb1-a57bc7463731 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:04.096035 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca0d6f-e6eb-4074-adb1-a57bc7463731 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:04.101124 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0260ab1-e2c0-4e97-a32a-ab4cfd4d5774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:04.102010 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0260ab1-e2c0-4e97-a32a-ab4cfd4d5774 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:04.102306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0260ab1-e2c0-4e97-a32a-ab4cfd4d5774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:04.102582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0260ab1-e2c0-4e97-a32a-ab4cfd4d5774 admin admin] PATH_INFO: `/v3/projects/fb3e7d19918f4f5d8b175271eccf68aa/users/4ecee9e56a4943bda8236549184e053a/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:04.116886 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0260ab1-e2c0-4e97-a32a-ab4cfd4d5774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3e7d19918f4f5d8b175271eccf68aa, user_id=4ecee9e56a4943bda8236549184e053a, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:04.119523 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0260ab1-e2c0-4e97-a32a-ab4cfd4d5774 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:04.131888 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1437/2867] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:43:04 2021] PUT /identity/v3/projects/fb3e7d19918f4f5d8b175271eccf68aa/users/4ecee9e56a4943bda8236549184e053a/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:04.137084 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2324bd-d6dd-4cc3-910a-e829e6a47af4 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:04.137391 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2324bd-d6dd-4cc3-910a-e829e6a47af4 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:04.137667 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2324bd-d6dd-4cc3-910a-e829e6a47af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:04.154704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-fb2324bd-d6dd-4cc3-910a-e829e6a47af4 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:43:04.155872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-fb2324bd-d6dd-4cc3-910a-e829e6a47af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:04.212293 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1431/2868] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:43:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:43:04.222398 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0260ab1-e2c0-4e97-a32a-ab4cfd4d5774 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:04.224586 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b0260ab1-e2c0-4e97-a32a-ab4cfd4d5774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:04.279043 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0260ab1-e2c0-4e97-a32a-ab4cfd4d5774 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:04.282610 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea413b45-1015-45c6-9fc1-8e0964ecc972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:04.283239 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea413b45-1015-45c6-9fc1-8e0964ecc972 service neutron] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:04.283525 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea413b45-1015-45c6-9fc1-8e0964ecc972 service neutron] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:04.283803 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea413b45-1015-45c6-9fc1-8e0964ecc972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:04.292453 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea413b45-1015-45c6-9fc1-8e0964ecc972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:04.293886 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea413b45-1015-45c6-9fc1-8e0964ecc972 service neutron] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:04.303056 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1438/2869] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:43:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 03:43:04.935047 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21481a-0bfd-45a2-8ed3-7c38e5a78754 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:04.935571 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21481a-0bfd-45a2-8ed3-7c38e5a78754 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:04.935571 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21481a-0bfd-45a2-8ed3-7c38e5a78754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:04.968145 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-8d21481a-0bfd-45a2-8ed3-7c38e5a78754 None None] MFA Rules not processed for user `4ecee9e56a4943bda8236549184e053a`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:43:04.969356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-8d21481a-0bfd-45a2-8ed3-7c38e5a78754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:05.034631 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1432/2870] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:43:04 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:43:05.039608 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea413b45-1015-45c6-9fc1-8e0964ecc972 service neutron] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:05.049175 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea413b45-1015-45c6-9fc1-8e0964ecc972 service neutron] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:05.056022 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e45506-8403-4974-b1bf-93810707b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:05.056693 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e45506-8403-4974-b1bf-93810707b584 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:05.056979 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e45506-8403-4974-b1bf-93810707b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:05.057259 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e45506-8403-4974-b1bf-93810707b584 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:05.058005 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e45506-8403-4974-b1bf-93810707b584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:05.060009 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e45506-8403-4974-b1bf-93810707b584 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:05.092082 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1439/2871] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:43:05 2021] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:43:05.093180 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21481a-0bfd-45a2-8ed3-7c38e5a78754 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:05.104594 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21481a-0bfd-45a2-8ed3-7c38e5a78754 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:05.158795 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515077ba-3224-42e3-8ef8-5743734df6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:05.159368 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515077ba-3224-42e3-8ef8-5743734df6bd admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:05.159652 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515077ba-3224-42e3-8ef8-5743734df6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:05.159924 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515077ba-3224-42e3-8ef8-5743734df6bd admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:05.160611 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515077ba-3224-42e3-8ef8-5743734df6bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:05.163065 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515077ba-3224-42e3-8ef8-5743734df6bd admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:05.183114 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1433/2872] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:43:05 2021] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:43:05.187057 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e45506-8403-4974-b1bf-93810707b584 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:05.196949 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e45506-8403-4974-b1bf-93810707b584 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:05.201493 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c1227-0687-4d76-8aec-277307efa4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:05.202181 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c1227-0687-4d76-8aec-277307efa4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:05.202459 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c1227-0687-4d76-8aec-277307efa4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:05.202732 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c1227-0687-4d76-8aec-277307efa4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:05.205078 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c1227-0687-4d76-8aec-277307efa4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:05.205078 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c1227-0687-4d76-8aec-277307efa4f1 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:05.216341 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1440/2873] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:43:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:43:05.220417 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515077ba-3224-42e3-8ef8-5743734df6bd admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:05.230875 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515077ba-3224-42e3-8ef8-5743734df6bd admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:05.235438 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7559834-0354-422c-8b35-ea6e97ad561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:05.236316 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7559834-0354-422c-8b35-ea6e97ad561d admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:05.236592 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7559834-0354-422c-8b35-ea6e97ad561d admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:05.236861 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7559834-0354-422c-8b35-ea6e97ad561d admin admin] PATH_INFO: `/v3/projects/14d3cdfdfd3e42c796af8e272c2212f9/users/04281eeefa384c409f8db63a0a14caa5/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:05.250876 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7559834-0354-422c-8b35-ea6e97ad561d admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d3cdfdfd3e42c796af8e272c2212f9, user_id=04281eeefa384c409f8db63a0a14caa5, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:05.253493 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7559834-0354-422c-8b35-ea6e97ad561d admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:05.265611 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1434/2874] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:43:05 2021] PUT /identity/v3/projects/14d3cdfdfd3e42c796af8e272c2212f9/users/04281eeefa384c409f8db63a0a14caa5/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:43:05.269599 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c1227-0687-4d76-8aec-277307efa4f1 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:05.279805 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c1227-0687-4d76-8aec-277307efa4f1 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:05.332995 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126fca0-9bff-465f-9536-4f6464c7f127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:05.334170 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126fca0-9bff-465f-9536-4f6464c7f127 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:05.334452 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126fca0-9bff-465f-9536-4f6464c7f127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:05.334725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126fca0-9bff-465f-9536-4f6464c7f127 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:05.335451 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126fca0-9bff-465f-9536-4f6464c7f127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:05.337083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126fca0-9bff-465f-9536-4f6464c7f127 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:05.346725 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1441/2875] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:43:05 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 03:43:05.351300 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7559834-0354-422c-8b35-ea6e97ad561d admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:05.361287 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7559834-0354-422c-8b35-ea6e97ad561d admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:05.365764 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd145231-b128-4ff9-b1ba-94d9c544837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:05.366656 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd145231-b128-4ff9-b1ba-94d9c544837a admin admin] REQUEST_METHOD: `PUT` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:05.366932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd145231-b128-4ff9-b1ba-94d9c544837a admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:05.367202 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd145231-b128-4ff9-b1ba-94d9c544837a admin admin] PATH_INFO: `/v3/projects/14d3cdfdfd3e42c796af8e272c2212f9/users/04281eeefa384c409f8db63a0a14caa5/roles/5f5ed2f047e14fffbb71361f14dc13a1` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:05.369152 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd145231-b128-4ff9-b1ba-94d9c544837a admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d3cdfdfd3e42c796af8e272c2212f9, user_id=04281eeefa384c409f8db63a0a14caa5, role_id=5f5ed2f047e14fffbb71361f14dc13a1)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:05.371780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd145231-b128-4ff9-b1ba-94d9c544837a admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:05.381574 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1435/2876] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:43:05 2021] PUT /identity/v3/projects/14d3cdfdfd3e42c796af8e272c2212f9/users/04281eeefa384c409f8db63a0a14caa5/roles/5f5ed2f047e14fffbb71361f14dc13a1 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:43:05.978426 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bf77c-34f2-4a5a-a7b5-04b4214b11eb None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:05.978722 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bf77c-34f2-4a5a-a7b5-04b4214b11eb None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:05.979038 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bf77c-34f2-4a5a-a7b5-04b4214b11eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:06.005173 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-689bf77c-34f2-4a5a-a7b5-04b4214b11eb None None] MFA Rules not processed for user `04281eeefa384c409f8db63a0a14caa5`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:43:06.006402 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-689bf77c-34f2-4a5a-a7b5-04b4214b11eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:06.076306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1442/2877] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:43:05 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:43:06.086937 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd145231-b128-4ff9-b1ba-94d9c544837a admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:06.089144 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-cd145231-b128-4ff9-b1ba-94d9c544837a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:06.143384 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd145231-b128-4ff9-b1ba-94d9c544837a admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:06.147525 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f672b6-2bc4-449e-b24a-2880ff89172a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:06.148184 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f672b6-2bc4-449e-b24a-2880ff89172a service cinder] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:06.148465 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f672b6-2bc4-449e-b24a-2880ff89172a service cinder] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:06.148732 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f672b6-2bc4-449e-b24a-2880ff89172a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:06.202736 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f672b6-2bc4-449e-b24a-2880ff89172a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:06.204275 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f672b6-2bc4-449e-b24a-2880ff89172a service cinder] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:06.214129 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1436/2878] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:43:06 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:43:07.530722 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bf77c-34f2-4a5a-a7b5-04b4214b11eb None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:07.540169 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bf77c-34f2-4a5a-a7b5-04b4214b11eb None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:07.543720 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c7793-39eb-4c06-baec-8704d2ca7a00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:07.544348 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c7793-39eb-4c06-baec-8704d2ca7a00 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:07.544652 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c7793-39eb-4c06-baec-8704d2ca7a00 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:07.544929 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c7793-39eb-4c06-baec-8704d2ca7a00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:07.554254 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c7793-39eb-4c06-baec-8704d2ca7a00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:07.555665 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c7793-39eb-4c06-baec-8704d2ca7a00 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:07.564824 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1443/2879] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:43:07 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:43:14.376783 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f672b6-2bc4-449e-b24a-2880ff89172a service cinder] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:14.430323 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f672b6-2bc4-449e-b24a-2880ff89172a service cinder] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:14.433918 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e06e4-d5f7-4ef9-b80e-aef3d0a38aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:14.434607 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e06e4-d5f7-4ef9-b80e-aef3d0a38aac service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:14.434883 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e06e4-d5f7-4ef9-b80e-aef3d0a38aac service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:14.435158 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e06e4-d5f7-4ef9-b80e-aef3d0a38aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:14.436940 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-f30e06e4-d5f7-4ef9-b80e-aef3d0a38aac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:14.517333 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e06e4-d5f7-4ef9-b80e-aef3d0a38aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:14.518794 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e06e4-d5f7-4ef9-b80e-aef3d0a38aac service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:14.538060 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1437/2880] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:43:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:43:20.305392 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c7793-39eb-4c06-baec-8704d2ca7a00 service cinder] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:20.319697 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c7793-39eb-4c06-baec-8704d2ca7a00 service cinder] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:20.324649 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54392a3-903d-42fb-afb7-67bb051b5678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:20.325581 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54392a3-903d-42fb-afb7-67bb051b5678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:20.325933 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54392a3-903d-42fb-afb7-67bb051b5678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:20.326318 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54392a3-903d-42fb-afb7-67bb051b5678 admin admin] PATH_INFO: `/v3/users/4ecee9e56a4943bda8236549184e053a` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:20.327713 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54392a3-903d-42fb-afb7-67bb051b5678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ecee9e56a4943bda8236549184e053a)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:20.329902 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54392a3-903d-42fb-afb7-67bb051b5678 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:20.379391 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c54392a3-903d-42fb-afb7-67bb051b5678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ecee9e56a4943bda8236549184e053a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:20.397012 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c54392a3-903d-42fb-afb7-67bb051b5678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ecee9e56a4943bda8236549184e053a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:20.418559 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c54392a3-903d-42fb-afb7-67bb051b5678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ecee9e56a4943bda8236549184e053a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:20.419536 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c54392a3-903d-42fb-afb7-67bb051b5678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ecee9e56a4943bda8236549184e053a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:20.420477 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-c54392a3-903d-42fb-afb7-67bb051b5678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ecee9e56a4943bda8236549184e053a'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:20.444330 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1444/2881] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:43:20 2021] DELETE /identity/v3/users/4ecee9e56a4943bda8236549184e053a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:20.663089 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e06e4-d5f7-4ef9-b80e-aef3d0a38aac service neutron] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:20.675531 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e06e4-d5f7-4ef9-b80e-aef3d0a38aac service neutron] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:20.778583 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99967-543f-4ee1-9721-d403934df8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:20.779969 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99967-543f-4ee1-9721-d403934df8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:20.780272 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99967-543f-4ee1-9721-d403934df8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:20.780619 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99967-543f-4ee1-9721-d403934df8ea admin admin] PATH_INFO: `/v3/projects/fb3e7d19918f4f5d8b175271eccf68aa` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:20.782587 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd99967-543f-4ee1-9721-d403934df8ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb3e7d19918f4f5d8b175271eccf68aa)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:20.787184 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd99967-543f-4ee1-9721-d403934df8ea admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:20.857827 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7dd99967-543f-4ee1-9721-d403934df8ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3e7d19918f4f5d8b175271eccf68aa', 'request_id': 'req-7dd99967-543f-4ee1-9721-d403934df8ea'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:20.866958 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7dd99967-543f-4ee1-9721-d403934df8ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3e7d19918f4f5d8b175271eccf68aa', 'request_id': 'req-7dd99967-543f-4ee1-9721-d403934df8ea'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:20.873640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7dd99967-543f-4ee1-9721-d403934df8ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3e7d19918f4f5d8b175271eccf68aa', 'request_id': 'req-7dd99967-543f-4ee1-9721-d403934df8ea'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:20.883621 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7dd99967-543f-4ee1-9721-d403934df8ea admin admin] The token cache is being invalidate because project fb3e7d19918f4f5d8b175271eccf68aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:43:20.883911 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7dd99967-543f-4ee1-9721-d403934df8ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:20.884557 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-7dd99967-543f-4ee1-9721-d403934df8ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:20.886110 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1438/2882] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:43:20 2021] DELETE /identity/v3/projects/fb3e7d19918f4f5d8b175271eccf68aa => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:20.890022 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54392a3-903d-42fb-afb7-67bb051b5678 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:20.891744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-c54392a3-903d-42fb-afb7-67bb051b5678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:20.904332 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54392a3-903d-42fb-afb7-67bb051b5678 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:20.960705 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d07d5-d8c4-454d-be99-c1bd5d3a2858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:20.961574 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d07d5-d8c4-454d-be99-c1bd5d3a2858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:20.961858 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d07d5-d8c4-454d-be99-c1bd5d3a2858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:20.962168 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d07d5-d8c4-454d-be99-c1bd5d3a2858 admin admin] PATH_INFO: `/v3/users/04281eeefa384c409f8db63a0a14caa5` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:20.963678 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d07d5-d8c4-454d-be99-c1bd5d3a2858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04281eeefa384c409f8db63a0a14caa5)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:20.965815 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d07d5-d8c4-454d-be99-c1bd5d3a2858 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:20.982953 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99967-543f-4ee1-9721-d403934df8ea admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:20.984742 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-7dd99967-543f-4ee1-9721-d403934df8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:20.998966 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99967-543f-4ee1-9721-d403934df8ea admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:21.004535 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf222daf-cde6-487a-a00b-1bf6f8ccb9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:21.005662 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf222daf-cde6-487a-a00b-1bf6f8ccb9db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:21.006027 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf222daf-cde6-487a-a00b-1bf6f8ccb9db admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:21.006405 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf222daf-cde6-487a-a00b-1bf6f8ccb9db admin admin] PATH_INFO: `/v3/users/97bdf19af9e34fc3886ff451cb9d7a27` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:21.007872 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf222daf-cde6-487a-a00b-1bf6f8ccb9db admin admin] RBAC: Authorizing `identity:delete_user(user_id=97bdf19af9e34fc3886ff451cb9d7a27)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:21.010231 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf222daf-cde6-487a-a00b-1bf6f8ccb9db admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:21.018276 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-904d07d5-d8c4-454d-be99-c1bd5d3a2858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04281eeefa384c409f8db63a0a14caa5'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.030598 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-904d07d5-d8c4-454d-be99-c1bd5d3a2858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04281eeefa384c409f8db63a0a14caa5'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.038798 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-904d07d5-d8c4-454d-be99-c1bd5d3a2858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04281eeefa384c409f8db63a0a14caa5'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.039568 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-904d07d5-d8c4-454d-be99-c1bd5d3a2858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04281eeefa384c409f8db63a0a14caa5'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.040183 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-904d07d5-d8c4-454d-be99-c1bd5d3a2858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04281eeefa384c409f8db63a0a14caa5'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.052739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1445/2883] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:43:20 2021] DELETE /identity/v3/users/04281eeefa384c409f8db63a0a14caa5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:21.056074 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-bf222daf-cde6-487a-a00b-1bf6f8ccb9db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97bdf19af9e34fc3886ff451cb9d7a27'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.068136 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-bf222daf-cde6-487a-a00b-1bf6f8ccb9db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97bdf19af9e34fc3886ff451cb9d7a27'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.075323 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-bf222daf-cde6-487a-a00b-1bf6f8ccb9db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97bdf19af9e34fc3886ff451cb9d7a27'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.082226 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-bf222daf-cde6-487a-a00b-1bf6f8ccb9db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97bdf19af9e34fc3886ff451cb9d7a27'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.082903 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-bf222daf-cde6-487a-a00b-1bf6f8ccb9db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97bdf19af9e34fc3886ff451cb9d7a27'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.089419 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1439/2884] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:43:20 2021] DELETE /identity/v3/users/97bdf19af9e34fc3886ff451cb9d7a27 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:43:21.237840 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d07d5-d8c4-454d-be99-c1bd5d3a2858 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:21.239495 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-904d07d5-d8c4-454d-be99-c1bd5d3a2858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:21.266525 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf222daf-cde6-487a-a00b-1bf6f8ccb9db admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:21.267933 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-bf222daf-cde6-487a-a00b-1bf6f8ccb9db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:21.310447 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d07d5-d8c4-454d-be99-c1bd5d3a2858 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:21.334457 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf222daf-cde6-487a-a00b-1bf6f8ccb9db admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:21.339471 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb9d66-251c-465d-8b43-ee313a0882e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:21.340317 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb9d66-251c-465d-8b43-ee313a0882e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:21.340598 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb9d66-251c-465d-8b43-ee313a0882e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:21.340871 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb9d66-251c-465d-8b43-ee313a0882e0 admin admin] PATH_INFO: `/v3/projects/494b56bf5eae4d56a5591546f85bc32b` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:21.342175 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb9d66-251c-465d-8b43-ee313a0882e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=494b56bf5eae4d56a5591546f85bc32b)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:21.344046 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb9d66-251c-465d-8b43-ee313a0882e0 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:21.365369 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae9efd-cf13-48db-b649-9a1b8cce7ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:21.366255 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae9efd-cf13-48db-b649-9a1b8cce7ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:21.366537 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae9efd-cf13-48db-b649-9a1b8cce7ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:21.366813 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae9efd-cf13-48db-b649-9a1b8cce7ab3 admin admin] PATH_INFO: `/v3/projects/14d3cdfdfd3e42c796af8e272c2212f9` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:21.367994 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae9efd-cf13-48db-b649-9a1b8cce7ab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d3cdfdfd3e42c796af8e272c2212f9)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:21.370384 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae9efd-cf13-48db-b649-9a1b8cce7ab3 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:21.389917 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fceb9d66-251c-465d-8b43-ee313a0882e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494b56bf5eae4d56a5591546f85bc32b', 'request_id': 'req-fceb9d66-251c-465d-8b43-ee313a0882e0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.397821 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fceb9d66-251c-465d-8b43-ee313a0882e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494b56bf5eae4d56a5591546f85bc32b', 'request_id': 'req-fceb9d66-251c-465d-8b43-ee313a0882e0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.404473 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fceb9d66-251c-465d-8b43-ee313a0882e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494b56bf5eae4d56a5591546f85bc32b', 'request_id': 'req-fceb9d66-251c-465d-8b43-ee313a0882e0'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.415119 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fceb9d66-251c-465d-8b43-ee313a0882e0 admin admin] The token cache is being invalidate because project 494b56bf5eae4d56a5591546f85bc32b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:43:21.415410 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fceb9d66-251c-465d-8b43-ee313a0882e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.416085 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-fceb9d66-251c-465d-8b43-ee313a0882e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.417596 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1440/2885] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:43:21 2021] DELETE /identity/v3/projects/494b56bf5eae4d56a5591546f85bc32b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:21.420549 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-20ae9efd-cf13-48db-b649-9a1b8cce7ab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d3cdfdfd3e42c796af8e272c2212f9', 'request_id': 'req-20ae9efd-cf13-48db-b649-9a1b8cce7ab3'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.421297 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb9d66-251c-465d-8b43-ee313a0882e0 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:21.422626 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-fceb9d66-251c-465d-8b43-ee313a0882e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:21.428204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-20ae9efd-cf13-48db-b649-9a1b8cce7ab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d3cdfdfd3e42c796af8e272c2212f9', 'request_id': 'req-20ae9efd-cf13-48db-b649-9a1b8cce7ab3'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.434669 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-20ae9efd-cf13-48db-b649-9a1b8cce7ab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d3cdfdfd3e42c796af8e272c2212f9', 'request_id': 'req-20ae9efd-cf13-48db-b649-9a1b8cce7ab3'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.445054 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-20ae9efd-cf13-48db-b649-9a1b8cce7ab3 admin admin] The token cache is being invalidate because project 14d3cdfdfd3e42c796af8e272c2212f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:43:21.445337 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-20ae9efd-cf13-48db-b649-9a1b8cce7ab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.445972 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-20ae9efd-cf13-48db-b649-9a1b8cce7ab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.447721 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1446/2886] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:43:21 2021] DELETE /identity/v3/projects/14d3cdfdfd3e42c796af8e272c2212f9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:21.452858 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3985b2b-8d1a-460b-9a10-841d6d2cb09c None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:21.453137 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3985b2b-8d1a-460b-9a10-841d6d2cb09c None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:21.453412 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3985b2b-8d1a-460b-9a10-841d6d2cb09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:21.471434 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-d3985b2b-8d1a-460b-9a10-841d6d2cb09c None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:43:21.472610 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-d3985b2b-8d1a-460b-9a10-841d6d2cb09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:21.484857 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb9d66-251c-465d-8b43-ee313a0882e0 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:21.529495 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1447/2887] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:43:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:43:21.538535 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f729e-6dca-425d-9223-ed6bff0b30b3 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:21.538825 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f729e-6dca-425d-9223-ed6bff0b30b3 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:21.538939 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5066636-34cd-49d5-96e9-7d29bfe68509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:21.539107 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f729e-6dca-425d-9223-ed6bff0b30b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:21.539731 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5066636-34cd-49d5-96e9-7d29bfe68509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:21.540013 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5066636-34cd-49d5-96e9-7d29bfe68509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:21.540281 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5066636-34cd-49d5-96e9-7d29bfe68509 admin admin] PATH_INFO: `/v3/users/a8dc1ac9ae974c5a963602603d51b784` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:21.552763 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5066636-34cd-49d5-96e9-7d29bfe68509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8dc1ac9ae974c5a963602603d51b784)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:21.554718 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5066636-34cd-49d5-96e9-7d29bfe68509 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:21.556587 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-4e0f729e-6dca-425d-9223-ed6bff0b30b3 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:43:21.557802 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-4e0f729e-6dca-425d-9223-ed6bff0b30b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:21.565582 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1448/2888] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:43:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:43:21.570072 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f729e-6dca-425d-9223-ed6bff0b30b3 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:21.580228 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f729e-6dca-425d-9223-ed6bff0b30b3 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:21.586570 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19755f42-0a27-4c1b-8987-1815c524d055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:21.587775 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19755f42-0a27-4c1b-8987-1815c524d055 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:21.587967 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19755f42-0a27-4c1b-8987-1815c524d055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:21.588288 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19755f42-0a27-4c1b-8987-1815c524d055 admin admin] PATH_INFO: `/v3/domains` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:21.589116 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19755f42-0a27-4c1b-8987-1815c524d055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:43:21.589425 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19755f42-0a27-4c1b-8987-1815c524d055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:21.591062 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19755f42-0a27-4c1b-8987-1815c524d055 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:21.601232 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d5066636-34cd-49d5-96e9-7d29bfe68509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8dc1ac9ae974c5a963602603d51b784'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.606737 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1449/2889] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:43:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 03:43:21.607641 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19755f42-0a27-4c1b-8987-1815c524d055 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:21.612501 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d5066636-34cd-49d5-96e9-7d29bfe68509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8dc1ac9ae974c5a963602603d51b784'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.618050 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19755f42-0a27-4c1b-8987-1815c524d055 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:21.620456 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d5066636-34cd-49d5-96e9-7d29bfe68509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8dc1ac9ae974c5a963602603d51b784'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.623124 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23eb5a-cd2f-4264-baa5-10ba762189a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:21.623744 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23eb5a-cd2f-4264-baa5-10ba762189a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:21.624022 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23eb5a-cd2f-4264-baa5-10ba762189a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:21.624295 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23eb5a-cd2f-4264-baa5-10ba762189a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:21.624972 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23eb5a-cd2f-4264-baa5-10ba762189a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:21.626892 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23eb5a-cd2f-4264-baa5-10ba762189a0 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:21.627146 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d5066636-34cd-49d5-96e9-7d29bfe68509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8dc1ac9ae974c5a963602603d51b784'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.627815 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-d5066636-34cd-49d5-96e9-7d29bfe68509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8dc1ac9ae974c5a963602603d51b784'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.634476 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1441/2890] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:43:21 2021] DELETE /identity/v3/users/a8dc1ac9ae974c5a963602603d51b784 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:43:21.653730 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1450/2891] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:43:21 2021] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:43:21.657635 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5066636-34cd-49d5-96e9-7d29bfe68509 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:21.659113 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-d5066636-34cd-49d5-96e9-7d29bfe68509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:21.721269 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5066636-34cd-49d5-96e9-7d29bfe68509 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:21.776273 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a310485-b045-44e1-a522-a8eba7fe2891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:21.776932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a310485-b045-44e1-a522-a8eba7fe2891 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:21.777236 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a310485-b045-44e1-a522-a8eba7fe2891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:21.777511 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a310485-b045-44e1-a522-a8eba7fe2891 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:21.778229 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a310485-b045-44e1-a522-a8eba7fe2891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:21.780134 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a310485-b045-44e1-a522-a8eba7fe2891 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:21.802691 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1442/2892] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:43:21 2021] POST /identity/v3/users => generated 281 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:43:21.804111 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a310485-b045-44e1-a522-a8eba7fe2891 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:21.804862 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23eb5a-cd2f-4264-baa5-10ba762189a0 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:21.805763 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-1a310485-b045-44e1-a522-a8eba7fe2891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:21.816460 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23eb5a-cd2f-4264-baa5-10ba762189a0 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:21.817606 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a310485-b045-44e1-a522-a8eba7fe2891 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:21.822500 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2e0e2-d12e-4fbc-8d50-a4b189780859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:21.823306 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2e0e2-d12e-4fbc-8d50-a4b189780859 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:21.823591 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42923c8a-de10-48e2-89aa-a6e34f882667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:21.823742 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2e0e2-d12e-4fbc-8d50-a4b189780859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:21.823865 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2e0e2-d12e-4fbc-8d50-a4b189780859 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:21.824561 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42923c8a-de10-48e2-89aa-a6e34f882667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:21.824693 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2e0e2-d12e-4fbc-8d50-a4b189780859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:21.824841 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42923c8a-de10-48e2-89aa-a6e34f882667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:21.825289 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42923c8a-de10-48e2-89aa-a6e34f882667 admin admin] PATH_INFO: `/v3/projects/0fe33ee304da4434be871865c6619a09` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:21.826309 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2e0e2-d12e-4fbc-8d50-a4b189780859 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:21.836399 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42923c8a-de10-48e2-89aa-a6e34f882667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe33ee304da4434be871865c6619a09)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:21.836632 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1451/2893] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:43:21 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:43:21.838966 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42923c8a-de10-48e2-89aa-a6e34f882667 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:21.840739 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2e0e2-d12e-4fbc-8d50-a4b189780859 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:21.850296 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2e0e2-d12e-4fbc-8d50-a4b189780859 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:21.855004 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc3966-6024-4be0-bdec-cf86bae03b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:21.855644 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc3966-6024-4be0-bdec-cf86bae03b39 admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:21.855928 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc3966-6024-4be0-bdec-cf86bae03b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:21.856207 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc3966-6024-4be0-bdec-cf86bae03b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:21.856926 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc3966-6024-4be0-bdec-cf86bae03b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:21.858524 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc3966-6024-4be0-bdec-cf86bae03b39 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:21.869287 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1452/2894] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:43:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:43:21.873352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc3966-6024-4be0-bdec-cf86bae03b39 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:21.883656 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc3966-6024-4be0-bdec-cf86bae03b39 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:21.886768 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-42923c8a-de10-48e2-89aa-a6e34f882667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe33ee304da4434be871865c6619a09', 'request_id': 'req-42923c8a-de10-48e2-89aa-a6e34f882667'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.894210 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-42923c8a-de10-48e2-89aa-a6e34f882667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe33ee304da4434be871865c6619a09', 'request_id': 'req-42923c8a-de10-48e2-89aa-a6e34f882667'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.900904 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-42923c8a-de10-48e2-89aa-a6e34f882667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe33ee304da4434be871865c6619a09', 'request_id': 'req-42923c8a-de10-48e2-89aa-a6e34f882667'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.910776 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-42923c8a-de10-48e2-89aa-a6e34f882667 admin admin] The token cache is being invalidate because project 0fe33ee304da4434be871865c6619a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:43:21.911057 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-42923c8a-de10-48e2-89aa-a6e34f882667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.911720 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-42923c8a-de10-48e2-89aa-a6e34f882667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:21.913450 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1443/2895] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:43:21 2021] DELETE /identity/v3/projects/0fe33ee304da4434be871865c6619a09 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:21.941554 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd030b-d895-4cd4-8ffb-442ccd1e4add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:21.942501 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd030b-d895-4cd4-8ffb-442ccd1e4add admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:21.943348 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd030b-d895-4cd4-8ffb-442ccd1e4add admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:21.943631 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd030b-d895-4cd4-8ffb-442ccd1e4add admin admin] PATH_INFO: `/v3/projects/ff367f8c1a324f0383c21701a1d204d7/users/b321e6f7e130413eb8957ed5b230a478/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:21.960079 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd030b-d895-4cd4-8ffb-442ccd1e4add admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff367f8c1a324f0383c21701a1d204d7, user_id=b321e6f7e130413eb8957ed5b230a478, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:21.963030 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd030b-d895-4cd4-8ffb-442ccd1e4add admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:21.977512 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1453/2896] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:43:21 2021] PUT /identity/v3/projects/ff367f8c1a324f0383c21701a1d204d7/users/b321e6f7e130413eb8957ed5b230a478/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:43:21.988321 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3aec0-7905-4b7f-a1e2-92af12c8a24d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:21.988611 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3aec0-7905-4b7f-a1e2-92af12c8a24d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:21.988892 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3aec0-7905-4b7f-a1e2-92af12c8a24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:22.018885 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-b5f3aec0-7905-4b7f-a1e2-92af12c8a24d None None] MFA Rules not processed for user `b321e6f7e130413eb8957ed5b230a478`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:43:22.020102 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b5f3aec0-7905-4b7f-a1e2-92af12c8a24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:22.087878 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1444/2897] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:43:21 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:43:22.117409 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd030b-d895-4cd4-8ffb-442ccd1e4add admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:22.119139 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-edbd030b-d895-4cd4-8ffb-442ccd1e4add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:22.172603 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd030b-d895-4cd4-8ffb-442ccd1e4add admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:22.176152 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08820144-8bc9-4c26-ab1d-934b32332939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:22.176780 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08820144-8bc9-4c26-ab1d-934b32332939 service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:22.177715 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08820144-8bc9-4c26-ab1d-934b32332939 service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:22.178016 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08820144-8bc9-4c26-ab1d-934b32332939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:22.186123 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08820144-8bc9-4c26-ab1d-934b32332939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:22.187537 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08820144-8bc9-4c26-ab1d-934b32332939 service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:22.196247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1454/2898] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:43:22 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:43:22.210663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3aec0-7905-4b7f-a1e2-92af12c8a24d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:22.212293 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b5f3aec0-7905-4b7f-a1e2-92af12c8a24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:22.275619 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3aec0-7905-4b7f-a1e2-92af12c8a24d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:22.280141 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dac6a-3fa6-424c-b09b-f34cfe59424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:22.281006 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dac6a-3fa6-424c-b09b-f34cfe59424f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:22.281281 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dac6a-3fa6-424c-b09b-f34cfe59424f admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:22.281551 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dac6a-3fa6-424c-b09b-f34cfe59424f admin admin] PATH_INFO: `/v3/users/b321e6f7e130413eb8957ed5b230a478` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:22.282786 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dac6a-3fa6-424c-b09b-f34cfe59424f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b321e6f7e130413eb8957ed5b230a478)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:22.284679 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dac6a-3fa6-424c-b09b-f34cfe59424f admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:22.329490 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ba4dac6a-3fa6-424c-b09b-f34cfe59424f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b321e6f7e130413eb8957ed5b230a478'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:22.341316 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ba4dac6a-3fa6-424c-b09b-f34cfe59424f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b321e6f7e130413eb8957ed5b230a478'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:22.347563 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ba4dac6a-3fa6-424c-b09b-f34cfe59424f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b321e6f7e130413eb8957ed5b230a478'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:22.354753 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ba4dac6a-3fa6-424c-b09b-f34cfe59424f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b321e6f7e130413eb8957ed5b230a478'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:22.355402 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-ba4dac6a-3fa6-424c-b09b-f34cfe59424f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b321e6f7e130413eb8957ed5b230a478'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:22.361153 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1445/2899] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:43:22 2021] DELETE /identity/v3/users/b321e6f7e130413eb8957ed5b230a478 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:22.366352 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbd5bb-c405-4331-88e2-2242100fe2b4 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:22.366838 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbd5bb-c405-4331-88e2-2242100fe2b4 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:22.366938 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbd5bb-c405-4331-88e2-2242100fe2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:22.383965 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-f0bbd5bb-c405-4331-88e2-2242100fe2b4 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:43:22.385123 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f0bbd5bb-c405-4331-88e2-2242100fe2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:22.439717 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1455/2900] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:43:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 03:43:22.449675 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dac6a-3fa6-424c-b09b-f34cfe59424f admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:22.451071 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-ba4dac6a-3fa6-424c-b09b-f34cfe59424f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:22.505700 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dac6a-3fa6-424c-b09b-f34cfe59424f admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:22.509302 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89650a-e7e9-423a-b91f-48a682371467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:22.509926 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89650a-e7e9-423a-b91f-48a682371467 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:22.510233 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89650a-e7e9-423a-b91f-48a682371467 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:22.510507 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89650a-e7e9-423a-b91f-48a682371467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:22.519238 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89650a-e7e9-423a-b91f-48a682371467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:22.520669 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89650a-e7e9-423a-b91f-48a682371467 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:22.530340 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1446/2901] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:43:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:43:22.780005 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbd5bb-c405-4331-88e2-2242100fe2b4 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:22.781577 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-f0bbd5bb-c405-4331-88e2-2242100fe2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:22.795685 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbd5bb-c405-4331-88e2-2242100fe2b4 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:22.800307 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613be4c-f437-4181-a1b2-ad3e375ac711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:22.801260 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613be4c-f437-4181-a1b2-ad3e375ac711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:22.801408 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613be4c-f437-4181-a1b2-ad3e375ac711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:22.801662 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613be4c-f437-4181-a1b2-ad3e375ac711 admin admin] PATH_INFO: `/v3/projects/ff367f8c1a324f0383c21701a1d204d7` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:22.802913 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613be4c-f437-4181-a1b2-ad3e375ac711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff367f8c1a324f0383c21701a1d204d7)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:22.804835 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613be4c-f437-4181-a1b2-ad3e375ac711 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:22.850367 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4613be4c-f437-4181-a1b2-ad3e375ac711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff367f8c1a324f0383c21701a1d204d7', 'request_id': 'req-4613be4c-f437-4181-a1b2-ad3e375ac711'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:22.857172 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4613be4c-f437-4181-a1b2-ad3e375ac711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff367f8c1a324f0383c21701a1d204d7', 'request_id': 'req-4613be4c-f437-4181-a1b2-ad3e375ac711'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:22.862986 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4613be4c-f437-4181-a1b2-ad3e375ac711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff367f8c1a324f0383c21701a1d204d7', 'request_id': 'req-4613be4c-f437-4181-a1b2-ad3e375ac711'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:22.872677 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4613be4c-f437-4181-a1b2-ad3e375ac711 admin admin] The token cache is being invalidate because project ff367f8c1a324f0383c21701a1d204d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:43:22.872900 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4613be4c-f437-4181-a1b2-ad3e375ac711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:22.873521 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-4613be4c-f437-4181-a1b2-ad3e375ac711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:22.875031 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1456/2902] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:43:22 2021] DELETE /identity/v3/projects/ff367f8c1a324f0383c21701a1d204d7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:22.881084 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2a114-63b8-4078-b934-23507b327761 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:22.881570 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2a114-63b8-4078-b934-23507b327761 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:22.881696 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2a114-63b8-4078-b934-23507b327761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:22.899419 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-65c2a114-63b8-4078-b934-23507b327761 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:43:22.900605 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-65c2a114-63b8-4078-b934-23507b327761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:22.957356 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1447/2903] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:43:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:43:22.966921 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e30229-a7cd-4d13-bc58-b82082e6a576 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:22.967211 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e30229-a7cd-4d13-bc58-b82082e6a576 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:22.967487 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e30229-a7cd-4d13-bc58-b82082e6a576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:22.985331 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-a1e30229-a7cd-4d13-bc58-b82082e6a576 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:43:22.986532 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-a1e30229-a7cd-4d13-bc58-b82082e6a576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:22.994138 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1457/2904] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:43:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:43:22.998218 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2a114-63b8-4078-b934-23507b327761 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:23.008096 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2a114-63b8-4078-b934-23507b327761 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:23.012555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841589-61ac-42d1-9941-c0b306b8cbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:23.013188 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841589-61ac-42d1-9941-c0b306b8cbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:23.013468 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841589-61ac-42d1-9941-c0b306b8cbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:23.013741 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841589-61ac-42d1-9941-c0b306b8cbd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:23.014504 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79841589-61ac-42d1-9941-c0b306b8cbd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 03:43:23.014811 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79841589-61ac-42d1-9941-c0b306b8cbd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:23.016394 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79841589-61ac-42d1-9941-c0b306b8cbd7 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:23.028189 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1448/2905] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Dec 15 03:43:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 03:43:23.032509 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e30229-a7cd-4d13-bc58-b82082e6a576 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:23.041602 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e30229-a7cd-4d13-bc58-b82082e6a576 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:23.046191 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc46ca-b6b6-4fae-b6b2-688b291d471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:23.046826 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc46ca-b6b6-4fae-b6b2-688b291d471b admin admin] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:23.047110 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc46ca-b6b6-4fae-b6b2-688b291d471b admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:23.047390 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc46ca-b6b6-4fae-b6b2-688b291d471b admin admin] PATH_INFO: `/v3/projects` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:23.048083 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc46ca-b6b6-4fae-b6b2-688b291d471b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:23.050004 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc46ca-b6b6-4fae-b6b2-688b291d471b admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:23.077204 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1458/2906] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Dec 15 03:43:23 2021] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 03:43:23.078623 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841589-61ac-42d1-9941-c0b306b8cbd7 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:23.088995 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841589-61ac-42d1-9941-c0b306b8cbd7 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:23.142324 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbd5f5-acf5-406a-b2ff-eb41eade11a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:23.142930 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbd5f5-acf5-406a-b2ff-eb41eade11a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:23.143198 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbd5f5-acf5-406a-b2ff-eb41eade11a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:23.143477 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbd5f5-acf5-406a-b2ff-eb41eade11a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:23.144165 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbd5f5-acf5-406a-b2ff-eb41eade11a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:23.146733 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbd5f5-acf5-406a-b2ff-eb41eade11a4 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:23.165074 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1449/2907] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Dec 15 03:43:23 2021] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 03:43:23.169026 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc46ca-b6b6-4fae-b6b2-688b291d471b admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:23.178852 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc46ca-b6b6-4fae-b6b2-688b291d471b admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:23.183326 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3511777-ab45-4ec5-8075-0072cb80c3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:23.183966 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3511777-ab45-4ec5-8075-0072cb80c3ff admin admin] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:23.184245 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3511777-ab45-4ec5-8075-0072cb80c3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:23.184515 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3511777-ab45-4ec5-8075-0072cb80c3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:23.185233 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3511777-ab45-4ec5-8075-0072cb80c3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:23.186834 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3511777-ab45-4ec5-8075-0072cb80c3ff admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:23.198706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1459/2908] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:43:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:43:23.201948 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbd5f5-acf5-406a-b2ff-eb41eade11a4 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:23.212771 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbd5f5-acf5-406a-b2ff-eb41eade11a4 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:23.217376 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd18c4-ba23-45ad-be1f-48070bd58f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:23.218045 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd18c4-ba23-45ad-be1f-48070bd58f25 admin admin] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:23.218332 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd18c4-ba23-45ad-be1f-48070bd58f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:23.218610 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd18c4-ba23-45ad-be1f-48070bd58f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:23.219341 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd18c4-ba23-45ad-be1f-48070bd58f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:23.221132 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd18c4-ba23-45ad-be1f-48070bd58f25 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:23.232770 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1450/2909] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Dec 15 03:43:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 03:43:23.236770 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3511777-ab45-4ec5-8075-0072cb80c3ff admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:23.246842 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3511777-ab45-4ec5-8075-0072cb80c3ff admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:23.251331 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1868eee-d772-488e-941c-57d2fd86a4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:23.252186 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1868eee-d772-488e-941c-57d2fd86a4b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:23.252460 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1868eee-d772-488e-941c-57d2fd86a4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:23.252730 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1868eee-d772-488e-941c-57d2fd86a4b6 admin admin] PATH_INFO: `/v3/projects/80db17ce95924ce2b239cf7b56b74b0e/users/c965b7cbe233477b8cf9fe5027305b4a/roles/69edf382652b443c97811919233bb991` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:23.267149 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1868eee-d772-488e-941c-57d2fd86a4b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80db17ce95924ce2b239cf7b56b74b0e, user_id=c965b7cbe233477b8cf9fe5027305b4a, role_id=69edf382652b443c97811919233bb991)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:23.269777 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1868eee-d772-488e-941c-57d2fd86a4b6 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:23.282345 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1460/2910] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Dec 15 03:43:23 2021] PUT /identity/v3/projects/80db17ce95924ce2b239cf7b56b74b0e/users/c965b7cbe233477b8cf9fe5027305b4a/roles/69edf382652b443c97811919233bb991 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:23.292360 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4337a-a2ba-41c7-afdc-a8efd1ffab2d None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:23.292647 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4337a-a2ba-41c7-afdc-a8efd1ffab2d None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:23.292919 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4337a-a2ba-41c7-afdc-a8efd1ffab2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:23.319381 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-63f4337a-a2ba-41c7-afdc-a8efd1ffab2d None None] MFA Rules not processed for user `c965b7cbe233477b8cf9fe5027305b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:43:23.320561 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-63f4337a-a2ba-41c7-afdc-a8efd1ffab2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:23.379579 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1451/2911] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:43:23 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:43:23.389706 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1868eee-d772-488e-941c-57d2fd86a4b6 admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:23.391347 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-b1868eee-d772-488e-941c-57d2fd86a4b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:23.445889 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1868eee-d772-488e-941c-57d2fd86a4b6 admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:23.449407 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e4e66-8e56-4157-a4d2-5ca410f93feb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd543ba91ee284c1384f15fb70910caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:23.450077 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e4e66-8e56-4157-a4d2-5ca410f93feb service cinder] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:23.450359 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e4e66-8e56-4157-a4d2-5ca410f93feb service cinder] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:23.450634 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e4e66-8e56-4157-a4d2-5ca410f93feb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:23.458714 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e4e66-8e56-4157-a4d2-5ca410f93feb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:23.460134 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e4e66-8e56-4157-a4d2-5ca410f93feb service cinder] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:23.468804 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1461/2912] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:43:23 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:43:33.132939 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4337a-a2ba-41c7-afdc-a8efd1ffab2d None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:33.198992 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4337a-a2ba-41c7-afdc-a8efd1ffab2d None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:33.203981 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d066be-f6c1-48c2-b18d-48ee1a091cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:33.204932 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d066be-f6c1-48c2-b18d-48ee1a091cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:33.205292 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d066be-f6c1-48c2-b18d-48ee1a091cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:33.205643 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d066be-f6c1-48c2-b18d-48ee1a091cfb admin admin] PATH_INFO: `/v3/users/c965b7cbe233477b8cf9fe5027305b4a` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:33.207129 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d066be-f6c1-48c2-b18d-48ee1a091cfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c965b7cbe233477b8cf9fe5027305b4a)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:33.209610 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d066be-f6c1-48c2-b18d-48ee1a091cfb admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:33.261141 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b3d066be-f6c1-48c2-b18d-48ee1a091cfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c965b7cbe233477b8cf9fe5027305b4a'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:33.275148 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b3d066be-f6c1-48c2-b18d-48ee1a091cfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c965b7cbe233477b8cf9fe5027305b4a'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:33.284011 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b3d066be-f6c1-48c2-b18d-48ee1a091cfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c965b7cbe233477b8cf9fe5027305b4a'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:33.292589 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b3d066be-f6c1-48c2-b18d-48ee1a091cfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c965b7cbe233477b8cf9fe5027305b4a'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:33.293299 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-b3d066be-f6c1-48c2-b18d-48ee1a091cfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c965b7cbe233477b8cf9fe5027305b4a'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:33.303267 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1452/2913] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:43:33 2021] DELETE /identity/v3/users/c965b7cbe233477b8cf9fe5027305b4a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:33.305154 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17280122-3ab0-4733-b472-9e940a4d9ed9 None None] REQUEST_METHOD: `POST` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:33.305691 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17280122-3ab0-4733-b472-9e940a4d9ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:33.306276 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17280122-3ab0-4733-b472-9e940a4d9ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:33.329871 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.auth.core [None req-17280122-3ab0-4733-b472-9e940a4d9ed9 None None] MFA Rules not processed for user `3bbde01a62314e839f70db08ddf77996`. Rule list: `[]` (Enabled: `True`). {{(pid=79173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:43:33.331132 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-17280122-3ab0-4733-b472-9e940a4d9ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:33.395027 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1462/2914] 10.222.0.18 () {58 vars in 957 bytes} [Wed Dec 15 03:43:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:43:33.405134 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d066be-f6c1-48c2-b18d-48ee1a091cfb admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:33.406598 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-b3d066be-f6c1-48c2-b18d-48ee1a091cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:33.465780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d066be-f6c1-48c2-b18d-48ee1a091cfb admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:33.469532 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6fc54-b9f5-4088-a79a-53b96edce8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb120cde66b246909cf8e0b7b8d96ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:33.470217 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6fc54-b9f5-4088-a79a-53b96edce8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:33.470501 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6fc54-b9f5-4088-a79a-53b96edce8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:33.470778 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6fc54-b9f5-4088-a79a-53b96edce8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:33.480854 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6fc54-b9f5-4088-a79a-53b96edce8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:33.482787 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6fc54-b9f5-4088-a79a-53b96edce8a1 service neutron] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:33.493189 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1453/2915] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:43:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 03:43:33.770668 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17280122-3ab0-4733-b472-9e940a4d9ed9 None None] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:33.772162 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-17280122-3ab0-4733-b472-9e940a4d9ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:33.784421 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17280122-3ab0-4733-b472-9e940a4d9ed9 None None] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:33.790524 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c4351-ad9b-4282-94dd-bc99d6459c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:33.791662 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c4351-ad9b-4282-94dd-bc99d6459c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:33.792092 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c4351-ad9b-4282-94dd-bc99d6459c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:33.792498 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c4351-ad9b-4282-94dd-bc99d6459c0d admin admin] PATH_INFO: `/v3/projects/80db17ce95924ce2b239cf7b56b74b0e` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:33.794264 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c4351-ad9b-4282-94dd-bc99d6459c0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=80db17ce95924ce2b239cf7b56b74b0e)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:33.796368 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c4351-ad9b-4282-94dd-bc99d6459c0d admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:33.845629 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-871c4351-ad9b-4282-94dd-bc99d6459c0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80db17ce95924ce2b239cf7b56b74b0e', 'request_id': 'req-871c4351-ad9b-4282-94dd-bc99d6459c0d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:33.856793 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-871c4351-ad9b-4282-94dd-bc99d6459c0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80db17ce95924ce2b239cf7b56b74b0e', 'request_id': 'req-871c4351-ad9b-4282-94dd-bc99d6459c0d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:33.863396 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-871c4351-ad9b-4282-94dd-bc99d6459c0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80db17ce95924ce2b239cf7b56b74b0e', 'request_id': 'req-871c4351-ad9b-4282-94dd-bc99d6459c0d'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:33.874482 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-871c4351-ad9b-4282-94dd-bc99d6459c0d admin admin] The token cache is being invalidate because project 80db17ce95924ce2b239cf7b56b74b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:43:33.874790 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-871c4351-ad9b-4282-94dd-bc99d6459c0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:33.875483 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-871c4351-ad9b-4282-94dd-bc99d6459c0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:33.877395 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1463/2916] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:43:33 2021] DELETE /identity/v3/projects/80db17ce95924ce2b239cf7b56b74b0e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:39.158157 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4062a29-bf6f-40fb-87eb-d90614bf5764 None None] REQUEST_METHOD: `POST` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:39.158627 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4062a29-bf6f-40fb-87eb-d90614bf5764 None None] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:39.158740 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4062a29-bf6f-40fb-87eb-d90614bf5764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:39.175424 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.auth.core [None req-c4062a29-bf6f-40fb-87eb-d90614bf5764 None None] MFA Rules not processed for user `39cddc4e2ea943cd882b6a1addd98e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 03:43:39.176555 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c4062a29-bf6f-40fb-87eb-d90614bf5764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:39.228809 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1454/2917] 10.222.0.18 () {58 vars in 967 bytes} [Wed Dec 15 03:43:39 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 03:43:39.269188 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c4351-ad9b-4282-94dd-bc99d6459c0d admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:39.270633 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-871c4351-ad9b-4282-94dd-bc99d6459c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:39.338247 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c4351-ad9b-4282-94dd-bc99d6459c0d admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:39.343186 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d450675-94f3-4cec-a14b-6f8fc0a2a8c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb0af7ac70d48989852c022c9f83848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:39.343822 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450675-94f3-4cec-a14b-6f8fc0a2a8c1 service swift] REQUEST_METHOD: `GET` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:39.344103 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450675-94f3-4cec-a14b-6f8fc0a2a8c1 service swift] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:39.344381 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450675-94f3-4cec-a14b-6f8fc0a2a8c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:39.352705 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d450675-94f3-4cec-a14b-6f8fc0a2a8c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:39.354298 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d450675-94f3-4cec-a14b-6f8fc0a2a8c1 service swift] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:39.361961 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1464/2918] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Dec 15 03:43:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 03:43:45.867495 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4062a29-bf6f-40fb-87eb-d90614bf5764 None None] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:45.869101 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-c4062a29-bf6f-40fb-87eb-d90614bf5764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:45.935447 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4062a29-bf6f-40fb-87eb-d90614bf5764 None None] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:45.939823 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dc6c0-0dae-41de-a4f8-e9e37443fd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:45.940670 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dc6c0-0dae-41de-a4f8-e9e37443fd15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:45.940985 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dc6c0-0dae-41de-a4f8-e9e37443fd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:45.941214 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dc6c0-0dae-41de-a4f8-e9e37443fd15 admin admin] PATH_INFO: `/v3/users/478d1c76208642f89d96afdf22f79829` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:45.942450 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9dc6c0-0dae-41de-a4f8-e9e37443fd15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=478d1c76208642f89d96afdf22f79829)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:45.944372 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9dc6c0-0dae-41de-a4f8-e9e37443fd15 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:45.987816 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-9e9dc6c0-0dae-41de-a4f8-e9e37443fd15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478d1c76208642f89d96afdf22f79829'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:45.999115 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-9e9dc6c0-0dae-41de-a4f8-e9e37443fd15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478d1c76208642f89d96afdf22f79829'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.006207 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-9e9dc6c0-0dae-41de-a4f8-e9e37443fd15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478d1c76208642f89d96afdf22f79829'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.013499 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-9e9dc6c0-0dae-41de-a4f8-e9e37443fd15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478d1c76208642f89d96afdf22f79829'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.014169 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-9e9dc6c0-0dae-41de-a4f8-e9e37443fd15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478d1c76208642f89d96afdf22f79829'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.019728 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1455/2919] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:43:45 2021] DELETE /identity/v3/users/478d1c76208642f89d96afdf22f79829 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:46.186751 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d450675-94f3-4cec-a14b-6f8fc0a2a8c1 service swift] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:46.197261 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d450675-94f3-4cec-a14b-6f8fc0a2a8c1 service swift] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:46.261228 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47a26c-196d-48f5-ae48-42b5d19651ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:46.262216 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47a26c-196d-48f5-ae48-42b5d19651ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:46.262404 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47a26c-196d-48f5-ae48-42b5d19651ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:46.262708 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47a26c-196d-48f5-ae48-42b5d19651ae admin admin] PATH_INFO: `/v3/projects/0f9dcbfd69bc450691e2b036e864f7d9` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:46.263988 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47a26c-196d-48f5-ae48-42b5d19651ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f9dcbfd69bc450691e2b036e864f7d9)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:46.265882 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47a26c-196d-48f5-ae48-42b5d19651ae admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:46.311309 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6e47a26c-196d-48f5-ae48-42b5d19651ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f9dcbfd69bc450691e2b036e864f7d9', 'request_id': 'req-6e47a26c-196d-48f5-ae48-42b5d19651ae'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.318598 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6e47a26c-196d-48f5-ae48-42b5d19651ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f9dcbfd69bc450691e2b036e864f7d9', 'request_id': 'req-6e47a26c-196d-48f5-ae48-42b5d19651ae'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.324809 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6e47a26c-196d-48f5-ae48-42b5d19651ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f9dcbfd69bc450691e2b036e864f7d9', 'request_id': 'req-6e47a26c-196d-48f5-ae48-42b5d19651ae'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.334753 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6e47a26c-196d-48f5-ae48-42b5d19651ae admin admin] The token cache is being invalidate because project 0f9dcbfd69bc450691e2b036e864f7d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:43:46.335044 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6e47a26c-196d-48f5-ae48-42b5d19651ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.335688 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-6e47a26c-196d-48f5-ae48-42b5d19651ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.337703 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1465/2920] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:43:46 2021] DELETE /identity/v3/projects/0f9dcbfd69bc450691e2b036e864f7d9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:43:46.341663 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dc6c0-0dae-41de-a4f8-e9e37443fd15 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:46.343151 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-9e9dc6c0-0dae-41de-a4f8-e9e37443fd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:46.356478 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dc6c0-0dae-41de-a4f8-e9e37443fd15 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:46.410102 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366c7c1-4922-4de9-b250-d6e4f5d7b2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:46.410964 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366c7c1-4922-4de9-b250-d6e4f5d7b2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:46.411247 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366c7c1-4922-4de9-b250-d6e4f5d7b2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:46.411520 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366c7c1-4922-4de9-b250-d6e4f5d7b2a3 admin admin] PATH_INFO: `/v3/users/63e50784ef8f4998abc53643bfc7240a` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:46.412704 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366c7c1-4922-4de9-b250-d6e4f5d7b2a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63e50784ef8f4998abc53643bfc7240a)` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:46.415223 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366c7c1-4922-4de9-b250-d6e4f5d7b2a3 admin admin] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:46.457680 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6366c7c1-4922-4de9-b250-d6e4f5d7b2a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63e50784ef8f4998abc53643bfc7240a'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.469460 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6366c7c1-4922-4de9-b250-d6e4f5d7b2a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63e50784ef8f4998abc53643bfc7240a'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.476780 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6366c7c1-4922-4de9-b250-d6e4f5d7b2a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63e50784ef8f4998abc53643bfc7240a'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.483467 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6366c7c1-4922-4de9-b250-d6e4f5d7b2a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63e50784ef8f4998abc53643bfc7240a'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.484097 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.notifications [None req-6366c7c1-4922-4de9-b250-d6e4f5d7b2a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63e50784ef8f4998abc53643bfc7240a'} {{(pid=79172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.489731 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1456/2921] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Dec 15 03:43:46 2021] DELETE /identity/v3/users/63e50784ef8f4998abc53643bfc7240a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 03:43:46.651399 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47a26c-196d-48f5-ae48-42b5d19651ae admin admin] Authenticating user token {{(pid=79173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:43:46.652900 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.fernet_utils [None req-6e47a26c-196d-48f5-ae48-42b5d19651ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:43:46.666327 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47a26c-196d-48f5-ae48-42b5d19651ae admin admin] Validating token access rules against request {{(pid=79173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:43:46.720807 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502daa9b-9c86-465c-9f1b-c3f19f834912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bbde01a62314e839f70db08ddf77996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f289697819814b2daa5373dc010a1dbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:43:46.721586 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502daa9b-9c86-465c-9f1b-c3f19f834912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:43:46.721870 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502daa9b-9c86-465c-9f1b-c3f19f834912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:43:46.722186 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502daa9b-9c86-465c-9f1b-c3f19f834912 admin admin] PATH_INFO: `/v3/projects/a566d81b2d144447ac54b70262069910` {{(pid=79173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:43:46.723360 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502daa9b-9c86-465c-9f1b-c3f19f834912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a566d81b2d144447ac54b70262069910)` {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:43:46.725249 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502daa9b-9c86-465c-9f1b-c3f19f834912 admin admin] RBAC: Authorization granted {{(pid=79173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:43:46.768944 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-502daa9b-9c86-465c-9f1b-c3f19f834912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a566d81b2d144447ac54b70262069910', 'request_id': 'req-502daa9b-9c86-465c-9f1b-c3f19f834912'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.775687 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-502daa9b-9c86-465c-9f1b-c3f19f834912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a566d81b2d144447ac54b70262069910', 'request_id': 'req-502daa9b-9c86-465c-9f1b-c3f19f834912'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.781824 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-502daa9b-9c86-465c-9f1b-c3f19f834912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a566d81b2d144447ac54b70262069910', 'request_id': 'req-502daa9b-9c86-465c-9f1b-c3f19f834912'} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.791563 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-502daa9b-9c86-465c-9f1b-c3f19f834912 admin admin] The token cache is being invalidate because project a566d81b2d144447ac54b70262069910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 03:43:46.791847 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-502daa9b-9c86-465c-9f1b-c3f19f834912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.792461 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: DEBUG keystone.notifications [None req-502daa9b-9c86-465c-9f1b-c3f19f834912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 03:43:46.793951 dv-cinder-818037-9-iscsi devstack@keystone.service[79173]: [pid: 79173|app: 0|req: 1466/2922] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Dec 15 03:43:46 2021] DELETE /identity/v3/projects/a566d81b2d144447ac54b70262069910 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 03:47:56.075312 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366c7c1-4922-4de9-b250-d6e4f5d7b2a3 admin admin] Authenticating user token {{(pid=79172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 03:47:56.076713 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-6366c7c1-4922-4de9-b250-d6e4f5d7b2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:47:56.188336 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366c7c1-4922-4de9-b250-d6e4f5d7b2a3 admin admin] Validating token access rules against request {{(pid=79172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 03:47:56.244723 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81612a51-17f6-4a06-abfb-0f1ea72aeb6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93762c21f03d44d5bf3881d17e14ef90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa03bf53a5ea4742be5ec4d1b69ac5ce', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 03:47:56.245361 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81612a51-17f6-4a06-abfb-0f1ea72aeb6b service placement] REQUEST_METHOD: `GET` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 03:47:56.245640 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81612a51-17f6-4a06-abfb-0f1ea72aeb6b service placement] SCRIPT_NAME: `/identity` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 03:47:56.245916 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81612a51-17f6-4a06-abfb-0f1ea72aeb6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 03:47:56.247698 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.fernet_utils [None req-81612a51-17f6-4a06-abfb-0f1ea72aeb6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 03:47:56.258496 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81612a51-17f6-4a06-abfb-0f1ea72aeb6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 03:47:56.260067 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81612a51-17f6-4a06-abfb-0f1ea72aeb6b service placement] RBAC: Authorization granted {{(pid=79172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 03:47:56.269608 dv-cinder-818037-9-iscsi devstack@keystone.service[79172]: [pid: 79172|app: 0|req: 1457/2923] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Dec 15 03:47:56 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)